FHIR TX Benchmark
← All runs

Round 0

2026-04-08

Apple M3, 8-core · 24 GB · macOS Tahoe 26.3 · Docker Desktop 4.64.0 (8 CPU / 20 GB)

SNOMED negative lookup

GET /CodeSystem/$lookup?system=http://snomed.info/sct&code=<code>

Inputs are fabricated SNOMED-like codes that do not exist. Verifies that the server correctly handles the not-found case and returns an appropriate OperationOutcome. Both 404 and a 200 OperationOutcome with issue.code = not-found are accepted.

Preflight request 
GET /CodeSystem/$lookup?system=http%3A%2F%2Fsnomed.info%2Fsct&code=999973211009
Accept: application/fhir+json
Ranking
Servers ranked by weighted RPS (wRPS) for this test. wRPS = raw RPS × per-test normalizer × bias factor. Score % is relative to the top performer. Raw RPS is the measured peak throughput; imputed values (shown in italics in orange) are estimated for servers that did not run this test. Status: ✓ preflight passed, ✗ failed, ~ skipped.
# Server wRPS Score RPS Errors Status
1 termbox 5.4K
100%
7.9K 0% ✓
2 fhirsmith 3.9K
73%
5.7K 0% ✓
3 ontoserver 799
15%
1.2K 0% ✓
4 snowstorm 502
9%
733 0% ✓
5 hades 301
6%
440 — ✗
Latency
Latency percentiles per server across all VU levels. Columns: percentile / VU count.
p50/1 p95/1 p99/1 p50/10 p95/10 p99/10 p50/50 p95/50 p99/50
termbox 0.42ms0.52ms0.89ms1.2ms2.1ms4.3ms6.0ms9.4ms14ms
fhirsmith 0.33ms0.41ms0.52ms1.6ms2.4ms4.7ms7.7ms12ms16ms
ontoserver 2.7ms3.4ms4.6ms6.6ms13ms71ms24ms274ms402ms
snowstorm 4.8ms7.3ms11ms12ms22ms45ms62ms143ms254ms