FHIR TX Benchmark
← All runs

Round 0

2026-04-08

Apple M3, 8-core · 24 GB · macOS Tahoe 26.3 · Docker Desktop 4.64.0 (8 CPU / 20 GB)

SNOMED is-a membership

GET /ValueSet/$validate-code?url=http://snomed.info/sct?fhir_vs=isa/<root>&code=<code>

Validates a code against a hierarchy-constrained implicit ValueSet (e.g. “is this code a descendant of Clinical finding?”). Pool entries cover a range of root concepts from large hierarchies (thousands of descendants) to small ones, mixing positive and negative cases.

Preflight request 
GET /ValueSet/$validate-code?url=http%3A%2F%2Fsnomed.info%2Fsct%3Ffhir_vs%3Disa%2F404684003&system=http%3A%2F%2Fsnomed.info%2Fsct&code=22298006
Accept: application/fhir+json
Ranking
Servers ranked by weighted RPS (wRPS) for this test. wRPS = raw RPS × per-test normalizer × bias factor. Score % is relative to the top performer. Raw RPS is the measured peak throughput; imputed values (shown in italics in orange) are estimated for servers that did not run this test. Status: ✓ preflight passed, ✗ failed, ~ skipped.
# Server wRPS Score RPS Errors Status
1 termbox 7.5K
100%
5.9K 0% ✓
2 fhirsmith 1.4K
19%
1.1K 0% ✓
3 ontoserver 1.3K
17%
1.0K 0% ✓
4 snowstorm 365
5%
287 0% ✓
5 hades 219
3%
172 — ~
Latency
Latency percentiles per server across all VU levels. Columns: percentile / VU count.
p50/1 p95/1 p99/1 p50/10 p95/10 p99/10 p50/50 p95/50 p99/50
termbox 0.61ms1.00ms1.6ms1.5ms2.5ms4.7ms7.9ms12ms16ms
fhirsmith 0.94ms1.9ms4.5ms8.0ms16ms22ms42ms55ms64ms
ontoserver 3.1ms4.5ms7.6ms7.5ms15ms86ms31ms290ms450ms
snowstorm 13ms17ms26ms33ms62ms83ms167ms221ms254ms