FHIR TX Benchmark
← All runs

Round 0

2026-05-27

Apple M3, 8-core · 24 GB · macOS Tahoe 26.3 · Docker Desktop 4.64.0 (8 CPU / 20 GB)

VSAC extensional ValueSets

GET /ValueSet/$expand?url=<vsac-url>&count=<n>[&filter=<term>]

Expands extensional ValueSets from the VSAC (Value Set Authority Center). Pool covers 10 curated clinical value sets with counts of 10, 100, and 1,000, plus filtered variants.

Preflight request 
GET /ValueSet/$expand?url=http%3A%2F%2Fcts.nlm.nih.gov%2Ffhir%2FValueSet%2F2.16.840.1.113762.1.4.1018.240&count=10
Accept: application/fhir+json
Ranking
Servers ranked by weighted RPS (wRPS) for this test. wRPS = raw RPS × per-test normalizer × bias factor. Score % is relative to the top performer. Raw RPS is the measured peak throughput; imputed values (shown in italics in orange) are estimated for servers that did not run this test. Status: ✓ preflight passed, ✗ failed, ~ skipped.
# Server wRPS Score RPS Errors Status
1 termbox 10.9K
100%
235 0% ✓
2 fhirsmith 2.4K
22%
51 0% ✓
3 snowstorm 1.9K
17%
41 42.3% ✓
4 ontoserver 601
6%
13 0% ✓
5 hades 67
1%
1 0% ✓
Latency
Latency percentiles per server across all VU levels. Columns: percentile / VU count.
p50/1 p95/1 p99/1 p50/10 p95/10 p99/10 p50/50 p95/50 p99/50
termbox 10ms65ms255ms22ms135ms236ms176ms423ms653ms
hades 731ms11.18s17.68s3.14s51.42s51.61s14.42s48.60s51.55s
fhirsmith 18ms63ms69ms181ms286ms341ms924ms1.44s5.44s
ontoserver 124ms403ms671ms451ms1.67s1.97s9.62s29.14s31.79s
snowstorm 53ms221ms328ms142ms452ms628ms913ms1.36s1.46s