← All runs

Round 0

2026-04-08

Apple M3, 8-core · 24 GB · macOS Tahoe 26.3 · Docker Desktop 4.64.0 (8 CPU / 20 GB)

Multi-system text filter

POST /ValueSet/$expand with an ad-hoc composed ValueSet spanning multiple code systems

Expands an ad-hoc ValueSet that combines two or three code systems (SNOMED CT, LOINC, RxNorm) with a free-text filter. Pool covers four system combinations (all3, sct+loinc, sct+rxnorm, loinc+rxnorm) with counts of 10, 200, and 400. Small counts (10) test short-circuiting when the first system alone satisfies the request; larger counts force the server to query and merge results across multiple systems.

Preflight request
POST /ValueSet/$expand
Content-Type: application/fhir+json
Accept: application/fhir+json

{
  "resourceType": "Parameters",
  "parameter": [
    {
      "name": "valueSet",
      "resource": {
        "resourceType": "ValueSet",
        "compose": {
          "include": [
            { "system": "http://snomed.info/sct" },
            { "system": "http://loinc.org" },
            { "system": "http://www.nlm.nih.gov/research/umls/rxnorm" }
          ]
        }
      }
    },
    { "name": "filter", "valueString": "amphetamine" },
    { "name": "count",  "valueInteger": 200 }
  ]
}
Ranking
Servers ranked by weighted RPS (wRPS) for this test. wRPS = raw RPS × per-test normalizer × bias factor. Score % is relative to the top performer. Raw RPS is the measured peak throughput; imputed values (shown in italics in orange) are estimated for servers that did not run this test. Status: ✓ preflight passed, ✗ failed, ~ skipped.
# Server wRPS Score RPS Errors Status
1 termbox 6.9K
100%
547 0%
2 ontoserver 217
3%
17 96.3%
3 fhirsmith 39
1%
3 4.1%
4 snowstorm 17
0%
1 ~
5 hades 17
0%
1 ~
Latency
Latency percentiles per server across all VU levels. Columns: percentile / VU count.
p50/1 p95/1 p99/1 p50/10 p95/10 p99/10 p50/50 p95/50 p99/50
termbox 8.4ms43ms67ms17ms31ms39ms90ms111ms130ms
fhirsmith 398ms574ms647ms2.09s8.97s16.70s14.60s31.05s31.33s
ontoserver 57ms159ms387ms268ms1.51s1.75s4.3ms4.49s15.00s