← All runs
Round 0
2026-04-08
Apple M3, 8-core · 24 GB · macOS Tahoe 26.3 · Docker Desktop 4.64.0 (8 CPU / 20 GB)
| ID | Title | Operation | Summary |
|---|---|---|---|
| FS01 | FHIR Search (CodeSystem, ValueSet) | GET /ValueSet or GET /CodeSystem with query parameters | Tests standard FHIR search across both ValueSet and CodeSystem resource types. Inputs are drawn from a pool of search parameter combinations including url, version, and _count. |
| LK01 | SNOMED CT lookup | GET /CodeSystem/$lookup?system=http://snomed.info/sct&code=<code> | Looks up SNOMED CT codes drawn from a pool of 2,000+ codes spanning clinical findings, procedures, organisms, and more. This test serves as the normalising baseline for the composite score. |
| LK02 | LOINC lookup | GET /CodeSystem/$lookup?system=http://loinc.org&code=<code> | Lookup on LOINC observation and laboratory codes. Pool covers 2,000+ codes. |
| LK03 | Mixed FHIR package codes | GET /CodeSystem/$lookup?system=<system>&code=<code>&version=<version> | Looks up codes from a diverse set of smaller terminologies bundled in FHIR R4 core and extension packages — DICOM, ActCode, MaritalStatus, v2 tables, NCI, and others. |
| LK04 | RxNorm lookup | GET /CodeSystem/$lookup?system=http://www.nlm.nih.gov/research/umls/rxnorm&code=<code> | Lookup on RxNorm drug codes. Pool covers 2,000+ ingredient and product codes. |
| LK05 | SNOMED negative lookup | GET /CodeSystem/$lookup?system=http://snomed.info/sct&code=<code> | Inputs are fabricated SNOMED-like codes that do not exist. Verifies that the server correctly handles the not-found case and returns an appropriate OperationOutcome. |
| VC01 | SNOMED implicit ValueSet, code only | GET /ValueSet/$validate-code?url=http://snomed.info/sct?fhir_vs&system=...&code=<code> | Validates SNOMED codes against the implicit "all SNOMED codes" ValueSet. |
| VC02 | SNOMED implicit ValueSet, code + display | GET /ValueSet/$validate-code?...&code=<code>&display=<display> | Like VC01, but also validates the display string against the code's preferred term. |
| VC03 | SNOMED is-a membership | GET /ValueSet/$validate-code?url=http://snomed.info/sct?fhir_vs=isa/<root>&code=<code> | Validates a code against a hierarchy-constrained implicit ValueSet. Pool entries cover a range of root concepts from large hierarchies to small ones, mixing positive and negative cases. |
| EX01 | SNOMED hierarchy expand with count and offset | GET /ValueSet/$expand?url=http://snomed.info/sct?fhir_vs=isa/<concept>&count=<n>&offset=<k> | Expands a SNOMED is-a hierarchy slice with pagination. Pool covers 100 SNOMED hierarchies across three tiers — large, mid, and small — with count/offset combinations sized to each tier. |
| EX02 | SNOMED hierarchy filters | POST /ValueSet/$expand with hierarchy filters | Expands an ad-hoc ValueSet constructed inline using SNOMED hierarchy filter operators (descendent-of, generalizes). |
| EX03 | SNOMED text filter | GET /ValueSet/$expand?url=http://snomed.info/sct?fhir_vs&filter=<term>&count=<n> | Searches within SNOMED using a text filter. Pool mixes high-frequency terms (many matches), selective terms (few matches), and prefix fragments. |
| EX04 | VSAC extensional ValueSets | GET /ValueSet/$expand?url=<vsac-url>&count=<n>[&filter=<term>] | Expands extensional ValueSets from the VSAC (Value Set Authority Center). Pool covers 10 curated clinical value sets with counts of 10, 100, and 1,000, plus filtered variants. |
| EX05 | SNOMED intensional filters | POST /ValueSet/$expand with composed ValueSet | Expands intensional SNOMED ValueSets using complex filter combinations — is-a hierarchy, single property equals, AND combinations, and OR multi-include. |
| EX06 | RxNorm intensional filters | POST /ValueSet/$expand with composed ValueSet | Intensional expansions using RxNorm-specific attributes — term type (TTY), relationship properties (tradename_of, has_ingredient), and combinations. |
| EX07 | Multi-system text filter | POST /ValueSet/$expand with an ad-hoc composed ValueSet spanning multiple code systems | Expands an ad-hoc ValueSet combining SNOMED CT, LOINC, and RxNorm with a free-text filter. Small counts test server short-circuiting; larger counts force multi-system result merging. |
| EX08 | SNOMED combined filters | POST /ValueSet/$expand with composed ValueSet | The most complex expansion test. Each request combines three filter types simultaneously — is-a hierarchy, a SNOMED property equals filter, and a free-text display filter. |
| SS01 | SNOMED hierarchy subsumption | GET /CodeSystem/$subsumes?system=http://snomed.info/sct&codeA=<a>&codeB=<b> | Tests hierarchy introspection via the $subsumes operation. Pool covers all four FHIR subsumption outcomes — subsumes, subsumed-by, equivalent, and not-subsumed — across concepts at different hierarchy depths. |
| CM01 | SNOMED implicit REPLACED BY map | GET /ConceptMap/$translate?url=http://snomed.info/sct?fhir_cm=900000000000526001&... | Translates retired SNOMED codes to their replacement codes using SNOMED's implicit REPLACED BY ConceptMap. |
| CM02 | FHIR package ConceptMaps | GET /ConceptMap/$translate?url=<map-url>&system=<src>&code=<code>&target=<tgt> | Translates codes using ConceptMaps bundled in FHIR R4 core and IPS packages — FHIR-to-v2/v3 crosswalks, status maps, LOINC↔SNOMED mappings, and more. |