Short Description

Sequel to the TestScript track at Connectathon 30. Goal is to advance FHIR Testing, the use of FHIR TestScript, and interoperable testing tools.

Long Description

Explore how the FHIR Testing Framework (TestScript) is being used, as well as FHIR testing tools that do not use the FHIR TestScript resource. 

The FHIR specification includes a Testing Framework that defines a Test Execution Engine and the TestScript resource for use in validating and verifying that FHIR implementations (client and/or server) are conformant to the FHIR specification. The inclusion of TestScript in the FHIR specification as a first-class resource reflects the community's experience that the management and proper use of testing are fundamental to effective, interoperable data exchange.

As the proliferation of FHIR implementations expands beyond Health IT early adopters, we are seeing a proliferation of FHIR testing tools and approaches. It is more important to promote FHIR testing and interoperability between testing approaches so that FHIR implementation testing can proliferate along with the community.

A focus of this track will be to continue defining an "interoperability framework" for FHIR testing tools.

We expect track participants to come away with a better appreciation of: 

  1. FHIR Testing and its benefits to improve FHIR implementations.
  2. Implementation and implementer experience with the FHIR Testing Framework and TestScript at scale
  3. The various FHIR testing approaches currently available.
  4. How to make FHIR testing tools interoperable.
  5. Ideas for demonstrating FHIR testing interoperability at the next Connectathon.

Type

Demonstrations/Brainstorming: FHIR Testing with TestScript, a first-lass FHIR resource; Testing engine interoperability; Lessons learned from FHIR testing at scale.

Track Lead(s)

 MITRE and AEGIS.

Track Lead Email(s)

jwalonoski@mitre.org; jeff.helman@aegis.net; joe.lamy@aegis.net

Specification Information

FHIR Testing Framework: (Current Build) http://build.fhir.org/testing.html; (FHIR R4B) http://hl7.org/fhir/testing.html
TestScript Resource: (Current Build) http://build.fhir.org/testscript.html; (FHIR R4B) http://hl7.org/fhir/testscript.html
TestReport Resource: (Current Build) http://build.fhir.org/testreport.html; (FHIR R4B) http://hl7.org/fhir/testreport.html

Call for participants

Vendors, implementors, and government interested in FHIR testing and making testing easier, accessible, scalable, and effective.

Zulip stream

https://chat.fhir.org/#narrow/stream/274423-TestScript-Resource/topic/Sep.202022.20Connectathon

Track Kick off Call

Dropped that ball on that. There was none.

Clinical Input Required?N/A
Related Tracks?

All tracks that have an ImplementationGuide (of any stage, helps to have capability statement, profiles, and examples)

Testing Scenario:

System roles:

  • ImplementationGuide authors (from other tracks also) who want to test their systems and learn about testing
  • Testing Systems, including TestScript generators and tooling, and execution engines

TestScript tools: editors, generators, engines, etc.

TestScript(s):

  • Generated TestScripts
  • TestScripts from the Spec
  • Hand-written TestScripts
  • BYOTS

Security and Privacy Considerations:

  •  One item of interest is TestScript for Tiered OAuth

Scenarios

  • TestScript Generator (input is an ImplementationGuide), we plan to execute it with various implementation guides and other tracks.
  • TestScript Engine (command line only). We plan to execute TestScripts we generated, or TestScripts that AEGIS has generated (either by hand or using your FSH tooling or any other method).
  • Mario has indicated that he wanted to test through the Touchstone proxy server and load in TestScripts for that.
  • Talk about direction and roadmaps (I suppose that can be the breakout)
  • What is on your list?