Page tree
Skip to end of metadata
Go to start of metadata


The meeting notes below are archived from previous meetings.

Current and recent notes are linked to from Conformity Assessment & Tooling  Team Discussion Notes section.


Gemini CA 2021-12-16 Meeting 

Gemini CA 2021-11-18 Meeting


NOTE:  Add most recent discussions first.

Agenda (proposed)

  1. General Updates
  2. PAT #5 Report Out
  3. RI+MC+RR for SDPi 1.0 Report Out
  4. Additional Items

Participants

Todd Cooper   John Donnelly   David Gregorczyk   John J. Garguilo   Tobias Klotz    Jan Rizzuto   Steven Griffiths 

Discussion Notes

  1. General Updates
    1. IHE Catalyst Study 
      1. A study project with IHE Catalyst to detail how and who and when with what ... for SDC/SDPi CA & Tooling over the next 3 years is going forward
      2. First report should be done late November and initial results ready for report out to this group in the December meetings
      3. This will answer questions like "How exactly do you interface a test application with Gazelle?"
    2. IHE T&T October Meeting Report Out 
      1. Todd reported out on the SDC/SDPi+FHIR work (esp. CA & Tooling) to the monthly IHE Testing & Tools meeting yesterday (2021.10/20), including the successful PAT #5, planning for PAT #6, Gemini SES/Quality & Regulatory Trust group launching, and the Catalyst study ... very well received by this "high level" IHE T&T team
      2. Report outs included the increasing demand for FHIR support and testing ... driving roadmaps for '22 to be updated to provide these capabilities 
      3. NIST Asbestos tool (initially for XDS.b to FHIR-based MHD testing) was also detailed and will be demo'd in the November T&T meeting; SDC/SDPi-P::FHIR Gateway may use this tool
    3. IHE DEV Infusion Pump Demo Today
      1. Note that Tobias will provide a LIVE!!! demonstration today of an SDC-enabled infusion pump along with the development & test tooling
      2. A recorded version will provided in the next week for those who cannot participate
  2. PAT #5 Report Out
    1. Tobias provided an update on IHE DE PAT #5 earlier this month
      1. Virtual testing infrastructure (VPN) worked very well 
      2. "Real" devices are increasingly being used in the testing (vs. application - to - application testing)
      3. Tobias provided a demo of the test tool use
    2. PAT #6 Planning 2021.10.06-08  
      1. Poll out for a F2F ... and response has been 50% "yes"!!! 
  3. RI+MC+RR for SDPi 1.0 Report Out
    1. Todd reviewed a few of the slides on the current effort to define a baseline RI approach for SDPi 1.0; a broader demonstration will be part of the IHE DEV F2F meetings later today
    2. QUESTION:  How will test assertions be formalized and linked from test cases / scripts into the RI chains that identify the requirements that they meet?
    3. This question will need to be resolved by the end of '21 and will be informed by the result of the Catalyst Study project.
  4. Additional Items
    1. No additional topics identified

Action Items / Tasks

No new tasks


NOTE:  2021.10.07 Meeting CANCELED due to concurrent IHE DE PAT #5

Agenda (proposed)

  1. General Updates
  2. HL7/IEEE/IHE WGM Preview
  3. PAT/CAT Discussion
  4. RI+MC+RR Discussion
  5. Additional Topics

Participants

Todd Cooper   David Gregorczyk   John Rhoads   John Donnelly  Michael Faughn   Jan Rizzuto   John J. Garguilo   

Discussion Notes

  1. General Updates
    1. 1st Zoom Call - Invites?
      1. ACTION (Todd Cooper  & John Rhoads ) Coordinate with Sarah Bell re. IHE Calendar invite list + send Zoom info blast to CA & Tooling List 
    2. PAT #5 Update - Full steam ahead ...
    3. Tooling development update - still looking for developer to work on testing tool (supporting transaction level testing)
    4. IHE T&T Monthly Report + HIMSS Showcase Briefing report out - 
      1. <T&T agenda & participation for SDPi >
      2. Both Showcase '22 (March/Orlando) & NA CAT (late January/Chicago) - focus is on in-person ONLY for both ... maybe hybrid if it is necessary
    5. IHE Catalyst discussions update
      1. Advancing a "study" project <... scope ...>
      2. John noted that <...relevance ...>
      3. Related question:  Is Gazelle the best long term tool for our test management?  especially with virtualized 24/7 testing / CA support 
        1. Consider the Stella Story & identification of gaps for using Gazelle for formal independent CA purposes 
        2. ACTION( John Donnelly ) Provide the short list of "gaps" for using Gazelle in support of product CA using ISO 17000 
    6. Kicking off an "SES/Regulatory Group" next week to focus on the strategy / roadmap and elements needed to build competence & confidence toward achieving "regulatory submission ready" product CA test reports
    7. ...
  2. IEEE/HL7 WGM Agenda Review
    1. <...add discussion notes>
  3. Discussion:  Can we build sufficient regulatory confidence through virtualized 24/7 testing including product CA?
    1. Given the challenges of in-person around the same table testing events (including CAT), a primary SDPi CA focus will be virtualized 24/7 testing, including CAT & product CA ...
    2. Given the challenges of needing to establish SES / regulatory confidence and trustworthiness in "regulatorily decoupled" component products ... 
      1. IOW when you cannot do combinatorial testing of all possible 
      2. NOTE:  See OR.NET Conformance Principles white paper
    3. QUESTIONWhat "mix" of CA & Tooling capabilities & events & implementation / pilot projects & demonstrations will be needed?
    4. Discussion:
      1. <... crosscuts with other stakeholders / experts esp. SES/Regulatory >
      2. < ... the sooner we start directly supporting vCAT and vCA ...>  ( at a quarterly basis)
      3. < ... will the FDA/NB require in-person D2D testing?  How much?  Will pilots/demos + in-hospital examples be sufficient?  How much? ...>
      4.  < ... CAT has two deliverables:  (1) Systems that demonstrate conformity + (2) tool maturity leading to CA process ... where the tool version gets locked down as part of the test package ...>
      5. < ... see ONC's testing certification program (excludes devices) that includes now a requirement for real world testing of products that are annually certified, need to submit a plan & test results for every criteria of certified product WITH A CUSTOMER ... in the implemented / in use of those products ...>
      6. <  NOTE ONC Tech Forum last Friday w/ "devices" session ... ACTION( Todd & John D. ) to find slides and possibly recording of event ...> 
      7. < ...Authority demanding / requiring CA ... Scheme owner & recognition of specifications (requirements & quality) + test plans / cases (completeness) & test tooling & how evidence captured and persisted ....>
      8. < ... need a focused plan & execution for all stakeholders for specifications => CA test plans / cases => CA process ... etc.>  
        1. See ASCA Pilot as well ... 
      9. < ... in Catalyst discussions ... how to integrate SDC/SDPi testing (incl. test cases) is included but provided by this Gemini SES MDI community ... >
      10. < ... note differences between ONC and FDA in terms of business driver & needed rigor for CA of med tech ...>
  4. Additional Topics
    1. Schedule / cancel next meeting   (during PAT #5) ?
      1. DECISION:  Cancel meeting due to PAT #5 & vacation schedules
      2. NOTE:  Todd to send out written update on October 7th to CA & Tooling list

Action Items / Tasks

<tbd>


Agenda (proposed)

  1. General Updates
  2. Test Tooling Update
  3. Transactions - Messages - Test Cases Discussion
  4. RI+MC+RR Pilot Projects Update
  5. Additional Topics

Participants

Todd Cooper David Gregorczyk   John Rhoads   Jan Rizzuto  John Donnelly

Note:  Many still on holiday through September 6th

Discussion Notes

  1. General Updates
    1. Moving to Zoom ... soon ...
      1. IHE WebEx going way ... 
      2. Watch for new Zoom web call info + new calendar invites from an "IHE International" calendar
      3. Watch for Sarah Bell emails ... she is providing administrative support for the IHE Devices domain
    2. FDA SDC/SDPi+FHIR Discussions Continue
      1. Stefan SchlichtingKonstantinos Makrodimitris Sajjad Syed  & Todd Cooper are advancing some general discussions around how to ensure that regulatory stakeholders both understand the SDC/SDPi+FHIR technology (especially the SES MDI construct) as well as the CA and regulatory submission documents that implementers will provide.
      2. Note:  similar discussions have been conducted in the EU with Notified Bodies; however, like the FDA discussions, they are somewhat ad hoc or "as needed" 
      3. Intent is to move these discussions to a more regular schedule and to build SDC/SDPi+FHIR (SES MDI) competency across all regulatory stakeholders
      4. Updates from these discussions will be posted to the FDA ASCA & IHE CA Pilot confluence page and then expanded to other pages when appropriate
      5. First presentation regarding the FDA ASCA meetings IHE CA "pilot" will be given at the upcoming IEEE/IHE/HL7 Devices WGM's
    3. PAT / CAT Planning 
      1. CAT '22 Discussion in IEEE SDC Tuesday call 
        1. Challenge is which companies would participate in a late January NA CAT?
        2. ACTIONTodd Cooper John Rhoads ) Ensure that Sara Bell has the SDPi  CAT Roadmap on her "radar" (CC Amit)
      2. PAT #5 for early October for 3 days - everything moving forward 
    4. PAT/CAT Tooling
      1. Actively working to get a developer onboard who can focus on transaction testing tooling 
    5. HL7 FHIR CAT 2021-09 
      1. No DoF Gemini track this time due to PoCD FHIR IG ballot consuming available resources!
  2. ...
  3. Additional Topics
    1. None identified

Action Items / Tasks


Agenda (proposed)

  1. General Updates
  2. 3 Year Plan + PAT & CAT Planning
  3. Tooling for CA - Topics 
  4. Additional Topics

Participants

Todd Cooper  John Donnelly John Rhoads Michael Faughn Steven Griffiths  David Gregorczyk  John J. Garguilo 

Discussion Notes

  1. General Updates
    • HIMSS'21 was held in Las Vegvas last week ...
      1. No showcase feeds on the digital subscription ... that was a surprise
      2. Primary focus was on Public Health ... Pandemic / COVID related themes
      3. Home health a topic but devices part typically left out ... but focus / attention should help!
    • IHE NA CAT '22 late January - hybrid event in Chicago planned, but little information currently available
    • IHE Testing & Tools (T&T) Report-out
      1. At the monthly IHE T&T meeting last Wednesday ...
      2. IHE-Japan's October connectathon request was approved; however, due to low registration, there will be no IHE DEV testing this year 
      3. Todd reported out on the Gemini SDPi+FHIR work ... very well received ... very supportive 
    • IHE Catalyst Engagement - August vacations have precluded significant progress ... will see more in September
    • Jim Keller (formerly at ECRI and then UL last two years) now at BrightInsight with Anura Fernando and others.
  2. Roadmap - Events & Predicates
    1. Include Development of sets of test scripts to check conformity to transactions & value sets 
    2. QUESTION:  What does the Gazelle integration process look like?
    3. QUESTION:  How do you launch test specific tool & get results back for recording?
    4. QUESTION:  (Ask Thom) phases for integration?  Required resources?
  3. Tooling for CA - Update
    1. Pursuing parallel paths with multiple tools
    2. SDCCC tool:  TBD to be able to release to public and when
    3. Python Tool (a la Tobias's Team):  Provider Testing & (maybe) some Consumer Testing ... 
      1. Will also work on a Java version 
      2. Generates a test result file - 
        1. Syntactic to SDC Core
        2. Not semantic validation (a la TF-3) yet
        3. JUnit XML output  ... 
      3. QUESTION:  Does it really support Consumer Testing?
    4. QUESTION:  Mapping Phase 1 transactions against test cases and tool capability w/ Gazelle integration
      1. See transaction mapping for PAT at https://confluence.hl7.org/pages/viewpage.action?pageId=113676845#ReferenceProvider/ConsumerSpecification-ReferenceConsumer 
      2. Need to expand and integrate into a Test Case plan that can then be integrated with Gazelle
  4. Additional Topics
    1. Pilot Projects Update
      1. "RI" Requirements Interoperability Pilot
        1. Primary focus in coming weeks will be to craft a basic SysML model that would link with Word styles that would enable ReqIF specification extration by NIST "V2plus" tooling
      2. "MC" Model Centric - MBSE / SysML / Cameo Pilot
        1. Future ('22)_ :  MBSE/SysML Test Case & coverage w/ traceability to requirements
        2. Now:  BICEPS Infusion Pump will be leveraged in near term for TF-3 + basic RI modeling + basic models for TF-1 & TF-3
      3. "RR" Regulatory submission Ready Pilot
        1. Target a report out on this during the September WGM
    2. CA will require some "user" involvement - not 100% automation 
      1. "user" involvement may include an observer / tester (individual) on site or camera etc.
      2. System Function => System Function Contribution (a la participant) => preconfiguration  steps (a la participant configuration) => SystemContext & other MDIB verification 
    3. ASCA Pilot will be key ASAP
      1. Establishing the process pathway (e.g., a la the ASCA process) will be a key step in gaining regulatory approval for SDPi-compliant products and systems
      2. MDIRA Profile actors may play a key role in addressing a strategy for establishing confidence in the SES of  a deployed system of decoupled component products

Action Items / Tasks

See QUESTIONs above.


Agenda (proposed)

  1. General Updates
  2. PAT #4 Wrap-up Discussion
  3. ...
  4. Additional Topics

Participants

Todd Cooper  Kenneth Fuchs Michael Faughn John Rhoads 

Note:  Due to the ongoing PAT #4, REGRETS from many of the normal participants in this call; also VACATION time!  

Discussion Notes

  1. General Updates
    1. PAT #4 Underway!
      1. Report-out discussion scheduled for SDPi Friday web call August 6th
    2. HIMSS'21 (August 9-13) 
      1. Next week will be the 2021 version of the HIMSS annual conference & showcase
      2. Note:  Gora & Kosta will present the RCC work (Gora will be in Vegas) 
      3. '22 CAT & Showcase?
    3. HL7 FHIR DevDay's - November '21 event "canceled" ... preparing to go 100% hybrid in the future
    4. IHE DEV F2F October '21 - in planning for San Diego at BD (includes an in person component)
      1. Todd & Michael planning on participating in person 
    5. FHIR CAT TACK for DoF for 2021 September - 
      1. Decided not to have a DoF CAT track in September due to bandwidth needed to get PoCD DoF IG Ballot work completed 
      2. Need to continue press to get devices & servers available for CAT events 
    6. 3 Year Planning Effort
      1. Focus will resume on detailing the 3 year SDPi+FHIR program plan, integrating the SDPi TF 1.0 capabilities and needed CA & Tooling support +
      2. Publishing the 1.0 version in alignment with our RI+MC+RR plans (including HTML publication of the document)
  2. Additional Topics
    1. No additional topics ideitified

Action Items / Tasks

No new action items identifed.


Agenda (Proposed)

  1. General Updates
    1. PAT / CAT Updates
    2. IHE CA & IHE Catalyst Updates
    3. ...
  2. Test Tooling Strategy - Continued Discussion
    1. CONSUMER System Testing Strategy (see discussion from  )
    2. vCAT Testing / Tooling Strategies
  3. MBSE Pilot Update (Deferred)
    1. QUESTION:  Representing IHE TF constructs in the MBSE Model
    2. QUESTION:  Representing modeling / design discussion issues & resolutions in Cameo?
    3. QUESTION:  Pathway from Requirements Model to Architecture Model to ... Test Cases & tooling?
  4. FDA ASCA Pilot Update (Deferred)
  5. Additional Topics

Participants

Todd Cooper John Rhoads Piero Ciancia Peter Kranich David Gregorczyk John J. Garguilo  John Donnelly  Michael Faughn

Regrets:  Jan Rizzuto 

Discussion Notes

  1. General Updates
    1. PAT / CAT Updates
      1. PAT #4 Planning
        1. Next PAT #4 scheduled for  , 2 days
        2. TBD if there will be sufficient participation 
        3. May have to push to early September 
      2. PAT #3 Recap Video Posted:  Library CA & Tooling Section  
        1. Also Stefan Schlichting 's MBSE/SysML BICEPS Infusion Pump model tour video now "public"
    2. IHE CA & IHE Catalyst Updates
      1. Direct discussions begun to explore how IHE Catalyst can support the Gemini SES MDI program (tooling & testing services)
      2. These will continue for the next 2 months (especially with August being a European "holiday" month) and should be finalized late September
    3. IHE NA CAT Planning
      1. Note that the next IHE NA CAT '22 is (unofficially!) planned for last week of January in Atlanta, as a hybrid event
    4. DTx and Interoperability Standards / Testing?
      1. Digital Therapeutics (DTx) has been a recent topic of discussion, including in IHE (e.g., PCH Program)
      2. Quality related standards being advanced in ISO/TC 215 WG11 & JWG7, but:  Interoperability standards?
      3. Considerations for applying IHE CA for SDPi SAMD (per the SDPi and MDIRA actor models) to DTx applications?
        1. Participants were not familiar with these apps or kinds of testing
  2. Test Tooling Strategy - Continued Discussion from previous call
    1. CONSUMER System Testing Strategy (see discussion from  ) 
      1. David reviewed an extended set of slides on this topic with two scenarios; find it here
      2. Current Gazelle test cases include setup (precondition), test steps, and final result (success criteria)
      3. Monitors may have to verify that a system actually processed the information - but not specifically how
        1. Can be a display screen (may be screen captured) 
        2. Log file
        3. ...
      4. Question is how to achieve the rigor needed for RR CA? + Achieving full automation for CA of products?
      5. "Man in the Middle" tool (e.g., SDccc) will support this approach, but in the nearer term the JTest approach
      6. Hybrid approach may be where we land:  full/partial automation, manual inspection, log files, etc.
      7. Note SDC Log files are not thoroughly defined (in terms of their contents) - perhaps we should add PAT/CAT/CA testing detail requirements for log files
      8. Discussion included the challenges in earlier IHE CA of device related profiles (e.g., DEC or ACM) and the challenges that resulted in the profiles not being included in subsequent version of the IHE CAS-2 Scheme
        1. Primary challenges were how difficult it was to cover testing "gaps" (as discussed above) and thus to lock down the CA test tooling and environment
        2. The problem was not intractable - clearly vendors take regulated products to market that include DEC & ACM interfaces - BUT there were limited time & resources and insufficient market demand complete the needed work
        3. OBSERVATION:  SDPi CA will also have to surmount these same challenges, but there are many more business drivers and control "levers" to significantly increase the success factor
      9. Note:  Since the IHE CA of DEC & ACM, recently the Continua Test Tooling has been integrated with Gazelle (in 2020) for the IHE POU (FHIR-based) profile testing.  Though the underlying technologies are different, this should help inform the work ahead with SDPi CA
    2. vCAT Testing / Tooling Strategies
      1. Virtualized CAT events for single profiles (e.g., an SDPi vCAT) is a key objective of this program and in discussions with Catalyst, appeared to be very much a likely reality
        1. 2020 CAT virtual events + other projectathon testing events drove the competency for deploying Gazelle for these configurations
      2. Helping this discussion was recent vCAT support for IVD profiles 
      3. It was also noted that this can be done in a way to lower the cost barriers for small companies and in emerging markets (where the testing value is too nascent to motivate traditional IHE CAT cost structures)
      4. SDC Transactions across cloud infrastructure is a key challenge for SDPi CA
        1. VPN infrastructure used in PAT events will directly support the vCAT testing
        2. NOTE:  This is as opposed to the typical SDC PoC subnet around a bed
      5. Challenges would include
        1. How / where to capture test information 
        2. Probes/Hello's across a VPN needs a multicast simulation simulation, such as what is done for the PAT
  3. MBSE Pilot Update (Deferred)
    1. QUESTION:  Representing IHE TF constructs in the MBSE Model
    2. QUESTION:  Representing modeling / design discussion issues & resolutions in Cameo?
    3. QUESTION:  Pathway from Requirements Model to Architecture Model to ... Test Cases & tooling?
  4. FDA ASCA Pilot Update (Deferred)
  5. Additional Topics
    1. Next Meeting include Gazelle SDPi test case update planning (who, when, how, etc.) (Tobias Klotz question!)
    2. NOTE:  The next meeting   is on the 2nd day of the PAT #4 ... we will try to have a joint session with the plugathon-ing group!

Action Items / Tasks

No new action items.


Agenda (proposed)

  1. General Updates
    1. PAT / CAT Planning
    2. IHE Catalyst Update / EU Experience Presentations Update
  2. "Reference Consumer" Testing Challenges
  3. Approach for "Lean" JUnit test app 
  4. MBSE / SysML / Cameo Pilot Discussion
    1. How best to represent the SDPi Transactions to SDC Message Sequence mappings in the SysML Model
  5. FDA ASCA / IHE CA Pilot Discussion
  6. Additional Topics

Participants

Todd Cooper David Gregorczyk Kenneth Fuchs Okan Yilmaz Peter Kranich  John Rhoads Michael Faughn 

Discussion Notes

  1. General Updates
    1. PAT / CAT Planning
      1. No additional updates - see Community Events for basic information
      2. Will engage participants   for who will actually plan on showing up - given that it is summer in the north .... expectations are not high!
    2. IHE Catalyst Update Update
      1. TBD when IHE EU will publish recorded IHE EU Experience videos re. Gemini project & IHE Catalyst & IHE Testing Continuum
      2. Discussions between Gemini SDPi+FHIR group & IHE Catalyst leadership underway
    3. MDIRA Project Updates
      1. JHU/APL MDIRA program completed its Period of Performance (POP)   and is actively working on follow-up project funding especially regarding MDIRA Profile advancement
      2. MDIRA profile group had their first monthly meeting  ... notes and all MDIRA profile related discussions are anchored at Specifications: MDIRA / ICE Profile 
      3. Group is working on updating their MBSE Model (based on an early version of the MDIRA specification ... see Github models repo folder; focus is only on updating the Requirements Model and TBD when now that the POP has expired
      4. NOTE: APL is actively working to join IHE International + will try to actively participate in these Gemini CA & Tooling calls
    4. Video Library Update (David G. will star!!!)
      1. Will post today the recording and presentation of the last PAT David Gregorczyk gave a couple weeks ago
      2. Investigating moving recordings to an OR.NET YouTube stream vs. Todd's personal channel!
  2. "Reference Consumer" Testing Challenges
    1. David Gregorczyk presented a few slides (based on his recent PAT update (IHE SDPi CA - Provider and consumer testing - David G 2021-07-01A.pdf
      1. PROVIDER testing is relatively easy (see slides #1 to 4), simply setting up an SDC CONSUMER that executes a set of tests against an SDC PROVIDER 
      2. BUT testing to see if an SDC CONSUMER is fully conformant is another proposition (Slide #5) 
    2. Consider also previously posted test tool configuration scenarios ...
      1. SDC CA Testing - Reference System Concept from 2019 White Paper.png 
      2. SDC CA Testing - Role-based Testing Suite from 2019 White Paper.png
      3. SDC CA Testing - SDC Compliance Check Tool from 2019 White Paper.png
    3. Discussion (per Slide #5):
      1. SDC PROVIDER (test system) can easily confirm SDC CONSUMER (SUT) proper message sequencing, well formedness (e.g., syntactic and semantic interoperability) of received messages and  confirmation of sent messages
      2. BUT NOT "Did the consumer properly interpret the content received?" and similar questions
      3. CONSUMER could generate a report separately providing evidence of its processing of interactions with a PROVIDER system
        1. This CONSUMER report could then be correlated with the PROVIDER repot to tie the ends together
        2. This "Backchannel" approach (e.g., CONSUMER sends PROVIDER (or Test Entity) via a different means / protocol etc.
      4. Acceptance Criteria per test easy for Provider vs. Consumer ... ???
      5. NOTE: 
        1. Many systems will not be purely PROVIDER or CONSUMER but
        2. PROVIDER/CONSUMER's ... and this may further add "System of Products" challenges when a test scenario includes an ensemble of component products
      6. Noted that though this is a starting point in lieu of having a fully functional test system tooling set BUT ...
        1. The goal is to decisively move toward IHE 'regulatory submission ready" CA at the product level
      7. Device specialization profiles (starting with TF3 specifications and MBSE models) will help inform specific test cases and sequences
      8. QUESTION:  Test Proxy needed?  Either now or in 2022?
  3. Approach for "Lean" JUnit test app 
    1. David Gregorczyk setting up a JUnit app that will act as an SDC CONSUMER that will be able to perform basic connectivity testing 
    2. TBD – Timing ... it is summer! ... but goal is to have it ready by fall
  4. MBSE / SysML / Cameo Pilot Discussion
    1. Cameo tooling activities ...
      1. John Rhoads now has a version of the Cameo tool up and running
      2. Todd Cooper also does BUT needs to update it to the latest service pack in order to load SSch's infusion pump model
      3. Wouter Peeters is looking to bring up the tool and may coordinate with Peter Kranich 
    2. Note:  Models are posted on GITHUB at SDPi-FHIR Github RI-MC-RR folder 
    3. Future Topic:  How best to represent the IHE TF constructs & SDPi Transactions to SDC Message Sequence mappings in the SysML Model
  5. FDA ASCA / IHE CA Pilot Discussion
    1. No specific progress in last month ... due to priorities
    2. This was the primary topic for the IHE EU Experience presentation by Stefan Schlichting and Todd Cooper and will be the topic of discussion with IHE Catalyst 
  6. Additional Topics
    1. No additional topics identified

Action Items / Tasks

No new action items identified.


NOTE:  June 17th meeting canceled to participate in the IHE Europe Experience sessions (part of IHE EU CAT event).

Agenda (proposed)

  1. General Updates
  2. IHE DE SDC/SDPi PAT #3 Report Out
  3. MBSE/SysML/Cameo Pilot Update
    1. BICEPS Infusion Pump Model Review (Stefan Schlichting
    2. Confluence Page Review + Planning 
  4. FDA ASCA on IHE CA Pilot Update
  5. Additional Topics

Participants

Todd Cooper Martin Kasparick Bjoern Andersen Piero Ciancia Steven Griffiths Stefan Schlichting  John Rhoads John J. Garguilo David Gregorczyk Kenneth Fuchs Fabian Baumeister John Donnelly

Regrets:  Michael Faughn 

NOTE:  Today is a holiday in parts of Europe (incl. southern Germany) - shocker!

Discussion Notes

  1. General Updates
    1. IHE DE SDC/SDPi PAT #3 Update
      1. Successfully concluded the June 1-2 virtual Plug-a-thon and "expanded the interoperability matrix" 
      2. Dates identified for PAT #4 & PAT #5 
      3. REPORT OUT scheduled for the 2021.06.11 Friday SDPi Meeting (per David Gregorczyk)
  2. MBSE / SysML / Cameo Pilot Update
    1. Briefing from Stefan Schlichting on the BICEPS Infusion Pump MBSE / SysML / Cameo model
      1. Stefan reviewed a BICEPS infusion pump that was created as part of the MDIRA project, but that has very broad applicability to the entire SDC/SDPi+FHIR work and the MDIRA Profile now underway
      2. Key features realized in this model include:
        1. BICEPS SysML Model (from which the pump model was crafted)
        2. Capabilities include metric reporting, alerting and external control
          1. In the case of control, this is a major requirement of the MDIRA that supports closed-loop control, for example, and it is not enough to allow an infusion pump to be programed but then require a person to push "go"!
        3. Integration of the RTMMS Nomenclature into a table in the Cameo tool
        4. Python script that can traverse the BICEPS device specialization model (looking for the top level MDS) and export it to an IEEE BICEPS XSD conformant specification 
        5. Starting point to realize a truly model-based specification for SDC/SDPi/MDIRA profiles 
        6. Establishes a UML (SysML is a strict profile of UML) BICEPS model that can serve as the basis for a revision of the 11073-10207 BICEPS standard, which per recent expert discussions, has a "disconnect" between the UML diagrams in the document and the "source of truth" constructs in the IEEE BICEPS xsd file.
      3. Status? 
        1. This is a very comprehensive and impressive model BUT there is a backlog of possible updates (e.g., modeling some dimensions more extensively)
        2. That will be the work of this pilot group as it moves the discussion forward and finds value in such modifications
    2. Related Updates (Todd Cooper)
      1. Models (BICEPS pump + MDIRA (early) model) have a home in the sdpi+fhir github repository (/RI-TF-CA/Pilot - MBSE SysML Cameo/Example Models/ folder
      2. Discussion will be included on the MBSE Hanging Gardens Model Library section 
      3. Video of the previous "MBSE / SysML Pitch" has been posted and linked to the  Education & MBSE pages; video of today's demo will also be posted
      4. The SDPi TF3 BICEPS infusion pump content will be linked to and generated from this model (see the forthcoming Specifications: Device Specializations pages)
    3. Discussion
      1. Question:  Are all units of measurement modeled in a given metric or only one?
        1. For expediency, generally only a single UoM was included in the model to show how it would work, BUT
        2. YES, sets of units particular for a specific semantic can be included in the model
        3. NOTE:  These data element semantics are rooted in what is provided in the RTMMS-based nomencature table
      2. Question:  Is this a model of an infusion pump INSTANCE or can it be used for a specialization specification ("Dev Spec")?
        1. For expediency, this infusion pump model is more of an INSTANCE vs. TYPE ((wink) ), but
        2. yes, it can be used to craft a general / generic device specialization specification 
        3. NOTE:  This is precisely what we intended to do for the SDPi TF-3 BICEPS Infusion Pump section
      3. Question:  Could you also IMPORT from xml to the tool?
        1. YES, but why?  
        2. If the model is the "source of truth" for all other artifacts, then exporting from the model ensures cohesiveness
        3. BUT if you already have an xml-based device specification, then yes, you could use that to "jump start" the modeling
      4. Question:  What is the "value add" for using SysML vs. xml-based tools?
        1. Benefits identified included ...
          1. Ease of use (vs. an XML editor ... though Altova and similar provide good options)
          2. Full support for MBSE (method) and the entire R+ALP modeling
          3. Integration from a requirements model to CA test scripts 
          4. Traceability from tests to requirements (and coverage)
          5. Profiling is "easier"  
          6. Supports simulation and other capabilities as well (i.e., SysML can be an "executable" system (of systems) specification
        2. NOTE:  SysML 2.0 (forthcoming later 2021) includes an API specification that should enable true tool "interoperability" (vs. using xml & ReqIF for example)
        3. BUT as one might expect, XML capabilities & SysML capabilities are often two sides of the same coin (e.g., utilization of schematron for constraint logic)
      5. Question:  How hard is it to leverage this infusion pump model for other device specializations (e.g., physiologic monitor)?
        1. Very easy ...
        2. Can start with this model, add what you need new, update the elements (e.g., MDS fields) for the new specialization, and delete the pump specific stuff
        3. It also starts with an export from the RTMMS tool of a value set for the specialization ... this table in the SysML specification will guide the BICEPS model components that are needed
        4. NOTE:  Stefan indicated that he generally (mostly) worked with tables and then rendered the graphics that were needed.  This is a general MBSE / SysML principle:  the model has everything, "views" (e.g., diagrams) have some subset as appropriate for the needs 
      6. Question:  How extensively can you model requirements in SysML?
        1. Basically any kind of constraints (constraint logic)
        2. OMG SysML Chapter 16 covers the requirements modeling constructs
        3. NOTE:  That the Cameo requirements modeler tool includes export to ReqIF (smile) 
      7. ...
    4. Follow-up Actions
      1. Create a starter "tool chain" discussion / graphic that shows the current inter-relatedness between CAMEO, BICEPS xsd, VSCode, NIST RTMMS ... ReqIF ... etc.
      2. Post session recording on Education pages and link to MBSE page discussion
      3. Update / create infusion pump device specialization pages to capture content from this model
      4. Craft "how to" guides (starter versions) for various topics, including
        1. Using this model to profile new device specializations 
        2. Path from RTMMS device value set export (JSON) and Cameo nomenclature table importing
        3. How to run the Python script to export the device specialization and then validate it against the IEEE BICEPS xsd specification
        4. ...
  3. Additional Topics
    1. Next Meeting Agenda

Action Items / Tasks


Agenda (proposed)

  1. General Updates
  2. FDA ASCA using IHE CA Pilot
    1. Review Confluence page
  3. MBSE / SysML / Cameo Pilot
    1. Review confluence page
    2. Demo:  JHU/APL MDIRA (early) modeling
    3. Demo:  Infusion Pump modeling
  4. Additional Topics

Participants

Todd Cooper Okan Yilmaz  Jan Rizzuto  Steven Griffiths  John Rhoads Michael Faughn Peter Kranich Piero Ciancia David Gregorczyk  

Damon Duquaine

Discussion Notes

  1. General Updates
    1. FDA ASCA on IHE CA - No significant progress since last group meeting
    2. HL7 / IEEE / IHE Devices WGM Planning
    3. Neurase MBSE Webinar later today - usage of models for MedTech regulatory purposes 
      1. Registration at Neurase Webinars site
  2. MBSE / SysML / Cameo Pilot 
    1. Tour:  Early MDIRA Model (Damon Duquaine)
      1. Damon gave the group a tour of an early MDIRA model
      2. Requirements table (via spreadsheet) was utilized supporting traceability between requirements & components 
      3. Early use case diagram was included to understand roles and key activities
      4. Sequence diagrams were also utilized between subsystem components 
    2. Discussion / Takeaways
      1. Will a copy of this model be made available to the Gemini group for reference
        1. Answer:  ACTION( Steven Griffiths  Jan Rizzuto ) Provide the model file to Todd Cooper to make available to this Gemnini CA & Tooling group
      2. Are referenced standards mapped into the model requirements:
        1. MDIRA requirements will identify normative standards BUT not details from those standards
      3. How are "required" and "optional" and "conditional" requirements modeled?
        1. For this model, only the requirement "tag" prefix indicates optionality ("MR" = mandatory; "RR" = recommended)
        2. ACTIONTodd Cooper ) identify SysML / UML construct intended for this purpose 
  3. 2021.06.01-02 IHE DE SDC/SDPi PAT #3 Update & Planning
    1. David Gregorczyk reviewed the planned objectives for the upcoming 2021.06.01-02 IHE DE SDC/SDPi PAT #3 event 
    2. Note:  two new vendors may be participating, having recently joined OR.NET
    3. Objectives include
      1. continue test sequence development per PAT #2
      2. validating the proposed mappings between SDC/MDPWS message exchanges and SDPi profile transactions
      3. capturing message sequence examples for use in TF-2 Appendix A 
      4. (TBD) Use of "docker" platform to support standalone testing (e.g., supporting pre PAT/CAT testing) 
      5. (TBD) Use of the SDCCCC (SDC Compliance Check) tool at the SDPi transaction level specifically 
    4. Presentation slides from PAT#1 were reviewed and will be updated for PAT#3
      1. ACTIONTodd Cooper) Update PAT#1 SDPi Intro & Overview slides for PAT#3, specifically updating with work advanced since the 2021.10 version
  4. Additional Topics
    1. Review upcoming HL7 IEEE IHE Devices Working Group Meeting Agenda
      1. Next week there will be a number of sessions related to SDC / SDPi+FHIR / MDIRA etc.
      2. NOTE:  The proposed Friday session on Device Specializations including the Anesthesia Workstation "demo" may need to be pushed to a subsequent Friday
      3. ACTIONOkan Yilmaz ) Determine when the OR.NET + Anesthesia Workstation activities can be presented - either Friday May 28 or Friday June 4 

Action Items / Tasks

  • ( Steven Griffiths  Jan Rizzuto ) Provide the model file to Todd Cooper to make available to this Gemnini CA & Tooling group
  • Todd Cooper ) identify SysML / UML construct intended for this purpose 
  • Todd Cooper) Update PAT#1 SDPi Intro & Overview slides for PAT#3, specifically updating with work advanced since the 2021.10 version
  • Okan Yilmaz ) Determine when the OR.NET + Anesthesia Workstation activities can be presented - either Friday May 28 or Friday June 4 


Agenda (proposed)

  1. General Updates
    1. IHE PAT / CAT Planning
    2. HL7 FHIR CAT - Sessions scheduled ... 
    3. Tooling Development Update 
  2. RI-TF-CA Update
    1. Requirements Interoperability Pilot Update
    2. ...
  3. MBSE/SysML Pilot Update
  4. FDA ASCA & IHE CA Pilot Update
  5. Additional Topics

Participants

Todd Cooper Fabian Kuehn  Peter Kranich  Kenneth Fuchs  John J. Garguilo  Michael Faughn John Donnelly  

Regrets:  David Gregorczyk

Discussion Notes

  1. General Updates
    1. IHE PAT / CAT Planning
      1. ACTIONDavid Gregorczyk ) confirm June 2-3 dates due to German holidays ("Pentecost")  
    2. HL7 FHIR CAT - Sessions scheduled ... 
      1. ACTIONTodd CooperJohn Rhoads ) Update Isolation PoC Track page with kick-off date & links + additional information 
    3. Tooling Development Update 
      1. Discussions continue with IHE CASC (final ecosystem model coming soon) & IHE Testing & Tools 
      2. Discussions about to begin with IHE Catalyst regarding integration with Gazelle etc.
      3. NOTE:  PCHA/Continua tool integration to Gazelle (phase 1) took about a man month; Phase 2 planned at a man month
        1. Note that the phases (if memory is correct) for the Gazelle integration of the Continua Conformity Test Tooling  ...
        2. Phase 1 - being able to launch the test tool from a Gazelle test instance, maybe with test instance metadata; test results are copy & paste into the appropriate test step
        3. Phase 2 - auto incorporation of the test results into the test instance 
        4. Phase 3 - more seamless integration at the test step level 
  2. RI-TF-CA Update
    1. Requirements Interoperability Pilot Update 
      1. Moving ahead slowly with tooling configuration (e.g., Todd Cooper now has license for the 3DS Cameo Systems Modeler w/ Requirements Modeling Tool) necessary for the pilot project
      2. Note:  that the need for multi inter-standard requirements interoperability specifications is increasingly (daily) clear
    2. "BICEPS vs. UML" discussion thread ...
      1. Discussion thread grew out of review of proposed alert nomenclature terms and the relationship between the BICEPS descriptor model & state model
      2. Observation:  Not clear that BICEPS UML does not necessary sync with the "standardized" XML schemas per the BICEPS 
      3. Note:  There is no comprehensive BICEPS model ... from the IEEE 11073 SDC group 
      4. ACTIONTodd Cooper ) Engage ORdotNET participants to see if they have such a model; also Stefan Schlichting 
    3. ...
  3. MBSE/SysML Pilot Update
    1. NOTE:  JHU/APL MBSE / SysML expert was planned to do a demo of his approach to an early version of the MDIRA specification;  will try to get queued up for the next meeting   
    2. See related BICEPS vs UML discussion above 
    3. Recent "device specializations" discussion also resulted in initial crafting of a Confluence Gemini SES MDI discussion work area (Specifications: Device Specializations) that will include MBSE / SysML modeling for each of the TF-3 device specializations.
      1. Noted that Stefan Schlichting has created an infusion pump model for the JHU/APL work that includes a Cameo SysML model, that he uses a Python script to search and export a BICEPS compatible XML specification.  
      2. Hope to demonstrate that in the next CA meeting
    4. Confluence page under development 
  4. FDA ASCA & IHE CA Pilot Update
    1. IHE "Accreditation" topic:  Relevance?  Strategy?
      1. Discussions on this topic are queued up with both NIST and ANSI staff ... today and tomorrow
    2. Confluence page under development 
  5. Additional Topics
    1. None mentioned 

Action Items / Tasks


Agenda (proposed)

  1. General Updates
    1. CA Tooling - Status Updates
    2. PAT Updates
    3. IHE CASC Model Updates (see notes from last Friday <link>) 
  2. FDA ASCA Program Update
  3. MBSE/SysML Update (incl. Confluence pages & Magicdraw Cameo)

Participants

Todd Cooper John Rhoads  David GregorczykMichael Faughn John J. Garguilo John Donnelly Peter Kranich Steven Griffiths Jan Rizzuto Piero Ciancia

Mike Obringer 

Regrets:  Fabian Kuehn 

Note:  If you don't already have an HL7 Confluence account, you can "Request" one for free at:  https://confluence.hl7.org/

Discussion Notes

  1. General Updates
    1. CA Tooling - Status Updates
      1. SDCCC Compliance Testing Tool Update
        1. Tool is in "pilot" development working toward a 1st complete software release
        2. Intent is still to publish 1.0 when it is ready and use it as the initial key tooling for SDC/SDPi testing
        3. TBD release date - David Gregorczyk will check to see if one has been specified
      2. SDC-RI Implementation
        1. Also being used in the IHE DE SDC PAT events and will be part of the tooling mix
        2. See https://gitlab.com/sdc-suite/sdc-ri 
      3. Gazelle support for SDPi Testing ...
        1. Need to engage with IHE Catalyst re. integration of SDC / SDPi testing support + use at virtual SDPi CAT late 2021
        2. Ditto for getting DEV SDPi into the IHE CA Scheme in '22 (late)
        3. NOTE:  Now that the HIMSS/PCHA/Continua testing platform integration is complete, precedence has been set for this kind of device-focused integration; question is $$$ and process and ..."who"!
        4. ACTIONJohn Donnelly  Todd Cooper ) Engage IHE Catalyst leadership to begin a dialog regarding the SDC/SDPi+FHIR testing pathway in 2021 and beyond
    2. PAT Updates - 
      1. Info on all PATs are on the Gemini MDI Community Events page 
      2. PATs include the development of test sequences for SDC capabilities to be leveraged for SDPi CAT testing 
      3. NOTE;  intent is map from current SDC exchanges to SDPi transactions and content for SDPi CAT testing; based on the current draft of the SDPi Supplement with its actors and transactions models, no significant issue is anticipated
    3. IHE CASC Model Updates (see notes from last Friday <link>) 
      1. Reviewed the IHE Conformity Assessment diagram currently published in Europe
      2. An "IHE Ecosystem" diagram with broader detail is also in development and will hopefully ready to review next call May   
      3. "Implementationathon" is an other phrase being used by some U.S. entities running - similar to Projectathons (e.g., HL7 for CDA, Blue Cross / Blue Shield for Da Vinci project)
  2. FDA ASCA Program Update
    1. An initial ROUGH confluence page (FDA ASCA & IHE CA Pilot) was reviewed that will establish a pilot project to investigate the possibility of establishing a mapping between the IHE CA approach to be applied to SDC / SDPi+FHIR assessment and the requirements emerging from the FDA ASCA pilot program
      1. Note that the "screen shots" will be replaced with the webinar presentation links once they are published publicly
    2. References are provided on the confluence page AND a helpful list of "terminology" is provided on the FDA ASCA home page 
    3. After general discussion, it was recognized that this is potentially a major opportunity to add "teeth" to the SDC / SDPi CA objective of "regulatory submission ready" CA test reports 
    4. Note:  This will be a standing discussion topic for this CA + Tooling group
  3. MBSE/SysML for IHE SDPi+FHIR KIck-off Discussion
    1. Reviewed the kick-off slides that are posted on the MBSE / SysML for MedTech Solutions Pilot (rough draft) page 
    2. Discussion:
      1. MF:  Especially once you get to ReqIF / XMI content, morphing it into needed forms is pretty straightfoward (if you've done it 100 times before!)
      2. MO:  (who had seen the slides previously) 
        1. "Excited about where the MBSE community of practice can take these initiatives."
        2. Regarding use of Magicdraw Cameo Systems Modeler, other tools have been used (e.g., Vitech GENESIS and CORE) but the Cameo has tended to work best for large projects 
      3. JD:  Moving IHE in this direction has been a long term discussion - perhaps finally this is a path forward!
      4. Piero 
        1. Regarding tooling:  In healthcare, Cameo doesn't seem to be the most used (e.g., vs. Sparx Enterprise Architect, which has been advanced in HL7 for example for decades) however this is not as much about the tooling than the application of systems engineering to healthcare ...
        2. Regarding SysML Interoperability - version 2.0 due out later this year includes an API capability that will make models (esp. in different tools) interoperable  
        3. Note:  A related MBSE for Healthcare community - Neurase - that is just getting started up
    3. Note:  This will be a standing topic for this CA + Tooling call, but may require some more focused discussions by team members

Action Items / Tasks

  • Todd Cooper John Donnelly Engage IHE T&T and IHE Catalyst regarding the path forward for SDC / SDPi+FHIR CA especially at Gazelle integration 
  • David Gregorczyk See if there is a target public release date for the SDCCC tool 


Agenda (proposed)

  1. General Updates
  2. Debrief from IHE NA CAT & Implications for SDPi+FHIR
  3. Review CA Events / Planning
  4. Review RI=>TF=>CA Work
  5. ...

Participants

Todd Cooper Kenneth Fuchs John J. Garguilo 

Regrets:  David Gregorczyk

Discussion Notes

  1. General Updates
    1. NOTE:  No one was on the call who could speak to the status and plans for the Dräger compliance check tooling that is anticipated to be used to support SDPi CAT testing later in 2021
    2. IHE CASC "CA Model" update still in process ... should be aligned with what is scoped out for Gemini SES MDI but is not "public" yet
  2. FDA ASCA Program Briefing
    1. The FDA "Accreditation Scheme for Conformity Assessment (ASCA)" which is part of their "Standards and Conformity Assessment Program" appears to be highly aligned with the approach being taken by the Gemini program using IHE CA approach (e.g., both are ISO 17000 based) 
    2. Investigation is underway to understand the relationship between the two and how to ensure that IHE CA test labs and test reports can "automatically" meet the requirements for this FDA program
    3. There is a public webinar by the FDA on April 13th (see the links above)
    4. NOTE:  NIST / Amy Phelps is actively involved in the team and has worked in the same department as John J. Garguilo and Lisa Carnahan - so is familar with our focus area; also Konstantinos Makrodimitris (FDA) is actively involved as well
    5. An update is planed for the next call 4/15
  3. Focus on MBSE/SysML for IHE SES MDI MedTech (regulated!) profiles
    1. As reported in recent weeks, advancing the tool chain needed to enable "requirements interoperability" included a quick evaluation of whether MBSE / SysML (e.g,. using Magicdraw Cameo SysML) would be a good option for our purposes, especially since that tool generates ReqIF representation of the SysML modeled requirements
    2. Determination the (Todd going solo) was that there was promise but descending into the SysML rabbit hole might be a terminal decision ... never to rise to the surface again!  
    3. Susbsequently, though others have expressed interest and expertise for MBSE/SysML including 
      1. JHU/APL MDIRA team that created a system model in the early days of that project and have SMEs who use Magicdraw Cameo for similar projects throughout APL 
      2. Stefan Schlichting helped present a MBSE webinar 3/25 that included application of the technologies to a "ventilator challenge" contest that they won in 2020
    4. It is clear that there is both interest & willingness of at least a few to see how far we can get in this area AS WELL AS value to try and move Gemini SES MDI (and IHE especially) from a document centric approach to one that is model centric and that provides a whole new level of value to implementers 
    5. ACTIONTodd Cooper ) Update the Tooling & Conformity Asssment page + a new "home" section under that for "MBSE/SysML for MedTech Solutions"

Action Items / Tasks

  • Todd Cooper Update CA & Tooling WebPages to reflect current RI-TF-CA strategy & MBSE/SysML dialogue


Agenda (proposed)

  1. General Updates & Action Item Review
  2. Update on IHE CASC Model Finalization
  3. Review TF-RI-CA efforts

Participants

Todd Cooper Michael Faughn  Kenneth Fuchs  John Donnelly 

Discussion Notes

  1. General Updates & Action Item Review
    1. NOTE:  IHE NA CAT is this week ... impacting some normally on this call ... and the call was shortened to 30 minutes due to NA CAT T&T Summit scheduled for the same time
    2. FHIR 2021-05 27 CAT Isolation PoC track DRAFT proposal created ... HERE is the home 2021-05 FHIR CAT page 
    3. IHE DE SDC/SDPi PAT scheduled for March 23-24 ... details coming
    4. ACTIONTodd Cooper ) Update the Community Events table with the FHIR CAT and PAT event information 
  2. IHE CASC CA Biz Model Update 
    1. John Donnelly updated the group on his efforts to inform the IHE CA Business Model (in development by the IHE CASC) to ensure it supports the SDPi+FHIR CA strategy we have been advancing
    2. Almost all of the recommendations were agreed by the CASC and should be reflected in the forthcoming model
    3. NOTE:  The model isn't public yet but should be available later this month or early next; 
  3. Review of RI-TF-CA Efforts
    1. Todd Cooper provided an update of his work-in-progress to take the Year 3 Update Presentation and advance the three core components to the next level of detail
    2. Note:  current efforts are focused on three lines of activity ... in priority:
      1. RI - Requirements Interoperability / Management 
      2. TF - Technical Framework management from content creation, development management (github) and publication (incl. HTML)
      3. CA - Conformity Assessment including requirements traceability and "regulatory submission ready" CA test reports 
    3. Current focus is primarily on the requirements management part, including how to formally represent and link capabilities & needs from various standards to capabilities that would be V&V'd at an interface.
    4. Part of that discussion included a review of Michael Faughn's musings model (DEFINITELY WIP!) ...
      1. Discussion focused around where to start, namely with "human crafted" content and linkages BUT with a desired FUTURE state where RI could be automated via assembling components
      2. The RI "Paper Airplane" Pilot effort will demonstrate the feasibility of RI in the Hanging Gardens model and hopefully a pathway to future automation

Action Items / Tasks


Agenda

  1. General Updates (all)
  2. Requirements Management Strategy Update (Todd Cooper)
  3. IHE CA Models Update (John Donnelly)
  4. 2021 PAT / CAT Planning Discussion (David Gregorczyk)
  5. Review Action Items
  6. Matters Arising

Particiants

Todd Cooper John J. Garguilo David Gregorczyk John Donnelly Anna Feiler  Michael Faughn

Discussion Notes

  1. General Updates
    1. MDIRA DPP Finalized and ready for circulation / review / approval - planned for tomorrow's SDPi Friday call with DPI Program meeting
    2. General Gemini MDI SDPi+FHIR publication & CA management reviewed and ready for next development stages (see next) 
    3. MTEC TiDE RFP Updates - Does anyone know of anyone who actually was accepted? NO 
  2. Requirements Management Strategy & Publication Update
    1. Group reviewed "publication" section of slides being finalized ...
    2. Slides 17-29 (IHE TF Publication section) were presented during the IHE T&T meeting yesterday, providing participants with a more detailed understanding of the HL7 V2+ project and the play for SDPi Supplement development and publication
    3. One question that was raised was whether NIST's IGAMT/TCAMT V2 management tools would be integrated with the V2+ tools
      1. Discussion confirmed that there has been coordinated discussions with key tool builders including  Robert Snelick and Frank Oemig, but that details for how these tools might be integrated is "future" work, but is also not anticipated to be a major challenge
      2. ACTIONJohn J. Garguilo ) Craft a few slides that show how the V2+ tooling could integrate with other V2 Management tools such as IGAMT/TCAMT
    4. Final updates were made to the SDPi Supplement authoring / management / publications slide #29 reflecting discussion and review during this meeting
  3. IHE CA Models Update 
    1. IHE CASC (Conformity Assessment Steering Committee) has been developing a detailed (though high-level) model of how requirements and CA + tooling are managed in IHE processes. 
      1. NOTE:  This was also mentioned during the IHE T&T call discussed in (2.b.) above
    2. Question is how the proposed Gemini MDI SDPi+FHIR CA / requirements traceability strategy (slide 29 and following) would integrate with this emerging CASC model
    3. ACTIONJohn Donnelly Todd Cooper) Craft an initial crosswalk between the draft CASC model and the SDPi+FHIR Requirements Traceability & CA model to ensure coordination and identify any potential disconnects; try to complete the initial analysis before the next CASC and IHE International Board meetings
  4. 2021 PAT / CAT Planning Discussion
    1. David Gregorczyk  has circulated an SDC/SDPi Plug-a-thon (PAT) Doodle poll to set dates for IHE PATs in 2021  (poll closes Wednesday  
    2. Plan is to schedule 6 (every other month) 2-day virtual events
    3. See topics discussed in the February 12 SDPi Friday call notes 
    4. ACTIONTodd Cooper ) Circulate the Doodle poll link to the SDPi+FHIR list AND update the Community Events page 

Action Items / Tasks

  • John J. Garguilo ) Craft a few slides that show how the V2+ tooling could integrate with other V2 Management tools such as IGAMT/TCAMT
  • John Donnelly Todd Cooper) Craft an initial crosswalk between the draft CASC model and the SDPi+FHIR Requirements Traceability & CA model to ensure coordination and identify any potential disconnects; try to complete the initial analysis before the next CASC and IHE International Board meetings
  • Todd Cooper ) Circulate the Doodle poll link to the SDPi+FHIR list AND update the Community Events page 


Agenda (aspirationally!)

  1. Review Action Items 
    1. IHE CAT for virtual SDPi testing?  
    2. Include review of possible application of the Prometheus Beacon Use Case Editor tool
    3. Gazelle Assertion Manager tool  - use update
    4. ...
  2. Approach for Test Assertion Inclusion in SDPi specification 
  3. Update the SDPi+FHIR 2021 CA & Tooling Plan + Issues
  4. Review 2021 Roadmap Central content for CA & Tooling

Participants

Todd Cooper Kenneth Fuchs John Donnelly John J. Garguilo

Discussion Notes

NOTE:  This meeting originally scheduled for 2021.01.21 - not sure if we actually had a discussion then!  No reminder sent for today's meeting ... 

  1. 2021 PAT/CAT Planning Update
    1. Todd Cooper still trying to determine what the "process" looks like for advancing a virtual SDPi-focused IHE CAT this year;  this includes platform requirements, Gazelle tool usage (and instance), monitors, etc.
    2. David Gregorczyk & Team are looking at OR.NET supported IHE PAT events this year, including the sequence of topics that might be proposed; intent is to try to have a testing event nominally every 6 weeks (+/- 2 weeks)
    3. Engagement in the IHE Europe June 2021 Connectathon & Conference for anything related to SDC/SDPi is being undertaken by OR.NET & IHE DE
  2. Gemini SDPi+FHIR Update for IEEE/IHE/HL7 WGM meetings last week - Review
    1. Todd Cooper reviewed the update presentation made during the Devices WGM last week
    2. Discussion included a detailed review of the IHE TF to HTML Publication section related to leveraging work done by NIST / Prometheus (Michael Faughn) for the HL7 V2+ project, which is also a Word-to-HTML publication effort.
  3. IHE CA - Use Cases to CA Report Discussion
    1. Todd Cooper reviewed the final section (still being drafted) from the above Gemini update - related to requirements management from use case specifications to CA test scripts and test reports
      1. Section should be finalized today and posted on the WGM site
    2. John Donnelly reported work in the IHE CASC to craft an updated model for IHE CA that clearly traces the path from use case requirements to test reports;
      1. This would fit nicely into the detailed reqirements management section mentioned above
      2. Hopefully we can see a version of the CA model in the next meeting

Action Items / Tasks

No new action items identified.


Agenda

  1. Review Action Items from December 17th meeting and before (below)
    1. Include review of possible application of the Prometheus Beacon Use Case Editor tool
    2. Gazelle Assertion Manager tool
    3. ...
  2. Update the SDPi+FHIR 2021 CA & Tooling Plan + Issues
  3. Review 2021 Roadmap Central content for CA & Tooling

Participants

John Donnelly John J. Garguilo Michael Faughn Todd Cooper  

NOTE:  First meeting of the year ... amazed anyone actually showed up!

Discussion Notes

NOTE:  Agenda above was mostly pushed to the next meeting.

  1. Review open action items
    1. IHE USA / Amit related topics - still waiting to hear back;  hopefully by the next meeting in two weeks
    2. Update on "IHE Supplements in Word or HTML" action items
      1. Reviewed exchanges between John Donnelly & Todd Cooper w/ John Moehrke regarding the questions of how to advance use of HTML and related for the SDPi+FHIR specifications
      2. Moehrke's response to the questions (see action items from previous meeting) was that for now, we should use the IHE Word template - everything else is very much in its infancy 
      3. Lengthy discussion included:
        1. Need to advance IHE specification development and publication to the same "level" as the FHIR spec, namely HTML publication and a development process that supports that work
        2. Noted that the current HL7 FHIR specification tooling / process is challenging - as Moehrke stated 10-20 times harder than simple Word documents (at leat in the front end authoring side
        3. The approach that David Gregorczykprovided for tagging and extracting test assertions / requirements from the Word document may be a good "hack" but Michael Faughn made it clear that at best, it was a "hack"!!!  
        4. ...
      4. John Donnelly will continue to advance the need for moving forward with a new on-line specification publication approach for IHE Supplements vs. traditional Word approach; report out at next meeting
  2. Additional Business
    1. (John J. Garguilo) Plan to get an updated version of the upcoming IEEE/IHE/HL7 DEV WGM Agenda out by COB tomorrow  

Action Items / Tasks

No new tasks identified.


Agenda

No published agenda - year end meeting!

Participants

Todd Cooper David Gregorczyk Anna Feiler John Donnelly John J. Garguilo

Discussion Notes

  1. IHE Gazelle & SDPi Testing in 2021 
    1. General overview of how Gazelle works and test instance management (provided to David Gregorczykearlier in the day)
    2. Role of Gazelle "Assertion Manager" tool?  Still actively used? 
      1. ACTIONTodd Cooper ) Ask Steve Moore / Lynn Felhoffer about status / use of the Gazelle Assertion Tool 
    3. IHE Gazelle vCAT in 2021 - How would that work for SDPi CAT Event Uses?
      1. Still underdiscussion by CAT managers for NA CAT & IHE Services, etc.
      2. ACTIONJohn Donnelly ) Ask Amit / IHE USA regarding approach for Gazelle test management for 2021 CAT event(s) + cost basis for a CAT instance for a virtual SDPi CAT using Gazelle (similar to IHE Brazil or Eyecare)
      3. Will this require a Gazelle VM for the specific event?  
        1. Note that this was done for IHE Korea CAT events but that the overhead of setting up and managing the VM for a single event of a small size (5-10 systems) didn't make sense
        2. IHE USA has a 24/7 instance of the Gazelle environment used for NA CATs and that includes specialized CAT instances for IHE Brazil and IHE Eyecare
        3. Will the "new" IHE Gazelle virtualized test environment / server (via IHE Services) provide the same?  Associated costs (if any)?  
  2. Integration of Requirements into SDPi Word Document
    1. Leverage the same / similar approach to the IEEE 11073 PKP standards utilizing ReqIF embedded in the Word document
      1. David Gregorczyk showed an example of using Word Bookmarks to capture "requirements"
      2. AND if IHE is moving toward HTML-based publishing (vs. PDFs of Word documents), should SPDPi Supplement be in HTML NOW vs. Word and then HTML?
      3. ACTIONTodd Cooper )  Ask Mary Jungers / John Moehrke whether SDPi Supplement should be in HTML now
    2. How would Gherkin (TF-1 Appendix C) be leveraged?
      1. Is this limited to Use Case requirements to terst tooling or from the core document as well?
      2. OR from the core document in Use Case sections?
      3. ACTION( Todd Cooper John Donnelly) Query IHE Gherkin-istas re. current intent; intehgrate IHE Gherkin discussion page
  3. Use of HTML for IHE Profile specification / publication 
    1. Question:  Would requirements / testable assertions be directly integrated?
      1. John Donnelly says:  Yes!  
      2. ACTION( Todd / John D. ) Ask Moehrke to confirm & identify "how"
  4. Next Meeting Agenda:
    1. Report out on action items below
    2. Firm up the 2021 SDPi+FHIR CA & Tooling roadmap & "issues" list

Action Items / Tasks

  • Todd Cooper Ask Steve Moore / Lynn Felhoffer about status / use of the Gazelle Assertion Tool 
  • John Donnelly Ask Amit / IHE USA regarding approach for Gazelle test management for 2021 CAT event(s) + cost basis for a CAT instance for a virtual SDPi CAT using Gazelle (similar to IHE Brazil or Eyecare)
  • Todd Cooper John Donnelly Ask Mary Jungers / John Moehrke whether SDPi Supplement should be in HTML now
  • Todd Cooper John Donnelly Ask Moehrke to confirm & identify "how" testable assertions / requirements etc. integrated into the HTML TF documents


Agenda

  1. General Updates
  2. Review 2020 Roadmap
    1. General Review
    2. 2021 March NA CAT Track?
  3. FHIR CAT 2021-01 Track Review
  4. Use Case Test Scripting Discussion
  5. Tooling Stastus / Planniing Review
  6. Additional Topics

Participants

<TBD>

Discussion Notes


Action Items / Tasks



Agenda

  1. General Updates / Action Item Review
  2. SDPi+FHIR CAT Track for 2021-01 
  3. Road Mapping 2020 - 2021: IHE SDPi Test Tooling Strategy for CAT / PAT Discussion
    1. Review section on 2021 Roadmap Central page
  4. Review Initial SDPi Use Cases / Scenarios to Test Scripts Exercise
  5. Other Discussion Topics

Participants

Todd Cooper Michael Faughn Anna Feiler  John Donnelly

Discussion Notes

  1. General Updates / Action Item Review
    1. Bill Majurski - Note the sad and untimely passing of Bill ... absence will be felt for a very long time
      1. Note that Bill & Todd had planned on using the Asbestos XDS-FHIR  tool 
      2. ACTION( Todd ) Sync with John J. Garguilo re. future development and use of the above tool to add an SDC connector and support SDPi+FHIR integration & SDPi & XDS etc.
    2. FHIR DevDays Today & Tomorrow ... presentations / content will inform what we do in 2021, especially FHIR 2021-01 CAT event
  2. SDPi+FHIR CAT Track for 2021-01 
    1. FHIR CAT 2021-01 Event
    2. "2021-01 Isolation ICU Bed Device Integration Use Case (Gemini MDI Project)" proposal submitted 
    3. NOTE that this use case will be one of primary focus in 2021 esp. given its relevant topic & use of all SDPi profiles; this may also be proposed for demonstration videos & events such as HIMSS'21 Interoperability Showcase
    4. Engagement for this FHIR CAT 2021-01 Track + Use Case marketing "ACTION" all ...
      1. Clinical Engineering Community Input, including ACCE and IFMBE/CED (International Federation for Medical & Biological Engineering / Clinical Engineering Division)
      2. IHE at WHO / Derek Ritz who has advanced related items such as IPS and Continuity of Care Guidelines in challenging contexts (e.g., Myanmar)
      3. AAMI CR511 External Device Control drafting community (isolation beds is included here)
      4. FHIR DevDays community sync (per above) to advance and participate in the 2021-01 event
    5. Tooling? 
      1. Similar to pre-connectathon tooling but with FHIR integration as well
      2. Tracks / Scripts from the Isolation Bed use case
      3. Sync with Stefan Karl & Ana Kostadinovska re. DoF PoCD IG w/ SDC  and possible tool approach for the 2021-01 Event
  3. Road Mapping 2020 - 2021: IHE SDPi Test Tooling Strategy for CAT / PAT Discussion
    1. Review section on 2021 Roadmap Central page - Deferred ... Verbal Discussion Instead
    2. John Donnelly  indicated the need to have some presence in the IHE NA CAT'21 March 1-5 (on-line only) , especially since HIMSS'21 Interoperability Showcase discussions will be advanced during that event
    3. ACTION( Todd ) Add a Gemini SDC / SDPi+FHIR "Track" to the 2021 roadmap 
    4. ACTION( John ) Engage HIMSS / NA CAT leadership to understand where to position this item :
      1. Plug-a-thon for Gemini SDPi+FHIR?
      2. Standards Accelarator Track?
    5. It is also important to understand WHERE this fits in the "Testing Continuum" from IHE PAT to CAT to CA, including FHIR CAT events + relationship to other more informal hackathongs such as those historically advanced by OR.NET
  4. Review Initial SDPi Use Cases / Scenarios to Test Scripts Exercise
    1. Deferred to next meeting ...
  5. Other Discussion Topics
    1. Next Meeting:  December 17th!!!

Action Items / Tasks

  • Todd Cooper Sync with John J. Garguilo re. future development and use of the above tool to add an SDC connector and support SDPi+FHIR integration & SDPi & XDS etc.
  • Todd Cooper Engage AAMI re. participation in Gemini SDPi+FHIR & Isolation Bed use case & 2021-01 FHIR CAT & etc. 
  • Todd Cooper Engage ACCE & IFMBE / CED around the use case
  • Todd Cooper Engage Derek Ritz re. use case & WHO engagement 
  • Todd Cooper Engage FHIR DevDays team + Zulip community around FHIR CAT 2021-01 participation
  • Todd Cooper Add a Gemini SDC / SDPi+FHIR "Track" to the 2021 roadmap  
  • John Donnelly Engage IHE NA CAT'21 Leadership around Gemini SDPi+FHIR Track, isolation bed use case, and '21 August Showcase etc.
  •  


Agenda

  1. General Updates
  2. Action Item Review
  3. IHE DE PAT - "Takeaways" & Building on the Success!
  4. Road Mapping 2020 - 2021: IHE SDPi Test Tooling Strategy for CAT / PAT Discussion
  5. Other Discussion Topics

Participants

Todd Cooper John J. Garguilo Anna Feiler Kenneth Fuchs

Discussion Notes

  1. General Updates
    1. Noted the Community Events page and the upcoming 2020.11.17-20 FHIR DevDays event
    2. SDPi Introduction & Overview presentation being built - drafts in the sdpi+fhir Github Education folder 
  2. Action Item Review
    1. Brief review - mainly items related to security & test tool chain updates 
  3. IHE DE PAT - "Takeaways" & Building on the Success!
    1. See final version of the "takeaways" on the 2020.10.20-21 IHE DE SDC/SDPi PAT #1 page
    2. Reviewed the main takeaways including having proved out the key components that will be needed for future PAT / CAT events (VPN, MS Teams, SDC Discovery Proxy, etc.) + 
    3. Challenges around CAT $$$ and intent to schedule multiple focused PAT / CAT events in 2021 that are formally recognized & approved by IHE T&T and Board
  4. SDC Test Tooling Update
    1. Anna Feiler provided a short update on the focus and status of the SDC conformance test tooling (note earlier related / background updates in previous web meetings)
    2. Focus on the current compliance check tool is "core" SDC capabilities primarily at the MDPWS standard level (that builds on BICEPS & SOMDA standards as well).  
      1. Noted that this is similar to the HL7 V2 validation tooling that simply confirms adherence to the core syntax and messaging sequences, but not specific application content or profiled components
      2. This tool would be perfect for a Pre-Connectathon test, like we have today for other protocols and IHE profiles
    3. A PKP test tool is pushed into 2021 at some time, primarily because the first of the PKP standards (11073-10700) has yet to go to IEEE ballot.  
      1. Note that this Base PKP standard is nearing ballot group formation, but there are still a number of issues being resolved.
    4. TBD how these tools might be utilzied and integrated into an SDPi PAT / CAT event - that is for the FUTURE discussion of this group
  5. Road Mapping 2020 - 2021: IHE SDPi Test Tooling Strategy for CAT / PAT Discussion
    1. See discussion notes on the 2021 Roadmap Central page, CA & Tooling section
    2. Topics discussed include:
      1. Confirmed the intent to hold regular (monthly?) Plug-a-thon events to test out various elements of the SDPi+FHIR profiles
      2. Schedule (see below) multiple 2021 CAT events that also focus on specific profiles (e.g., one for SDPi-P, one for SDPi-A, etc.) or specific use case scenarios
      3. How to "bootstrap" test scripting?
        1. DECISION:  Take the detailed use cases / scenarios that we are currently building into the SDPi Supplement document and begin an exercise of test script development to be presented at the next CA & Tooling call  
      4. Pre-CAT tooling vs. CAT tooling - 
        1. Inventory for what we have TODAY that can be leveraged for both PAT and CAT and pre-CAT testing
        2. Inventory of current IHE Tooling that might be utilized / adapted / integrated into ....
          1. See Gazelle Framework Documentation for a list of current tools and their information
          2. See Gazellle Security Suite capabilities
          3. See Gazelle Proxy tool
        3. Note that there are other tools that may be leveraged as well, such as NIST's Asbestos tool set (under development) that could have an SDC Connector added for SDC/SDPi-to-FHIR testing
      5. Develop a strategy for how 1:1 and multi-way SDC/SDPi SOMDS testing might be accomplished in pre-CAT and CAT events, including
        1. How and where and how many messages are grabbed?
        2. How will security be managed for (1) above?
        3. How will person identity be managed (e.g., patient identifiers and PHI)?
      6. What might a PHASED roadmap look like as we enter 2021?
        1. Start simple with what we have, taking the same early approaches for PCD-01 (DEV-01) transaction testing or CDA document validation 
        2. Start small with Excel spreadsheets and monitor checking vs. Gazelle integration & full test automation
        3. Chart a roadmap from today to a fully automated future tooling architecture
  6. Other Discussion Topics
    1. Engagement of the IHE T&T Committee
      1. IF the SDPi+FHIR community is going to advance focused PAT and (official/formal) IHE CAT events in 2021, 
      2. THEN IHE T&T has to review and approve the proposal(s) and the IHE Board has to ratify the events 
        1. Note that this is required in order to have the CAT results officially recognized and recorded as they are for other events (e.g., IHE EU & NA CAT)
      3. To do this, the T&T must ...
        1. Be educated as to the basics of SDC & SDPi+FHIR so they understand the kinds of capabilities and challenges that are represented
        2. Be briefed on the tooling and testing approach being advanced by this group
        3. Be presented with CAT proposal(s) for review and approval 
      4. Questions include ...
        1. Timing of T&T engagement (esp. given everything else that is of an equal or higher priority ... as the end of 2020 approaches!)
        2. Who and what should be briefed and when?  
        3. What (if anything) is done in 2020 and what can be done early in 2021?

Action Items / Tasks

  • Todd Cooper Take the detailed use cases / scenarios that we are currently building into the SDPi Supplement document and begin an exercise of test script development to be presented at the next CA & Tooling call 
  •  


Agenda

  1. General Updates on SDC / SDPI CA & Tolling Topics
  2. IHE DE SDC / SDPI PAT 2020 OCT 21 - 22 Review / Planning
  3. Tool Chain Discussion:  Computable Device Specialization Specification to Simulation to CA & Tooling
  4. Other Discussion Topics

Participants

Todd Cooper John Donnelly John J. Garguilo Michael Faughn

Anna Feiler

Discussion Notes

  1. General Updates on SDC / SDPI CA & Tolling Topics
    1. (DEFERRED) Python open source library update
    2. (DEFERRED) OR.NET and member org plans for open sourcing / licensing SDC CA tooling for use in IHE PAT / CAT / CA 
    3. (DEFERRED) Related discussions from recent IHE / HL7 / IEEE joint meetings
  2. IHE DE SDC / SDPI PAT 2020 OCT 21 - 22 Review / Planning
    1. Status update (participants, logistics, etc.)
      1. Brief discussion ...
      2. Separately:  Logistics are still being worked out between in-person and a conference call / video feed; also still working out the intended use case and testing / "hacking" objectives 
    2. Test Infrastructure Plans - TBD
    3. Schedule / scenarios 
      1. Formal agenda / schedule is still being finalized
      2. Initial concept is to have a use case / scenarios around an isolation ICU room
    4. NOTE:  Todd Cooper is working on some SDC=>SDPi=>PAT/CAT/CA slides that will provide background for next week's IHE PAT in Lübeck as well as going forward for reviewing and using the supplement
      1. ACTIONJohn Donnelly ) John will see if he has any updated graphics around the IHE PAT / CAT / CA and Projectathon etc. concepts
  3. Tool Chain Discussion:  Computable Device Specialization Specification to Simulation to CA & Tooling
    1. Soon we will have device specialization specificsations (e.g., from PoCSpeC and others), joined with the Base PKP standard, joined with the core SDC standards, all profiled by SDPi ...
    2. NOTE:  This topic was not directly addressed today ... will be picked up in a future session
    3. QuestionWhat specification format(s) and what device profiling tooling can we use to get to a computable spec that leads us all the way to CA of SDC/SDPi conformant SOMDS Participant systems?
      1. Initial discussion around what can be done NOW vs. where we want to go in the future but will require more time & resources than currently available
      2. Todd Cooper recounted some recent discussions with David Gregorczyk about possibly just "tagging" formal requirements in the SDPi Supplement Word document and then extracting them for subsequent requirements management / testing / tooling etc.
      3. Michael Faughn indicated that (sadly) he has a lot of experience pulling requirements from a Word .docx file, it isn't pretty but it is doped
      4. For example, you could define a Word Style that could be applied to these requirements; however, you will also need to include some contextual metadata to help understand, for example, whether the requirement applies to an actor, transaction, option, SDC message, etc.  
      5. ACTIONTodd Cooper Michael Faughn) Todd will create a few examples of what a ReqIF "ready" requirement might look like in the SDPi Supplement document and have Michael review and "fix".  Report back in the next CA & Tooling call November 5th
    4. Question:  What SDC testing tools are currently being advanced for general "open" conformity assessment use?
      1. (Anna) There are two tools currently being developed:
        1. SDC Test Tool - Rigorous testing of conformance to the core SDC standards (11073-10207/-20701/-20702)
        2. PKP Test Tool - focused on establishing conformity to the Participant Key Purposes standards (11073-1070x)
      2. The SDC Test Tool will be available for use in CAT testing next year, but the PKP tool will have to wait publication of the related standards, targeted for later in 2021
  4. Other Discussion Topics
    1. How rigorous (and repetitive) will CAT testing of SDPi profiles be over SDC testing?
      1. For example, the SDC testing tool supports fully automated checking of all core SDC capabilities and usually runs "over night";  though this level of rigor is mandatory for conformant systems, it shouldn't be required for the interoperability multi-vendor system testing at CAT; but where to draw the line between the two?
      2. IHE CAT events require all systems to first pass "pre-connectathon" testing:
        1. This testing ensures that the vendors have fully complied to the technical capabilities that will be utilized during the CAT testing
        2. For example, that they use the right BICEPS schema, security, MDPWS messages, etc. etc. etc.
        3. This is the detailed level of testing that would be supported by the SDC Test Tool (see above) for the required SDC capabilities based on the SDPi CAT testing to be performed 
      3. In the SDPi CAT Testing ...
        1. The exchanges will have to be verified at basic message syntax level, but will assume that the vendor has 100% passed pre-CAT testing 
        2. NOTE:  This is necessary to ensure the integrity of the test results and to facilitate debugging, especially given that software is often modified frequently during the CAT event based on issues that are identified during connection with other vendors (decoupled) systems.
        3. The test SCENARIOS are much more limited than full core SDC functionality and are focused on actor / profile / option / transaction testing ..
    2. What scenarios will be tested for IHE CAT?
      1. This is TBD by those who join the SDPi CAT testing group (including this group) to identify the scenarios and the test that should be performed to provide the desired interoperability confidence.
      2. This SDPi CAT test development will begin in earnest once the SDPi Supplement 1.0 drafting / publication is completed.
      3. These tests will be captured in the IHE Gazelle test management system, which will guide and document (including independent reviewer / monitor evaluation) each of the tests
      4. For CAT testing, full automation is not the intent, but it will leverage the SDC Test Tooling and its integration with Gazelle and the logging of message exanges between each test participant
    3. How will test participant exchanges / messages be logged (especially if encrypted)?
      1. (See next for the "encrypted" part of this question)
      2. Vendor logging of each exchange for CAT tests is very important, in that it provides the evidence that the exchange actually happened (time stamps included) and that it was successful (e.g., pasting logged message instances into Gazelle  so as to let the Monitor run validation testing).
      3. This can be faciliated by network monitoring tools (incl. Wireshark and similar), but is a key part of creating the evidence.
      4. Again, for debugging of test problems, logging is a key tooling capability
    4. (Anna) How will secure connections be supported by IHE PAT / CAT / CA test tooling?
      1. There are numerous ways of accomplishing this, including utilization of a middle-man participant appliance that captures and forwards the message exchanges between two participants
      2. Question is what is the best way of accomplishing this in an IHE / Gazelle CAT testing environment
      3. Discussion recognized that this challenge has been dealt with many times in IHE testing, especially ITI profiles, and that we should understand and leverage that work 
      4. ACTIONJohn J. GarguiloDiscuss with Bill M. & Rob S. at NIST about strategies that have been used in IHE Gazelle-based CAT testing for secure communications.
    5. What are the IHE CAT target dates for 2021?
      1. IHE USA has announced a 100% virtual NA CAT for March 1-5 
      2. IHE EU has not announced any 2021 events, nor other IHE national deployment committees.
    6. <Note:  there were undoubtably other questions but ...>

Action Items / Tasks

  • Todd Cooper Michael Faughn Todd will do a few examples of what a requirement might look like in the SDPi Supplement document and have Michael review and "fix".  Report back in the next CA & Tooling call  
  • John J. Garguilo Discuss with Bill M. & Rob S. at NIST about strategies that have been used in IHE Gazelle-based CAT testing for secure communications. to report back to the group no later than  
  • John Donnelly Provide updated graphics (if any) for IHE PAT / CAT / CA etc. to use to brief those starting to work with 


Agenda

  1. General Updates
  2. Action Items Review
  3. Tool Chain (requirements to test scripts to test execution / documentation) Discussion
  4. Other Topics

Participants

Todd Cooper Michael Faughn Kenneth Fuchs  John Donnelly John J. Garguilo

Regrets:  David Gregorczyk, Anna Feiler

Discussion Notes

  1. General Updates
    1. OR.NET & IHE Germany SDC/SDPi PAT 
      1. IHE Germany & OR.NET have scheduled an SDC/SDPi Plug-a-thon (PAT) for October 21 & 22 at Dräger in Lübek, Germany
      2. PAT objectives under consideration include ...
        1. Exploring a virtual (or hybrid) CAT / PAT event for SDC / SDPi testing - this would set the foundations for subsequent PAT/CAT events
        2. Utilization of a "discovery proxy" concept, that could then possibly be supported by a MDIRA/ICE Supervisor / Network Controller actor (see below)
        3. Validation and consideration of the current SDPi Actors & Transactions (at an abstract level) and their mapping to MDPWS messages and message sequences
        4. SDPi Transaction Test Scripting & Tooling (see below detail)
    2. SDPi Supplement Update
      1. Actor Models & Transactions & options have been created for all four SDPi Profiles 
      2. Detailed drafts of these should be provided in the 10/02 Friday supplement release + 
      3. Ready for consideration at the upcoming IHE Germany PAT (per above)
    3. IHE DEV MDIRA Profile Proposal
      1. Proposal for an IHE DEV MDIRA Profile proposal was advanced two weeks ago, reviewed last week during the joint HL7 / IHE / IEEE WGM and is out for approval by the IHE Devcies domain
      2. This profile proposal would build on the foundation of the four SDPi profiles, but add actors and transactions supporting the MDIRA Reference Implementation (see the JHU/APL MDIRA Update to the September WGM last week)
      3. Note that Gemini MDI CA & Tooling would directly support this emerging profile ... if we get everything "right"! 
  2. Action Items Review
    1. Review of Cucumber / Gherkin usage, including in Dräger & Prometheus & IHE (David Gregorczyk Michael Faughn John Donnelly)
      1. Michael pointed out that Cucumber (incl. Studio) and Gherkin are primarily intended to drive test tooling; whereas here we are using it as a stepping stone from use case / scenarios to ReqIF
      2. John Donnelly will try to provide an update on IHE-based discussions as well (e.g., HIE white paper work)
    2. Updating SDC / SDPi Test Tooling diagrams (David Gregorczyk & Anna Feiler) 
      1. NOTE:  Both David & Anna are on PTO for another week or two 
      2. Per previous discussions, the intent is to provide more up-to-date tool diagrams; here are those from the white paper:
        • ..
  3. Tool Chain Discussion
    1. Requirements Capture
      1. Discussions will continue with how to capture (e.g., using ReqIF) requirements from JWG7 standards (such as 80001-1 2nd edition) for mapping to PKP (e.g., 11073-10700) and to SFC (see above) and testing 
    2. Test Scripting
      1. Now that the initial complete set of transactions for the four SDPi profiles has been established, work (at least at the conceptual level) can begin for test scripts ... starting with the upcoming IHE DE PAT
  4. Other Topics
    1. HIMSS'21 in August in Las Vegas

Action Items / Tasks

No new action items identified.


Agenda

  1. General Updates
  2. IHE" Cucumber Studio" Use? 
  3. Virtual CAT Testing for SDC/SDPi?
  4. Other Topics

Participants

Todd Cooper David Gregorczyk John J. Garguilo John Donnelly

Discussion Notes

  1. General Updates
    1. IHE EU CAT'20 November 6-11 will be 100% virtual; now evaluating which profiles can be tested "virtually" and to what level of completeness
    2. IHE NA CAT'21 will be 100% Virtual ("online") / remoted and will probably be pushed out to March 2021
      1. NOTE:  The test tools & platform for both EU and NA Connectathons will (most likely) be the same; the profiles WILL be the same (smile)  
    3. NOTE:  IHE is also investigating leveraging GITB framework for integration of multiple test platforms, supporting a next gen Gazelle API
    4. IHE Germany may advance an IHE Plug-a-thon for SDC/SDPi in the coming months ...
      1. TBD whether this will be an in-person event or online or hybrid  
  2. IHE "Cucumber Studio" Use?
    1. IHE International has a license to use "Cucumber Studio" (incl. Gherkin; tutorials are also available)
    2. To date this has been mostly applied to the  OpenHIE initiative & some IHE test tooling considerations (e.g., possibly for future FHIR-based testing of QEDm)
    3. Can it be utilized for IHE DEV DPI SDPi Use Case analysis purposes?  (e.g., see Peter K's QH/Silent ICU Gherkin examples)
    4. Discussion ...
      1. Prometheus & Dräger have experience with Cucumber / Gherkin ... but not necessarily this Studio tool
      2. "BDD" (Behaviour-Driven Development) Experience?  (None on the call)
      3. ACTION( David & Todd )  Ask for experience with Dräger & Prometheus stakeholders (incl. BDD use)
      4. ACTION( Todd ) Create Silent ICU project & invite Ken Fuchs & Peter Kranich as members to test out
  3. Virtual CAT Testing for SDC/SDPi?
    1. Some have said, "You can't test SDC-based interoperability virtually ... the whole point is tight integration around a patient!"  To what degree is that statement true?  
    2. Discussion ...
      1. (David)  SDC is a local area network focus, so virtualization requires a virtual LAN w/ WS multi-cast support;  So ... "not easy" but also very doable - with the Right Smart Guy!  
        1. VLAN's utilized with some testing (incl. cross Atlantic sessions in virtual environment) ... so there is some experience
        2. Utilized a "discovery proxy" to facilitate discovery w/o UDP multi-cast requirements; but this is not formally defined (in standards) & currently Dräger internal only 
          1. CONSIDER profiling discovery proxy in SDPi as an option & backfill to the  ISO / IEEE 11073 SDC standards when / as needed & appropriate
      2. (John D.) All U.S. ONC testing has been virtualized, but not for devices!  This effort may support future adoption & integration
      3. ACTION( David ) Consider the 2020 IHE Germany SDC/SDPi Plug-a-thon to test out virtualized testing approaches 
  4. Other Topics
    1. No other topics identified


Action Items / Task


Agenda

  1. General Updates
  2. Draft IEEE 11073-10700 Base "Common" PKP w.r.t. Hanging Gardens Model
  3. Open Discussion / Topics

Participants

Todd Cooper John Donnelly Kenneth Fuchs David Gregorczyk  Michael Faughn John J. Garguilo  

Michael Kirwan

Regrets:  Anna Feiler

Meeting Notes

  1. General Updates
    1. NOTE:  This was the first meeting moving to IHE WebEx web call info ... 
    2. September WGM Agenda - updates in progress 
  2. Draft IEEE 11073-10700 Base "Common" PKP  w.r.t. Hanging Gardens Model 
    1. David GregorczykProvided a tour of a draft 11073-10700 standard (pre ballot) 
      1. (Todd Cooper) provided an orientation of the positioning of -10700 to the Hanging Gardens model + how to be integrated into the SDPi Supplement document
      2. NOTE:  The early draft of the -10700 standard was circulated to the meeting participants NOT TO BE FURTHER DISTRIBUTED OR POSTED ANYWHERE!  
      3. (David Gregorczyk) Provided a high-level review of the document's content
        1. Section 6 is focused on the quality / regulatory / legal affairs stakeholders
        2. Section 7 is focused on the MDI R&D technical stakeholders
    2. Discussion
      1. (John Donnelly) Would be good to keep sync of titles & graphics to reduce confusion for those just coming to the party
      2. CONSIDER:  Changing 11073-1070x PAR titles and / or Cathedral window titling; also audiences from the IEC/SC 62A & 60601-xyz standards community
      3. Sources of requirements (at least topics) for the document?  Standards-based sources?
      4. Relationship to a "shared" (across SDC products ecosystem) risk management / RCMeasures requirements?  Supporting interoperability of decoupled products?  What's missing?
    3. NOTE:  Ran out of time ... 
  3. Open Discussion / Topics
    1. (John Donnelly) Questions regarding Home-sourced to Cloud Info
      1. Home device to "home hub" => FHIR  (a la IHE POU)
        1. For example, for remote patient monitoring / disease management applications
          1. NOTE:  Not typically acute care medical devices deployed at home settings
          2. Should include device status info (e.g., device failure) 
        2. What should we tell device manufacturers for terminology, for connectivity standards, etc. etc. etc. 
        3. See IHE POU profile + Devices on FHIR PHD IG  + see PCHAlliance / Continua Guidelines
      2. Sensors (ambient) data collection guidance (esp. with geo-positioning ) 
        1. See IEEE Std 11073-10471 - Device specialization - Independent living activity hub
      3. ISO/IEEE 11073 General Info Sources?  (per  (i) above)
        1. New players (e.g., from LTC per COVID challenges / post-acute) looking at home-based care technologies ... not steeped in health informatics and definitely not in device informatics 
        2. "Remote Patient Monitoring" and similar hot topics today ...
        3. Discussion
          1. Relevant discussion at Paper: SES Remote Connected Care and Mobile Health 
          2. See wikipedia links above ... 

Action Items / Tasks

No new action items.


Agenda

  1. General Updates
    1. Action Items
    2. Topics
  2. Review SES MDI Framework Slides (UML Model & Layer Detail Slides)
  3. Review PKP ReqIF-based Word documents 
  4. Review SDPI Supplement draft & approach to support V&V testing
  5. Other Business

Participants

Todd Cooper Michael Faughn David Gregorczyk

Anna Filer

Meeting Notes

  1. General Updates (All)
    1. IHE T&T:  IHE Europe & IHE Services continue to finalize the approach for November's IHE EU Connectathon, including F2F / Remoted / Hybrid;  IHE USA has indicated January's event will be 100% virtual; 
  2. SES MDI Framework  (Todd Cooper)
    1. UML Modeling - Work begun using MagicDraw ... will report out next call
    2. Layer Specific Slides - No additional Work has been ... will update in next call
  3.  SDC PKP Standards ReqIF→Word doc review (David Gregorczyk
    1. David Gregorczyk provided a quick review of the 11073-10700 Base PKP standard, including the use of ReqIF.
    2. Word document will be available mid-next week for review
    3. The Word document was created from a ReqIF based specification that was exported from DOORS.  
    4. Goal is to be able to transform the ReqIF XML spec (e.g., using "ReqIF Studio" or similar tooling) into the Hanging Gardens ReqIF Integration spec
  4. SDPi Supplement & Readiness for Test Tooling
    1. Todd Cooper reviewed the SDC tooling descriptions in the 2019 IHE SDPi White Paper 
      1. Anna indicated that these are quite dated - tooling strategy has evolved over the last year! - and does not reflect what is planned for release into the public domain later in 2019
      2. ACTION( Anna) To craft some tool diagrams that will reflect the current planning
  5. Other Business
    1. (Anna) updated the group on a PKP regulatory focused white paper that is being developed
      1. Paper will be put on a public drive early next week for review and contributions; 
      2. Paper completion deadline will be set in the coming weeks when the next meeting with European regulators is set

Action Items / Tasks

  • (Anna / David Gregorczyk)  Update tool diagrams reflecting what is planned for public release later this year


Agenda

  1. Team Status Updates
    1. Future IHE CAT events - F2F, V2V or hybrid?
  2. Topics Report-outs (see previous meeting)
  3. Other Business 

Participants

Todd Cooper Michael Faughn Kenneth Fuchs David Gregorczyk John J. Garguilo

Meeting Notes

  1. General Updates
    1. NOTE:  July 16th meeting didn't capture any notes here ... but the focus was on the development of the SES MDI Framework slides as discussed today in (2) below
    2. Reviewed Topics from 7/2 session (see above & below)
    3. NOTE:  The EU CAT'20 in November in Brussels is still TBD whether it is F2F / Virtualized / Hybrid event; to be finalized & announced around September 15
  2. Framework Slides review
    1. General discussion and review of the current draft of the slide deck
    2. Question:  Is the current Hanging Gardens Conceptual Model about right - worth drilling down on more detail - or is it off track in some way?
      1. Consensus is that it has evolved to a generally good place ... BIG scope / vision ... but needed 
      2. Yes, drilling down on the next level of detail and then using to present to "layers" communities / stakeholders is appropriate
    3. Next Steps:
      1. Create a UML model of the constructs both for horizontal layer characterization + integration across layers 
      2. Update the layer-specific pages to illustrate the artifacts / components etc. that comprise that subject matter and the linkages to the Big 6 Formalization technologies (e.g., ReqIF)
      3. ACTION (Todd Cooper Michael Faughn) Get MagicDraw up and working for this UML file (note MagicDraw is also used by Dräger and many others)
  3. CA - Tooling Topic Updates
    1. (2.a) Gherkin & ReqIF Update -
      1. no progress at this point - but see (2.b)
      2. Kenneth Fuchs has been extending the detail around audible alert management - at which point we will be able to 
    2. (2.b) PKP & ReqIF Update
      1. David Gregorczyk working on PKP standards using ReqIF but for Word version of standards documents
      2. Hopefully will have a version of these by next meeting of this group 8/20th? Consider how to extract / migrate those requirements to a Gemini SDPi+FHIR ReqIF format
    3. (2.c) Inter-layer Mapping
      1. Todd Cooper is first addressing this in the SES MDI Framework slide deck ... then can focus on more specifics of the mappings
    4. (2.g) CA Strategy 
      1. No significant work since the last meeting - but completing the slide deck will help lay the foundation for the strategy
      2. John J. Garguilo provided a Reality Check regarding the fact that specifications are still in development, DPE tool is in work but a ways off ... resources are highly constrained ...
      3. AND this is a very very complex set of profiles - perhaps the most in IHE - Strategy vs. near term Starting Point will have to factor all this together
    5. (2.h) Tool Identification / Collection
      1. Still an open To Do item
      2. Note that Dräger put the Python sdc11073 library in the public domain and Todd CooperDavid Gregorczyk are working to integrate sample messages and links to the library in the TF-2 SDC messages appendix.  
      3. The OR.NET, Dräger and others also have test tooling that will be contributed for CAT testing and that leverage the sdc11073 lib, etc.  
  4. Other Business
    1. John J. Garguilo led a discussion of the upcoming HL7 / IEEE / IHE WGM's (virtualized) and the schedule that we should use.  
      1. Agreement was that scheduling 2x 90 minute sessions daily should be sufficient:  0600-0730 Pacific & 0800-0930 Pacific


Action Items / Task Lists

  • Todd Cooper Michael Faughn Get MagicDraw up and going on Todd's platform for creation of the UML diagrams for the slide deck


Agenda

  1. Review structure & content of this team page
  2. Discuss & Update Roadmap
  3. Begin the CA & Tooling Strategy development task
  4. Other Business 

Participants

Todd Cooper Kenneth Fuchs Michael Faughn

Anna Feiler 

Regrets:  David Gregorczyk

Meeting Notes

  1. General Updates
    1. Introductions ... esp. Anna to Michael & John
    2. Recap of the discussions to date
      1. ACTION (Todd) Post Michael F's Ghirkin for SDPi presentation
      2. ACTION (Todd) update slide deck (to SES MDI) version, including fixing the PKP on the SDPi profiles model
  2. Topics / Issues 
    1. Requirements Capture:  Scenarios to Gherkin to ReqIF (Ken & Michael)
      1. Includes a few example scenarios  example (simple but representative) 
    2. Use of ReqIF by the PKP Standards (David & Michael)
    3. Use of ReqIF for SDPi inter-layer mapping (Todd)
    4. <Target report out for 2020.07.16 call>
    5. Update of an SDC/SDPi Device Profile Editor (DPE)
      1. Is the current "SDC DPE" from PoCSpeC project to/from Prometheus ... usable?  (probably ... not)
      2. Scope of the DPE tool?
        1. What layers from the SDPi layers model?
        2. Integration of ReqIF? 
        3. Generation of SFC specifications?
    6. Inventory of tooling that is or will soon be available (Anna, John/Michael)
      1. See white paper + list for IHE CAT below.
      2. Target:  Update of tooling approach on meeting 2020.08.06 call
    7. CA Strategy - Narratives to PnT using IHE CA for SDPi (Todd + John & Anna)
      1. "strategy" - Need to define approach 
      2. (Garguilo) Challenge is today vs. 2-3 years "strategic" objective
      3. NOTE:  CA is much more rigorous than CAT integration & interoperability testing
      4. Target:  Initial update on 2020.07.16 ca..
    8. IHE Connectathon Support Tooling & Testing Processes (work that has to be done to plan for planned '20 & 21 IHE CAT events) (John & Todd)
      1. Use of existing NIST tooling?
        1. Leveraging the  V2 test framework?
        2. Potential use of NIST FHIR Toolkit (e.g., XDS.b & MHD profiles testing)?
        3. IHE Devices tooling (RTMMS, DPE)
      2. Integration with Gazelle (& IHE Services ...) 
      3. Use of existing & emerging SDC / OR.NET tooling (+ MoVE project, Martin K's university tooling, etc.)
      4. NOTE:  Whether future IHE CAT events are F2F, remoted or a hybrid is TBD - should be able to report out at next call (based on IHE T&T call the day before)
    9. ACTION (Todd) Create a similar "topics" table / pages like used on the Topics of Interest page & add action items for the team members
  3. Team Discussion Prioritization 
    1. Topics:  2.a + 2.b + 2.c  grouped and initial report out at next call  (Ken, David, Michael)
    2. Topics:  2.g  initial report out on next call (Anna, John, Todd)
    3. Topics:  2.h begin to collect
    4. Defer:  2.e  until after 2.f & 2.f until August (after German vacation / holiday season)

Action Items / Task Lists

  • Todd CooperPost Michael F's Ghirkin for SDPi presentation
  • Todd Cooper update slide deck (to SES MDI) version, including fixing the PKP on the SDPi profiles model
  • Todd Cooper Create a similar "topics" table / pages like used on the Topics of Interest page & add action items for the team members