Interoperability Roadmap Recommendations Semantic Standards Workgroup James Ferguson, co-chair Rebecca Kush, co-chair April 22, 2015.

Slides:



Advertisements
Similar presentations
Interoperability Roadmap Comments Package Implementation, Certification, and Testing (ICT) Workgroup February 13, 2015 Liz Johnson, co-chair Cris Ross,
Advertisements

ELTSS Alignment to Nationwide Interoperability Roadmap DRAFT: For Stakeholder Consideration in response to public comment.
HITSC Clinical Quality Workgroup Jim Walker March 27, 2012.
Kick-Off Meeting Semantic Standards James Ferguson, co-chair Rebecca Kush, co-chair December 1, 2014.
Summary of Workgroup Comments on the Interoperability Roadmap Implementation, Certification, and Testing (ICT) Workgroup April 22, 2015 Liz Johnson, co-chair.
Companion Guide to HL7 Consolidated CDA for Meaningful Use Stage 2
Interoperability Roadmap Comments on Common Clinical Data Set Content Standards Workgroup Andy Wiesenthal, chair Rich Elmore, co-chair March 23, 2015.
Interoperability and Health Information Exchange Workgroup March 10, 2015 Micky Tripathi, chair Chris Lehmann, co-chair.
Draft – discussion only Advanced Health Models and Meaningful Use Workgroup: Update Paul Tang, chair Joe Kimura, co-chair March 10, 2015.
Interoperability Framework Overview March 24, 2010 Presented by: Douglas Fridsma, MD, PhD Acting Director, Office of Interoperability & Standards ONC HIT.
2015 Edition Certification NPRM Prioritization Recommendations/Standards Readiness Assessment June 24, 2015 Semantic Standards Workgroup Becky Kush, co-chair.
1 Definitions Value set: A list of specific values, which may – or may not – contain subsets of one or more standard vocabularies, that define or identify:
AUGUST 21, 2014 STANLEY M. HUFF, MD CHIEF MEDICAL INFORMATICS OFFICER INTERMOUNTAIN HEALTHCARE HSPC Meeting Introduction.
Development Principles PHIN advances the use of standard vocabularies by working with Standards Development Organizations to ensure that public health.
Strategy and Innovation Workgroup: Recommendations on the Federal Health IT Strategic Plan March 4, 2015 David Lansky, Chair Jennifer Covich,
V ocabulary Subsets and Value Sets NCPDP Response Feb 23, 2010 HIT Standards Committee (HITSC) Task Force on Vocabulary.
Nedra Garrett Director, Division of Informatics Practice, Policy, and Coordination (DIPPC) PHIN Partner Call April 20, 2011 Public Health Information Network.
1 Federal Health IT Ontology Project (HITOP) Group The Vision Toward Testing Ontology Tools in High Priority Health IT Applications October 5, 2005.
Our Joint Playing Field: A Few Constants Change Change Our missions (if defined properly) Our missions (if defined properly) Importance of Community Engagement.
Working Together to Advance Terminology Tooling Presentation to OHT Board, Birmingham Jennifer Zelmer & Karen Gibson.
Interoperability and Health Information Exchange Workgroup April 2, 2015 Micky Tripathi, chair Chris Lehmann, co-chair 1.
MODULE B: Case Report Forms Jane Fendl & Denise Thwing April 7, Version: Final 07-Apr-2010.
Betsy L. Humphreys Betsy L. Humphreys ~ National Library of Medicine National Institutes of.
© CDISC 2011 Joint Initiative Council 18 October 2011 Bron Kisler, VP, Strategic Initiatives, Current JIC Leader Rebecca D. Kush, PhD, President and CEO,
Public Health Reporting Initiative: Stage 2 Draft Roadmap.
Chapter 6 – Data Handling and EPR. Electronic Health Record Systems: Government Initiatives and Public/Private Partnerships EHR is systematic collection.
Component 11/Unit 8b Data Dictionary Understanding and Development.
Interoperability Framework Overview Health Information Technology (HIT) Standards Committee June 24, 2010 Presented by: Douglas Fridsma, MD, PhD Acting.
HIT Policy Committee NHIN Workgroup Recommendations Phase 2 David Lansky, Chair Pacific Business Group on Health Danny Weitzner, Co-Chair Department of.
HIT Standards Committee Clinical Operations Workgroup Report Jamie Ferguson, Chair Kaiser Permanente John Halamka, Co-chair Harvard Medical School 20 August,
1 Meaningful Use Stage 2 The Value of Performance Benchmarking.
Draft – discussion only Advanced Health Models and Meaningful Use Workgroup June 23, 2015 Paul Tang, chair Joe Kimura, co-chair.
2015 Edition Certification NPRM Prioritization Recommendations/Standards Readiness Assessment June 11, 2015 Semantic Standards Workgroup Becky Kush, co-chair.
HIT Policy Committee Adoption/Certification Workgroup Comments on NPRM, IFR Paul Egerman, Co-Chair Retired Marc Probst, Co-Chair Intermountain Healthcare.
HIT Policy Committee Information Exchange Workgroup NwHIN Conditions for Trusted Exchange Request For Information (RFI) May 18,
Public Health Reporting Initiative Stage 3 Sprint: Implementation Guide Development Phone: x
Query Health Vendor Advisory Meeting 12/15/2011. Agenda Provide Overview of Query Health Seek Guidance and Feedback on Integration Approaches.
Provider Data Migration and Patient Portability NwHIN Power Team August 28, /28/141.
Interoperability Roadmap Comments on Common Clinical Data Set Content Standards Workgroup Andy Wiesenthal, chair Rich Elmore, co-chair March 10, 2015.
Health IT Workforce Curriculum Version 1.0 Fall Networking and Health Information Exchange Unit 3b National and International Standards Developing.
Larry Wolf Certification / Adoption Workgroup May 13th, 2014.
MATT REID JULY 28, 2014 CCDA Usability and Interoperability.
The Practical Challenges of Implementing a Terminology on a National Scale Professor Martin Severs.
2015 Edition Certification NPRM April 1, 2015 Semantic Standards Workgroup Becky Kush, co-chair Jamie Ferguson, co-chair.
NHII 03 Standards and Vocabulary Group A CG Chute Mayo Clinic CG Chute Mayo Clinic This presentation does not necessarily reflect the views of the U.S.
HIT Standards Committee Clinical Operations Workgroup, Vocabulary Task Force Update on Vocabulary For Stage 2 Jamie Ferguson, Kaiser Permanente Betsy Humphreys,
HIT Standards Committee Overview and Progress Report March 17, 2010.
HIT Standards Committee Clinical Operations Workgroup Jamie Ferguson Kaiser Permanente John Halamka Harvard University February 24, 2010.
Lab Results Interfaces S&I Framework Initiative Bi-Weekly Initiative Meeting May 9, 2011.
HIT Standards Committee Vocabulary Task Force Task Force Report and Recommendation Jamie Ferguson Kaiser Permanente Betsy Humphreys National Library of.
HIT Policy Committee NHIN Workgroup HIE Trust Framework: HIE Trust Framework: Essential Components for Trust April 21, 2010 David Lansky, Chair Farzad.
HIT Standards Committee Clinical Operations Workgroup Report on Gaps and Next Steps Jamie Ferguson Kaiser Permanente John Halamka Harvard Medical School.
Discussion - HITSC / HITPC Joint Meeting Transport & Security Standards Workgroup October 22, 2014.
Proposed S&I Public Health Reporting Initiative 1 Challenge -There is a lack of harmonized activities to enable electronic data exchange between clinical.
“ Jericho / UT Austin Pilot” Privacy with Dynamic Patient Review April 30, 2013 Presented by: David Staggs, JD, CISSP Jericho Systems Corporation.
Section 4.9 Work Group Members Kris Hafner, Chair, Board Member Rob Kondziolka, MAC Chair Maury Galbraith, WIRAB Shelley Longmuir, Governance Committee.
Health IT Standards Committee A Public Advisory Body on Health Information Technology to the National Coordinator for Health IT 2017 Interoperability Standards.
Joint Health IT Committee Meeting Precision Medicine Task Force March 10, 2016 Leslie Kelly Hall, Co-Chair Andy Wiesenthal, Co-Chair.
Draft – discussion only Advanced Health Models and Meaningful Use Workgroup February 17, 2015 Paul Tang, chair Joe Kimura, co-chair.
C-CDA Scorecard Rubrics Review of CDA R2.0 Smart C-CDA Scorecard Rules C. Beebe.
Interoperability Measurement for the MACRA Section 106(b) ONC Briefing for HIT Policy and Standards Committee April 19, 2016.
HIT Policy Committee Health Information Exchange Workgroup Comments on Notice of Proposed Rule Making (NPRM) and Interim Final Rule (IFR) Deven McGraw,
NAACCR CDA Pilot Project - Overview, Status, and Findings 2009 NAACCR Conference Ken Gerlach, Co-Chair, NAACCR Clinical Data Work Group; Health Scientist,
1 The information contained in this presentation is based on proposed and working documents. Health Information Exchange Interoperability Minnesota Department.
Patient Centered Medical Home
Component 11 Configuring EHRs
Federal Health IT Ontology Project (HITOP) Group
Unit 5 Systems Integration and Interoperability
Health Information Exchange Interoperability
Carolina Mendoza-Puccini, MD
Presentation transcript:

Interoperability Roadmap Recommendations Semantic Standards Workgroup James Ferguson, co-chair Rebecca Kush, co-chair April 22, 2015

Membership 2 MembersOrganization Co-Chairs Jamie FergusonKaiser Permanente Becky KushClinical Data Interchange Standards Consortium (CDISC) Members John CarterApelon, Inc. Todd CooperCenter for Medical Interoperability Stan Huff Intermountain Healthcare Rosemary KennedyeCare Informatics, LLC, Thomas Jefferson University Harry RhodesAHIMA Eric RoseIntelligent Medical Optics (IMO) John Speakman New York University Langone Medical Center Asif SyedAmerican Medical Association (AMA) Andy Wiesenthal - liaison memberDeloitte Consulting, LLP Ex Officio Members Steve BrownVeterans Administration (VA) Margaret HaberEnterprise Vocabulary Services, National Cancer Institute (NCI) Betsey HumphreysNational Library of Medicine (NLM) Mitra RocaFood and Drug Administration (FDA) ONC Staff Lead Patricia GreimOffice of the National Coordinator for Health IT

HITSC - Semantics Standards WorkgroupSemantics Standards General Questions (as they apply to the assigned Roadmap section) Are the actions proposed in the draft interoperability Roadmap the right actions to improve interoperability nationwide in the near term while working toward a learning health system in the long term? What, if any, gaps need to be addressed? Is the timing of specific actions appropriate? Are the right actors/stakeholders associated with critical actions? Roadmap Sections J. Consistent Data Formats and Semantics Charge / Question(s) Which data elements in the proposed common clinical data set list need to be further standardized? And in what way? 3

Common Themes 1 of 4 Additional Focus Areas 1.Need a shared understanding of the importance of information models and terminology bindings 2.Need agreement on highly granular information models bound to terminologies for information exchange 3.Data standards (e.g., for performance and quality measures, public health) should reflect the semantics implemented in EHR systems and semantics in EHR should be the same across settings 4.Need attention to challenges of data aggregation, for example for resolving duplicates, when data is assembled from multiple sources 5.It is critically important for data provenance to be workable and practical for semantic interoperability 6.Reject usefulness of National Information Exchange Model (NIEM) related to healthcare interoperability 7.Usage of FDA Unique Device Identifiers (UDIs) including laboratory devices should be more explicit in the roadmap for use in the EHR and for surveillance, patient safety, and other reporting purposes. 4

Common Themes 2 of 4 Missing Or Misconstrued Items 1.Need to prioritize additional diagnostic studies/reports (e.g. EKG) for patient and provider decision making 2.Need to support semantic web standards including OWL and RDF 3.Recommend minimizing mapping between different standards because mapping is imprecise 4.Support the use of interface terminologies that allow accurate and precise use of target standards 5.Need to support semantic interoperability by multiple mechanisms, including: a)Data exchange - standards for moving copies of data between entities b)Access to data at its source – need shared access to patient centered data sources c)Combinations of a and b including access to aggregated data 6.The roadmap should include the seamless integration and use of healthcare device information (e.g., physiological monitors, infusion pumps, … personal health and public health), including unique identifiers, observations, settings, alerts and waveforms using standards such as UDI, ISO/IEEE 11073, LOINC and SNOMED CT 5

Common Themes 3 of 4 Clarification Needed 1.Need a clear plan for achieving the objectives laid out in the Roadmap 2.Need clarity about how to achieve coordinated governance of semantic standards 3.The reference to “technical architecture” is too vague (p. 84, Table 10, J2) 4.The reference to “translation and adapter services” is unclear (p. 85, Table 10, J4) 5.Common data elements are not necessarily standards and a definition needs to be developed, preferably based upon ISO The common clinical data set from the roadmap needs more specificity, needs to be vetted broadly, and to be harmonized with other common clinical data sets 6

Common Themes 4 of 4 ONC Coordination With SDOs 1.Need ONC to work more closely with (and within) accredited SDOs 2.Need closer coordination of US semantic standards with international standards organizations (e.g., via the Joint Initiative Council on SDO Global Health Informatics Standardization) a)Reduce overlap and improve coordination b)Improve operations e.g. release schedules 3.Suggested vocabularies and code sets do not align well with widely used research and clinical standards, including those defined by US and international agencies and SDOs such as CDISC 7

Interoperability Roadmap Section J Consistent Data Formats and Semantics 8 Questions for Workgroup Which data elements in the proposed common clinical data set list need to be further standardized? And in what way? Common Clinical Data Elements 1.Patient name 2.Sex 3.Date of birth 4.Race 5.Ethnicity 6.Preferred language 7.Smoking status 8.Problems 9.Medications 10.Medication allergies 11.Laboratory test(s) 11.Laboratory value(s)/result(s) 12.Vital signs 13.Care plan field(s), including goals and instructions 14.Procedures 15.Care team members 16.Immunizations 17.Unique device identifier(s) for a patient’s implantable device(s) 18.Notes/narrative Proposed Prioritize the list with cliniciansFurther specify the standards Proposed Diagnostic ReportsCritical need for radiology, cardiology, etc. reports Proposed Culture Results/MicrobiologyIs this included under Laboratory tests? Proposed Surveillance Interventionselectronic submissions Proposed Change 7 Smoking statusAlign with IOM report tobacco use Proposed Harmonize with CDASHIncludes models and metadata to support FDA/PMDA/research

Interoperability Roadmap Section J. 1. (1 of 3) Consistent Data Formats and Semantics 9 J. 1. Common, list of interoperability standards Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J ONC will annually publish and update a list of the best available standards and implementation guides. ONC will facilitate an open transparent process/minimize cost/promote innovation. No – We need to transmit human readable reports for expensive useful diagnostic studies Ex: electronic FAX Need access models in addition to transactional data movement-Need the availability of past studies and reports (such as CT/ MRI/ EKG tracings/nerve conduction studies/Operative Reports/Discharge Summaries) Device informatics standards should be included and supported accordingly, including UDI Annual Changes are unworkable - stability is desirable. New standards are additive so costs and resource burden increase as they are added. Focus first on document exchange of reports and prioritize the Common Data Set What is the relationship of the standards advisory with rulemaking? Engagement with implementers for lessons learned is key/ transparency is critical/ avoid including content without prior FACA and community discussions (RadLex) Standards are not replaced, but layered Send, receive, find, use common clinical data set Need to include access to clinical data Prioritize diagnostic reports Expand HIT and users Prioritized subset for prioritized scenarios Achieve LHS Continue to work from prioritized list

Interoperability Roadmap Section J. 1. (2 of 3) Consistent Data Formats and Semantics 10 J. 1. Common, list of interoperability standards Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J Implementers and decision-makers should use ONC’s list of the best available standards when making decisions about the standards they will use to enable specific use cases If the focus is on mature standards (not Draft Standards for Trial Use) and if they avoid unnecessary variation. Harmonization of V 2.3, V2.5, and V2.8 should be pursued. (We now have five versions of HL7 V2.x, versions of CCDA, and infinitely flexible FHIR) Greater coordination among standards versions are important. Feedback loops from implementers need to be strengthened. Documentation of pros/cons and lessons learned will promote informed decisions Harmonization should be pursued with SDOs. ONC should work more closely with Standards Development Organizations Send, receive, find, and use common clinical data set Need to include access to clinical data Focus on unstructured reports and prioritize diagnostic reports Expand HIT and users Prioritized subset for prioritized scenarios Achieve LHS Continue to work from prioritized list

Interoperability Roadmap Section J. 1. (3 of 3) Consistent Data Formats and Semantics 11 J. 1. Common, list of interoperability (Continued) Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J Developers will update their systems to align with ONC list of best available standards C-CDA 2.0, vocabulary standards and code sets that support the common clinical data set Change is costly and stability supports interoperability. Vocabulary advice needs more detail. Description of planned ONC enforcement authority as well as incentives and penalties are missing Designating C-CDA 2.0 is premature Needs of the Research community are missing Send, receive, find, use common clinical data set Need to include access to clinical data Focus on unstructured reports Expand HIT and users Prioritized subset for prioritized scenarios Achieve LHS Continue to work from prioritized list

Interoperability Roadmap Section J. 2. (1 of 2) Architecture in Support of Standards Activities 12 J. 2. Architecture in Support of Standards Activities Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J Through coordinated governance, public and private stakeholders will establish and maintain a prioritized set of use cases and associated functional requirements (see Appendix H for Priority Interoperability Use Cases). How this will be done should be explained (e.g.) ONC will facilitate a process by which public and private stakeholders will establish and maintain…” Missing a subset of high value use cases for collaborative focus The role of public and private stakeholders should be to set priorities not just to comment on them -Ensure there’s open, transparent and balanced representation of diverse stakeholders J Through coordinated governance, public and private stakeholders will develop a nationwide technical architecture Technical Architecture is ambiguous, depending on the scope this may not be achievable Missing definitions for what is meant by technical architecture

Interoperability Roadmap Section J. 2. (2 of 2) Architecture in Support of Standards Activities 13 J. 2. Architecture in Support of Standards Activities Are these the right actions? What gaps need to be addressed?Is the timing appropriate? Are the right stakeholders associated with critical actions? J Through coordinated governance, public and private stakeholders will define a necessary set of standards activities that support the prioritized use cases and functional requirements and the agreed upon architecture. Architecture is not defined. The role of ONC is not defined. Substantially more work needs to be done on prioritizing use cases. As an example of the need for use case prioritization, use cases do not adequately address post- market surveillance and/ or integration of EHRs with clinical research. So far, use cases do not address failure to rescue (FTR). Failure to synthesize information and make decisions has been found to account for 57% of FTR events. Use case prioritization needs more transparency Support the inclusion of use cases that focus on the use of device- acquired semantic content Need engagement of front line clinicians who exchange information across care settings and experienced implementers

Interoperability Roadmap Section J. 3. (1 of 3) Develop and Pilot New Standards 14 J. 3. Develop and pilot new standards for priorities. Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Send ? Are the right stakeholders associated with critical actions? J SDOs will advance and accelerate semantic standards for lab orders, other orders… Orders are not included in the Common Data Set and standards for e-prescribing are being addressed ONC direct engagement in SDOs, including the Joint Initiative Council needs to be strengthened Consider standardizing orders later rather than sooner Priorities need to be revisited with all affected stakeholders J Research and clinical trial communities will pilot the use of the common clinical data set. It is not clear if there is a role for the Common Clinical Data Set in research. Need a way to extend the common data set. Consider pilots in high dollar/high value Long Term Care use cases. Stronger research and post surveillance engagement is needed. J SDOs will advance consumer-friendly terminologies. Consumer friendly terminologies can sometimes obscure the precision needed in diagnostic studies and reports related to interoperability. Reconsider the priority and timing consumer friendly terms

Interoperability Roadmap Section J. 3. (2 of 3) Develop and Pilot New Standards 15 J. 3. Develop and pilot new standards for priorities. Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Send ? Are the right stakeholders associated with critical actions? J Health IT developers and SDOs should advance systems in support of human- centered design, including the ability to provide information to individuals with varying levels of health literacy in their primary language. It is not clear how human- centered design is key to interoperability Move to later timeframe J Technology developers, providers and individuals will pilot data format and vocabulary standards and provide feedback to the SDOs. Semantic Web Standards should be considered (OWL and RDF) Missing reference to intensional vs. extensional model paradigm Missing reference to concept models in Semantic Standards (e.g. SNOMED CT)

Interoperability Roadmap Section J. 3. (3 of 3) Develop and Pilot New Standards 16 J. 3. Develop and pilot new standards for priorities. Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Send ? Are the right stakeholders associated with critical actions? J States and other stakeholders explore NIEM with regards to supporting health care and human services interoperability. The use case for NIEM outside of government information exchange is not clear. Missing coordination between NIEM and SDOs. Missing a focus on high priority use cases for Interoperability Not applicable J SDOs and industry will collaborate on best practices and provide guidance on the exchange of unstructured data such as a physician note Very important, especially for diagnostic reports. Electronic replacement of FAX Most immediate and urgent need to support direct patient care Professional societies and Consumer groups Send, receive, find, use common clinical data set Need to include access to clinical data Unstructured data Expand HIT and users LHS Need prioritized use cases for structured data

Interoperability Roadmap Section J. 4. Vocabulary Approach 17 J. 4. Vocabulary ApproachAre these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J Through coordinated governance, public and private stakeholders will work with SDOs to define a standard approach to federated distribution of centrally maintained code sets. Agree ONC needs stronger coordination with SDOs. Federated or Centrally maintained? We have a federated distribution of vocabularies through NCI/NLM/CDC for example Missing references to intensional vs. extensional modeling of value sets Missing attention to web standards Federated distribution works now Include distributors: NCI/NLM/CDC J Health IT developers will provide accurate translation and adapter services where needed in order to support priority LHS use cases (see Appendix H for Priority Interoperability Use Cases). Remove the word accurate and change it to say : HIT developers will enable code mapping and vocabulary look up services where needed Resolve ambiguity. Prioritize use cases and focus on “very high” priority use cases Translator and adaptor services should support device informatics No, it will take longer Yes

Interoperability Roadmap Section J. 5. Maintain and Improve Standards 18 J. 5. Maintain and Improve Standards Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Are the right stakeholders associated with critical actions? J. 5. SDOs will maintain and improve existing standards based on implementation feedback Feedback from implementers is critical and feedback loops are variable among SDOs. How will this be accomplished? Need opportunities for candidate standards to be implemented and generate lessons learned Seek lessons learned from experienced Implementers including CDISC Send, receive, find, use common clinical data set Need to include access to clinical data Focus on unstructured reports and prioritize diagnostic reports Expand HIT and users Prioritized subset for prioritized scenarios Achieve LHS Continue to work from prioritized list

Interoperability Roadmap Section J. 6. New Standards for New Requirements 19 J. 6. New Standards for New Requirements Are these the right actions? What gaps need to be addressed? Is the timing appropriate? Send ? Are the right stakeholders associated with critical actions? J Through coordinated governance, public and private stakeholders will advance the development and maintenance of data format and vocabulary standards and implementation guidance necessary to support priority learning health system use cases (see Appendix.) How will this be done? Is this describing actions that OC will take to coordinate stakeholders? Proposals become powerful when they are prioritized and resourced. Missing reference to content model of terminology standards Missing reference to the intensional and extensional modeling component. Depending on priorities and resources. SDOs, Professional Societies, Federal Agencies, Consumer Groups, Health Care Providers Institutions, and Vendors, Send, receive, find, use common clinical data set Focus on unstructured reports and prioritize diagnostic reports Expand HIT and users Prioritized subset for prioritized scenarios Achieve LHS Continue to work from prioritized list

Suggested Edits Page 85, J.4.2. Health IT developers will provide accurate translation and adapter services where needed – Change the term, “translation and adapter services,” to, “mapping and terminology services” Page 79, 2nd to last paragraph – Change sentence to “… (LOINC) for laboratory tests, vital signs and other observations,” in order to promote consistency with LOINC being indicated as such elsewhere. Pages 85, the phrase code sets appears to be used as a synonym for value sets, as currently be stored in the NLM VSAC. Recommend using the term value sets more consistently throughout the document 20