Semantic MediaWiki in Action: CTCAE Revision Project Traci St. Martin, Ann Setser and Lewis Frey Architecture/VCDE Face-to-Face Meeting Northwestern University,

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Introduction Lesson 1 Microsoft Office 2010 and the Internet
Consistent and standardized common model to support large-scale vocabulary use and adoption Robust, scalable, and common API to reduce variation in clinical.
Adverse Events: An Update
Common Terminology Criteria for Adverse Events (CTCAE) v.4: Updating a Cancer Research Standard Ann Setser 1, Ranjana Srivastava 2, Lawrence Wright 1,
LexGrid for cBIO Division of Biomedical Informatics Mayo Clinic Rochester, MN.
© Copyright 2008, Mayo Clinic College of Medicine Mayo Clinic Open Health Tools Application for Membership OHT Board Meeting, Birmingham, UK July 1, 2008.
LexWiki Framework & Use Cases SMW for Distributed Terminology Development Guoqian Jiang, PhD, Robert Freimuth, PhD, Haorld Solbrig Mayo Clinic NCI caBIG.
Copyright 2002 Prentice-Hall, Inc. Chapter 4 Automated Tools for Systems Development 4.1 Modern Systems Analysis and Design Third Edition.
Copyright 2002 Prentice-Hall, Inc. Chapter 4 Automated Tools for Systems Development 4.1 Modern Systems Analysis and Design Third Edition Jeffrey A. Hoffer.
Mayo LexWiki: A Prototype of Collaborative Platform for Terminology/Ontology Content Development Guoqian Jiang, Ph.D. Division of Biomedical Informatics,
IRS XML Standards & Tax Return Data Strategy For External Discussion June 30, 2010.
Overview of New Behind the Blackboard for Blackboard Customers APRIL 2012 TM.
User Group 2015 Version 5 Features & Infrastructure Enhancements.
OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
PREMIS Tools and Services Rebecca Guenther Network Development & MARC Standards Office, Library of Congress NDIIPP Partners Meeting July 21,
1 Proposed PLCS TC Organization and Functional Responsibilities Revision
OpenMDR: Alternative Methods for Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
OFC304 Excel 2003 Overview: XML Support Joseph Chirilov Program Manager.
CTEP, NCI Adverse Event Reporting Programmatic & Workflow Processes Prepared by: Ann Setser May 24, 2010.
LexEVS 6.0 Overview Scott Bauer Mayo Clinic Rochester, Minnesota February 2011.
Deliverable Readiness Review LexEVS 5.1 December 17, 2009.
LexEVS Overview Mayo Clinic Rochester, Minnesota June 2009.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Session 1 SESSION 1 Working with Dreamweaver 8.0.
1 Synchronize work on DEXs and reference data between PLCS pilots and OASIS/PLCS - Proposed PLCS TC Organization and Functional Responsibilities.
Alice Chen, MD, FACP Investigational Drug Branch, CTEP, DCTD National Cancer Institute CTCAE Version 4.
Workgroup Clinical Quality Measure Workgroup Jim Walker & Karen Kmetik, Co-Chairs May 7, :30 pm – 5:30 pm.
Evolving MARC 21 for the future Rebecca Guenther CCS Forum, ALA Annual July 10, 2009.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Reports and Learning Resources Module 5 1. SLMS Primary Administrator Training Module 5: Reports and Learning Resources 2.
Ad Hoc Graphical Reports Ad Hoc Graphical Reports Copyright © Team #4 CSCI 6838 Spring CSCI Research Project and Seminar Team# 4 (
CaDSR Software Users Meeting 3.1 Requirements Review 9/19/2005 caDSR Software Team Host: Denise Warzel NCICB, Assistant Director, caDSR.
A Short Tutorial to Semantic Media Wiki (SMW) [[date:: July 21, 2009 ]] At [[part of:: Web Science Summer Research Week ]] By [[has speaker:: Jie Bao ]]
LexEVS Semantic Tooling Advancements Kevin Peterson Mayo Clinic Mayo 2009.
SKOS. Ontologies Metadata –Resources marked-up with descriptions of their content. No good unless everyone speaks the same language; Terminologies –Provide.
Dr. Sebastian Garde Ocean Informatics Medinfo 2013 Copenhagen, Copyright 2012 Ocean Informatics.
A LexWiki-based Representation and Harmonization Framework for caDSR Common Data Elements Guoqian Jiang, Ph.D. Robert Freimuth, Ph.D. Harold Solbrig Mayo.
- EVS Overview - Biomedical Terminology and Ontology Resources Frank Hartel, Ph.D. Director, Enterprise Vocabulary Services NCI Center for Bioinformatics.
Copyright 2002 Prentice-Hall, Inc. Chapter 4 Automated Tools for Systems Development 4.1 Modern Systems Analysis and Design.
Chapter 4 Automated Tools for Systems Development Modern Systems Analysis and Design Third Edition 4.1.
May 2007 Registration Status Small Group Meeting 1: August 24, 2009.
3 Copyright © 2010, Oracle. All rights reserved. Product Data Hub: PIM Functional Training Program Setup Workbench Fundamentals.
1 Open Ontology Repository initiative - Planning Meeting - Thu Co-conveners: PeterYim, LeoObrst & MikeDean ref.:
Lessons learned from Semantic Wiki Jie Bao and Li Ding June 19, 2008.
Collection Management Systems
EcoInformatics Initiative 04/18/2007 Terminology and the Semantic MediaWikiEcoterm IV – Vienna 17 – 18 April 2007 Terminology Curation with the Semantic.
Sherri de Coronado Enterprise Vocabulary Services NCI Center for Bioinformatics and Information Technology March 11, 2009 A Terminology.
Supporting Collaborative Ontology Development in Protégé International Semantic Web Conference 2008 Tania Tudorache, Natalya F. Noy, Mark A. Musen Stanford.
Copyright © 2007, Oracle. All rights reserved. Managing Items and Item Catalogs.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
NCI Clinical Trials Reporting Program CTRP User Meeting May 4, 2011.
Semantic Media Wiki Open Terminology Development - Initial Steps - Frank Hartel, Ph.D. Associate Director, Enterprise Vocabulary Services National Cancer.
LexWiki Framework & Use Cases SMW for Distributed Terminology Development Guoqian Jiang, PhD, Harold Solbrig Mayo Clinic Meeting with Dr. Jakob (WHO) May.
Accurate  Consistent  Compliant Contact: i4i the structured content company the structured content company.
CTCAE v3.0 Revision Project Working Group Information for Getting Started Prepared by: Ann Setser, BSN, MEd NCI Center for Bioinformatics July 11, 2008.
VICH Training Strategy Steven D. Vaughn, DVM Director, Office of New Animal Drug Evaluation, Center for Veterinary Medicine U.S. Food and Drug Administration.
© CDISC 2015 Paul Houston CDISC Europe Foundation Head of European Operations 1 CTR 2 Protocol Representation Implementation Model Clinical Trial Registration.
National Cancer Institute caDSR Briefing for Small Scale Harmonication Project Denise Warzel Associate Director, Core Infrastructure caCORE Product Line.
BiomedGT Wiki support for CTCAE update/ Creating a pre-coordinated OWL file Sherri de Coronado NCI CBIIT/ EVS May 1, 2009.
UNIFIED MEDICAL LANGUAGE SYSTEMS (UMLS)
Modern Systems Analysis and Design Third Edition
The Information Professional’s Role in Product Safety
Midwest Biopharmaceutical Statistics Workshop
Modern Systems Analysis and Design Third Edition
IDN Variant TLDs Program Update
Chapter 4 Automated Tools for Systems Development
Modern Systems Analysis and Design Third Edition
Modern Systems Analysis and Design Third Edition
Modern Systems Analysis and Design Third Edition
Presentation transcript:

Semantic MediaWiki in Action: CTCAE Revision Project Traci St. Martin, Ann Setser and Lewis Frey Architecture/VCDE Face-to-Face Meeting Northwestern University, Evanston, IL Oct. 28 th, 2008

Agenda Introduction to Semantic MediaWiki (2 min)-Traci St. Martin Use of Semantic MediaWiki: CTCAE Revision Project (20 min) Background of CTCAE Revision Project-Ann Setser CTCAE Community Requests for Additional Functionality-Traci St. Martin VCDE Input into CTCAE Revision Project-Lewis Frey Lessons Learned from CTCAE Revision Project-All (5 min)

Introduction to Semantic MediaWiki Semantic MediaWiki (SMW) utilized for BiomedGT The Biomedical Grid Terminology is an open, collaboratively developed terminology system for translational research, initially based on NCI Thesaurus Goal: Evolve BiomedGT into a set of sub-terminologies that can be: Federated Collaboratively developed Maintained by experts in relevant research communities Integrated, where appropriate With re-use and integration of existing high quality terminologies Additional tools: Protégé OWL Collaborative Protégé LexGrid/LexBIG

Why SMW? Traditional approach using NCI Thesaurus didn’t scale Desire to move to federated terminology development Include external groups for wider amount of expertise Create better acceptance and maintenance of ontologies The infrastructure and culture of the semantic wiki is a promising workbench for collaborative ontology engineering. Easy to learn tool Open content development platform Change history management Formal output rendering (RDF export) With some extensions, the SMW can be useful for publishing, annotating and cross-referencing other terminological resources SMW offers: Browsing support (hierarchical view, data elements, etc.) Authoring support (workflow for proposals, etc.) Ability to load multiple terminologies

BiomedGT Wiki: Current & Future Current Projects within BiomedGT Wiki Environment BiomedGT Nanotechnology terminology Pathology related terminology updating and expansion (interested) CTCAE4 Revision project Enhancements via collaboration between NCI and Mayo Clinic for BiomedGT Wiki Enabling Wiki features Mayo developed for ICD11 Adding additional namespaces (RadLex, etc.) Supporting BiomedGT development Maintaining and developing Wiki for CTCAE Revision project

Agenda Introduction to Semantic MediaWiki (2 min)-Traci St. Martin Use of Semantic MediaWiki: CTCAE Revision Project (20 min) Background of CTCAE Revision Project-Ann Setser CTCAE Community Requests for additional functionality-Traci St. Martin VCDE Input into CTCAE Revision Project-Lewis Frey Lessons Learned from CTCAE Revision Project-All (5 min)

CTCAE Background The Cancer Therapy Evaluation Program (CTEP) of the NCI developed the original Common Toxicity Criteria (CTC) in 1983 to aid in the documentation and analysis of adverse effects of chemotherapy. The CTC is a list of Adverse Event (AE) terms commonly encountered in oncology accompanied by a grading (severity) scale for each AE. 1983CTC v1 ~ 50 terms 1998CTC v2 ~ 300 terms 2003 CTCAE v3 ~ 1000 terms 2008Draft 1 ~ 820 terms – MedDRA terms

Medical Dictionary for Regulatory Activities – MedDRA Is a clinically validated international medical terminology used by regulatory authorities and the regulated biopharmaceutical industry throughout the entire regulatory process, from pre- marketing to post-marketing activities, and for data entry, retrieval, evaluation, and presentation.medical terminology Is the adverse event classification dictionary endorsed by the International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH).adverse event International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use Is used in the US, European Union, and Japan. Its use is currently mandated in Europe and Japan for safety reporting.USEuropean UnionJapan

MedDRA Structure System, Organ, ClassSOCHighest level of the terminology, and distinguished by anatomical or physiological system, etiology, or purpose 26 High Level Group TermHLGTSubordinate to SOC, supraordinate descriptor for one or more HLTs 332 High Level TermHLTSubordinate to HLGT, superaordinate descriptor for one or more PTs 1,688 Preferred TermPTRepresents a single medical concept18,075 Lowest Level TermLLTLowest level of the terminology, related to a single PT as a synonym, lexical variant, or quasi-synonym (Note: All PTs have an identical LLT) 66,135 MedDRA translations CzechDutchEnglish DutchFrenchGerman EnglishItalianJapanese PortugueseSpanish MedDRA includes Standardised MedDRA Queries (SMQs) -groupings of terms that relate to a defined medical condition or area of interest.

CTCAE v3.0 & MedDRA Use CTCAE & MedDRA MedDRA is used by the biopharmaceutical industry and regulatory agencies within the ICH regions CTCAE use by Industry CTCAE is widely used in oncology and HIV clinical research 11 MedDRA List of terms >86,000 Content: Comprehensive --- Hierarchy: 5 levels Medically validated CTCAE v3.0 List of terms 1,059 Content: Oncology Severity Scale Hierarchy: 2 levels ---

CTCAE v3.0 Issues & MedDRA Oncology community reported concerns/challenges using CTCAE vs/and MedDRA 2006MedDRA MSSO International Meeting CTEP, NCI & FDA discussions 2007caBIG VCDE Review of CTCAE CTCAE – MedDRA mapping imprecise CTCAE terms too general – loss of granularity Critical concepts in Grades Lack of CTCAE maintenance Recommendations To facilitate data exchange within internal databases using MedDRA and with regulatory authorities for the purpose of SAE reporting, must establish a mechanism to ‘translate’ or ‘convert’ CTCAE terms from investigators to MedDRA terms.

Rationale for CTCAE v3.0 Revision CTCAE v3.0 Terms Multiple concepts One/many element of Grade description is critical AE concept Not all MedDRA terms CTCAE v3.0 Revision Goals Harmonize with MedDRA 100% MedDRA single concepts Revise and extend AE terms and severity indicators to be machine interpretable; conformance with caBIG Vocabulary Standards Establish a formal, ongoing governance for future versions Understandability, Reproducibility, Usability

CTCAE v3.0 Multiple Concepts in one AE Term 14 Mapped to MedDRA: Fatigue CTCAE v4.0/MedDRA –Fatigue –Asthenia –Lethargy –Malaise

MedDRA Preferred Term Fatigue + 20 LLTs

16 CTCAE v3.0 Revision Critical concept listed in Grade only – not as AE Term CTCAE v4.0/MedDRA –Allergic reaction –Anaphylaxis

CTCAE Governance Group FDA,CBIIT,CTEP, PhRMA Steering committee CBIIT, CTEP,VCDE, WG Leads CTCAE v3.0 Revision Project Semantic Media Wiki CTCAE Editing/modeling Establish long term governance of CTCAE Develop the strategic vision of CTCAE Drive the development of CTCAE Defines work; prioritizes and schedules the content Review/ Comments CTCAE Version 4.0 Internal review WG CTCAE draft version

Working Groups / SOCs

CTCAE v3.0 Revision Project Methods – Wiki

Agenda Introduction to Semantic MediaWiki (2 min)-Traci St. Martin Use of Semantic MediaWiki: CTCAE Revision Project (20 min) Background of CTCAE Revision Project-Ann Setser CTCAE Community Requests for additional functionality-Traci St. Martin VCDE Input into CTCAE Revision Project-Lewis Frey Lessons Learned from CTCAE Revision Project-All (5 min)

CTCAE Iteration 1 Publishing CTCAE v3.0: CTCAE v3.0 existed as an Excel spreadsheet. Created a tool to map the spreadsheet to LexGrid model Once in the model, the tool generated XML in LexGrid format This XML was loaded into LexGrid database using LexBig API Used existing LexWiki tab plug-in to Protégé to get the LexGrid contents to load into Protégé database and publish to Wiki CTCAE3 spreadsheet Map to LexGrid model XML Generated XML loaded to LexGrid DB Publish to Wiki LexGrid to Protégé DB Protégé Plug-in

CTCAE Iteration 1

Utilized additional SMW extensions, created new Semantic Forms, and created new Templates specifically for CTCAE.

CTCAE Iteration 1 Functionality Initial requirement - to display the data in a tabular format. Utilized Dynamic Page List extension to dynamically show all the Adverse Event terms of a Category in a table. Query looks for all pages in a Category and displays them in a table. The Adverse Event (AE) name displays as a link instead of the URL

CTCAE Iteration 1 Functionality Initial requirement continued: Created templates to display original content and proposal in a tabular format.

CTCAE Iteration 1 Functionality Using features of Semantic Forms, created a proposal mechanism with a drop down menu for users to select Proposal status of Edit, Split or New Term.

CTCAE Iteration 1 Functionality Utilized Header tabs extension in SMW to easily toggle between the Tabular format and the Factbox.

CTCAE Iteration 1: Processing proposals Created mappings based on rules for Edit, New, and Split Term status. Used RDF feed to read the proposals and render to LexGrid model. Used RDF feed and created a script to generate spreadsheets for Ann to review proposals, MedDRA review and reporting to Steering Committee. Published to Wiki using same initial process. Published to a new CTCAE SOC Draft 1 namespace for 2 nd Iteration of CTCAE revisions. Enabled referencing CTCAE 3 proposals.

CTCAE Iteration 1: Usability enhancements Based on user difficulties with standard Talk/Discussion page, utilized Article comments to change to a more user-friendly format. Old formatNew format

CTCAE Iteration 1: Usability enhancements Users experienced difficulties with using the Edit tab instead of creating a proposal. PHP code modified to hide the Edit tab for non-Sysop users. Edit tab hidden

CTCAE Iteration 2: Changes Iteration 2 organizes data by SOC instead of Category Established mapping between Category, Adverse Event term, and SOC. Allowed publishing by SOC but maintains Category information in database.

CTCAE Iteration 2: Changes Created a new Header tab and link back to CTCAE 3.0 Adverse Event term and Proposal (from which the CTCAE Draft term originated). Link opens in a new tab or window CTCAE Category (v3) is ‘locked’(via a change to the CTCAE form). Users cannot edit 1 st iteration proposals.

CTCAE Iteration 2: Changes Modified Status Allowed for separate status for Adverse Event & Grades Created new options: No Change, New, Edit, Delete

CTCAE Iteration 2: Additional Enhancement Customized Auto-complete feature Use Ctrl-Space or enable in My Preferences Easier to find specific article (AE term)

Agenda Introduction to Semantic MediaWiki (2 min)-Traci St. Martin Use of Semantic MediaWiki: CTCAE Revision Project (20 min) Background of CTCAE Revision Project-Ann Setser CTCAE Community Requests for additional functionality-Traci St. Martin Demonstration of Media Wiki-Traci St. Martin VCDE Input into CTCAE Revision Project-Lewis Frey Lessons Learned from CTCAE Revision Project-All (5 min)

CTCAE VCDE Subgroup Scope Propose governance and structure for the CTCAE caBIG terminology. Proposals that are designed to help CTCAE pass the VCDE vocabulary review for terminologies that support value domains within the caBIG infrastructure Support CTEP’s need for multiple formats of CTCAE such as Excel and PDF as well as a paper version of the terminology support for use in clinical settings consistent with the way it is currently used Subgroup: Salvatore Mungal, Mike Riben, Stuart Turner, Lewis Frey & Larry Wright

CTCAE V3.0 PDF Format

Agenda Introduction to Semantic MediaWiki (2 min)-Traci St. Martin Use of Semantic MediaWiki: CTCAE Revision Project (20 min) Background of CTCAE Revision Project-Ann Setser CTCAE Community Requests for additional functionality-Traci St. martin Demonstration of Media Wiki-Traci St. Martin VCDE Input into CTCAE Revision Project-Lewis Frey Lessons Learned from CTCAE Revision Project-All (5 min)

Lessons Learned Overall – good learning experience, great user community leadership! Modified Development process important for quicker deployments to react to user needs Stage is “Production” Developed build script to make deployments easier Quick response important for new users Encountered slowness due to maintenance by infrastructure team Maintenance schedule modified to accommodate user availability needs Workflow Fully understanding workflow early on is important for determining features needed for users and for processing proposals Workflow functionality not developed for CTCAE which necessitated developing scripts to generate spreadsheets for reviewing data

Lessons Learned Requirements defined before NCI clinical team understood Wiki ‘Maintain paper format’ Reluctant users – clinicians Performance – very slow at times Data in – nothing out No summary data No analysis of complete vs. to-do Data quality poor Misspellings; Upper / lower case errors Non-MedDRA terms Abbreviations Inconsistent use of indicators – Edit, Split, New Identified need for additional indicator – Delete Lack of ‘checks’ associated with indicators

Next Phase of Wiki Work Training for WG members Well-defined instructions Strive for consistent use of indicators – Edit, Delete, New Accurate data entry (spelling, case, no abbreviations, etc.) New terms must be pre-approved with MedDRA Performance – ? Data in – Wiki team working on provision for summary/report data