Lifelines2: Hypothesis Generation in Multiple EHRs Taowei David Wang Catherine Plaisant Ben Shneiderman Shawn Murphy Mark Smith Human-Computer Interaction.

Slides:

Advertisements

Similar presentations

Agent-Based Architecture for Intelligence and Collaboration in Virtual Learning Environments Punyanuch Borwarnginn 5 August 2013.

Advertisements

Reeder et al. Perceived usefulness of a distributed community-based syndromic surveillance system: a pilot qualitative evaluation study. BMC Research Notes.

1 Evaluation Rong Jin. 2 Evaluation  Evaluation is key to building effective and efficient search engines usually carried out in controlled experiments.

Clinical research and the electronic medical record: Interdisciplinary research agendas Michael G. Kahn MD, PhD Biomedical Informatics Core Director Colorado.

Workshop: Interactive Visual Exploration of Electronic Health Records David Wang, Catherine Plaisant, Ben Shneiderman University of Maryland College Park,

Prof. Carolina Ruiz Computer Science Department Bioinformatics and Computational Biology Program WPI WELCOME TO BCB4003/CS4803 BCB503/CS583 BIOLOGICAL.

Information Retrieval: Human-Computer Interfaces and Information Access Process.

LifeLines: Visualizing Personal Histories Catherine Plaisant, Brett Milash, Anne Rose, Seth Widoff, Ben Shneiderman.

Visualizing Temporal Patterns also including… Twinlist for Medication Reconciliation Catherine Plaisant Human-Computer Interaction Lab University Of Maryland,

Small Displays Nicole Arksey Information Visualization December 5, 2005 My new kitty, Erwin.

Time Series visualizations Information Visualization – CPSC 533c Lior Berry March 10 th 2004.

Lifelines: Visualizing Personal Histories Class overview Jen Golbeck 04 Feb 02.

IVITA Workshop Summary Session 1: interactive text analytics (Session chair: Professor Huamin Qu) a) HARVEST: An Intelligent Visual Analytic Tool for the.

Information Visualization in Medical Informatics Ben Founding Director ( ), Human-Computer Interaction Lab.

Interactive Pattern Search in Time Series (Using TimeSearcher 2) Paolo Buono, Aleks Aris, Catherine Plaisant, Amir Khella, and Ben Shneiderman Proceedings,

Patternfinder 3.0 : Sparse Temporal Data Visual Query Application Hyunyoung Song, Nathaniel Ayewah, Gleneesha Johnson Department of Computer Science, University.

A Visual Interface for Multivariate Temporal Data: Finding Patterns of Events across Multiple Histories Jerry Alan Fails, Amy Karlson, Layla Shahamat &

1 User Centered Design and Evaluation. 2 Overview Why involve users at all? What is a user-centered approach? Evaluation strategies Examples from “Snap-Together.

Live Re-orderable Accordion Drawing (LiveRAC) Peter McLachlan, Tamara Munzner Eleftherios Koutsofios, Stephen North AT&T Research Symposium August, 2007.

Webinar: Publishing for the EHR 101 James J. Cimino Chief, Laboratory for Informatics Development National Institutes of Health Clinical Center May 20,

Information Retrieval: Human-Computer Interfaces and Information Access Process.

1 User Centered Design and Evaluation. 2 Overview My evaluation experience Why involve users at all? What is a user-centered approach? Evaluation strategies.

Mrs. LeBlanc Even Einstein asked Questions! So… ASK AWAY!!!

TimeCleanser: A Visual Analytics Approach for Data Cleansing of Time-Oriented Data Theresia Gschwandtner, Wolfgang Aigner, Silvia Miksch, Johannes Gärtner,

From Controlled to Natural Settings

FINDING PATTERNS IN TEMPORAL DATA KRIST WONGSUPHASAWAT TAOWEI DAVID WANG CATHERINE PLAISANT BEN SHNEIDERMAN HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF.

MEDLINEplus: Your Gateway to Consumer Health Information on the Web.

ETIM-1 CSE 5810 CSE5810: Intro to Biomedical Informatics Mobile Computing to Impact Patient Health and Data Exchange and Statistical Analysis Presenter:

Oncosifter: A Customized Approach to Cancer Information Authors : Ketan Mane & Sidharth Thakur Presenter: Yueyu Fu.

Health Information Technology Costs and Benefits What does the current literature address? Melinda Beeuwkes Buntin, Ph.D. (presenting) Matthew Burke August.

Joy Hamerman Matsumoto.  St Jude Medical Cardiac Rhythm Management Division manufactures implantable cardiac devices ◦ Pacemakers ◦ Implanted defibrillators.

JumpStart the Regulatory Review: Applying the Right Tools at the Right Time to the Right Audience Lilliam Rosario, Ph.D. Director Office of Computational.

IDR Snapshot: Quantitative Assessment Methodology Evaluating Size and Comprehensiveness of an Integrated Data Repository Vojtech Huser, MD, PhD a James.

1 Lecture 20: Non-experimental studies of interventions Describe the levels of evaluation (structure, process, outcome) and give examples of measures of.

Sina Keshavaarz M.D Public Health &Preventive Medicine Measuring level of performance & sustaining improvement.

SALUS - Scalable, Standard based Interoperability Framework for Sustainable Proactive Post Market Safety Studies A short overview May 2015 A. Anil SINACI.

1 Adapting the TileBar Interface for Visualizing Resource Usage Session 602 Adapting the TileBar Interface for Visualizing Resource Usage Session 602 Larry.

© 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of Designing the User Interface: Strategies for Effective Human-Computer.

1 EviCare (NLP) Aid clinical work in hospitals using NLP: “Summarize” health records Select and rank recommendations from clinical practice guidelines.

BlueMedics Evidence-based Patient Empowerment. Challenges Integration of clinical data –Horizontal - Sources –Vertical – Data Dynamic incorporation of.

Enhancing Timely Management of Workflow with Interactive Visual Displays & Actions for Situation Awareness Processing Sureyya Tarkan UMD Dept. of Computer.

Copyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. McGraw-Hill Chapter 7 Introduction to Practice Partner Electronic Health Records.

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential. Mahalia.

Designing Decision Aids to Help Patients Choose Treatment Options Lyndsey Franklin, Catherine Plaisant, Ben Shneiderman HCIL.

Krist Wongsuphasawat John Alexis Guerra Gomez Catherine Plaisant Taowei David Wang Ben Shneiderman Meirav Taieb-Maimon Presented by Ren Bauer.

P AIR F INDER : I DENTIFYING AND M EASURING T EMPORAL A SSOCIATIONS FROM T EMPORAL E VENT S EQUENCES Hsueh-Chien Cheng, Catherine Plaisant, Ben Shneiderman.

Medical Informatics: Opportunities for Improving Patient Care Ben Founding Director ( ), Human-Computer Interaction.

Interactive Visualizations for Biodiversity Information Bongshin Lee Researcher Visualization and Interaction Research Group Microsoft Research Bongshin.

WebFOCUS Magnify: Search Based Applications Dr. Rado Kotorov Technical Director of Strategic Product Management.

Awalin Sopan, Catherine Plaisant, Seth Powsner, Ben Shneiderman Human-Computer Interaction Lab & Department of Computer Science, University of Maryland.

Sept 13-15, 2004IHE Interoperability Workshop 1 Integrating the Healthcare Enterprise Access to Radiology Information Cor Loef Co-chair IHE Radiology Technical.

© 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of Designing the User Interface: Strategies for Effective Human-Computer.

SAGE Nick Beard Vice President, IDX Systems Corp..

Uses of the NIH Collaboratory Distributed Research Network Jeffrey Brown, PhD for the DRN Team Harvard Pilgrim Health Care Institute and Harvard Medical.

N VISUAL ANALYTICS FOR HEALTHCARE: BIG DATA, BIG DECISIONS David Gotz Healthcare Analytics Research Group IBM T.J. Watson Research Center.

NPCR – Advancing E-cancer Reporting and Registry Operations (NPCR-AERRO): An Update on Innovative Activities NAACCR Annual Conference June 16, 2009 Sandy.

E- Patient Medical History System

Ben Shneiderman & Catherine Plaisant

Medical Record as a Semantic Graph

Efficient Remediation of Terms Inactivated by Dictionary Updates

Catherine Plaisant with Tiffany Chao, Ran Liu, Ben Shneiderman

Temporal Data Analysis and Electronic Health Records Ben Shneiderman, Catherine Plaisant, Taowei David Wang, Kris Wongsuphasawat

Stanley Lam Department of Computer Science University of Maryland

From Controlled to Natural Settings

Presenter : Wayne Chen 陳旭瑋

Medical Students Documenting in the EMR

Summary of Domain Specific Needs of Context

CHAPTER 14: Information Visualization

Regulatory Perspective of the Use of EHRs in RCTs

Registered Nurse’s Use of HIT, 2006: Findings from a National Survey

Presentation transcript:

Lifelines2: Hypothesis Generation in Multiple EHRs Taowei David Wang Catherine Plaisant Ben Shneiderman Shawn Murphy Mark Smith Human-Computer Interaction Lab, University of Maryland

LifeLines: Overview of Patient Record Plaisant et al.,CHI96 AMIA98 -

Single record  Millions of records Large databases of Electronic Health Records (EHRs): Observational studies Recruitment for clinical trials Hospital metrics Alarm design and testing etc. Often involves temporal comparison relative to an important event (e.g. heart attack, start of a treatment, 1 st diagnosis of cancer)

multiple patients Lifelines2 Sets of patient records Disclaimer: de-identified data

Lifelines2 Introduce powerful combination of simple operators Align, Rank, Filter, and Summarize Multiple records simultaneously visible Align by sentinel events Rank by frequency Filter by events Summaries Focus on Point Events Diagnosis, lab tests, etc. Measure Benefits of Alignment

Sample of Related Work Demo (Quick) Report on Studies Ongoing & Future Work

Static views Powsner & Tufte, 1994 Lexis diagrams (Bertin)

Lifelines and improvements Overview of categorical and/or numerical data (semantic zoom) Plaisant, CHI 96, AMIA 98

Lifelines and improvements Overview of categorical and/or numerical data (semantic zoom) Plaisant, CHI 96, AMIA 98 i2b2 (Murphy, AMIA 07)

Lifelines and improvements Overview of categorical and/or numerical data (semantic zoom) Plaisant, CHI 96, AMIA 98 i2b2 (Murphy, AMIA 07) Bade, CHI 2004

ExperiScope (Guimbretiere, CHI 07) Spiral Graph: Weber, 01 (based on Carlis, UIST 89) Periodic data One of many example of manual alignment Alignment Inspirations

Patients with increasing dosages of Remeron followed by a heart attack within 180 days Ball and chain display of matches Fails, VAST 06 PatternFinder Specification of complex temporal queries on categorical data

Sample of Related Work Demo LifeLines2 Report on Studies Ongoing & Future Work

Demo

multiple patients User Studies

Two user studies Controlled experiment on Alignment (some training, measure speed and error) Domain expert qualitative study (no training, think aloud, discussion)

Two user studies Controlled experiment (some training, measure speed and error) Benefit of alignment: YES (Significant improvement on complex tasks) 20 participants: grad students Data: synthetic student record data Tasks checked as domain independent Domain expert qualitative study (no training, think aloud, discussion) Details

Two user studies Controlled experiment (some training, measure speed and error) Benefit of alignment: YES (Significant improvement on complex tasks) 20 participants: grad students Data: synthetic student record data Tasks checked as domain independent Domain expert qualitative study (no training, think aloud, discussion) Learnability: GOOD General feedback and suggestions Suggestions 4 participants: nurse, physician, 2 prof. of nursing All experienced with EHR and medical research

Context Search millions of records Interactive visualization of results LifeLines2

Combine Alignment with PatternFinder Washington Hospital Center

Integrate Align-Rank-Filter in i2b2 Harvard Medical School, Partners HealthCare

In summary… Align Rank, Filter, and Summarize Powerful combination of simple operations to explore temporal categorical data (events) Performance benefit of alignment: significant Impact : Deployment in 2 large operational EHR systems Many applicable domains : Highway incident log Student records Web logs Vehicle fleet records

Thank you!

Quant. Evaluation Sample Data Back to Evaluations

Quantitative Evaluation Tasks Task 1: How many students submitted a paper within 1 month after proposal? (5 records) Task 2: How many students submitted a paper within 1 month after proposal? (20 records) Task 3: How many students submitted at least 3 papers between proposal and defense? Task 4: What occurred most often within a month of a student’s 1 st paper submission? Back to Evaluations

(Alignment vs. No Alignment) back RM 1-way ANOVA Counter-balanced Very helpful (8.3)

TimeSearcher Dynamic queries on numerical temporal data Hochheiser Infovis04 Buono VDA05

Specification of temporal abstractions To reason/query with them Shahar 1999 Post 2007 No focus on interaction