9/10/2018 Largest US Healthcare Dataset in Hadoop enables Patient-level Analytics in Near Real Time September 28, 2016 Navdeep Alam Director of Data.

Slides:



Advertisements
Similar presentations
Big Data and Predictive Analytics in Health Care Presented by: Mehadi Sayed President and CEO, Clinisys EMR Inc.
Advertisements

FAST FORWARD WITH MICROSOFT BIG DATA Vinoo Srinivas M Solutions Specialist Windows Azure (Hadoop, HPC, Media)
Truven Health Analytics State Exchanges - Data Collection & Analysis April 2014.
1 Data-driven Approaches to Augment Clinical Decision in EMR Era Health Data Initiative Forum III The Health Datapalooza Ketan Mane Renaissance Computing.
Observation Pattern Theory Hypothesis What will happen? How can we make it happen? Predictive Analytics Prescriptive Analytics What happened? Why.
July 3, 2015 New HIE Capabilities Enable Breakthroughs In Connected And Coordinated Care Delivery. January 8, 2015 Charissa Fotinos.
Summary of “New Ways to Exploit Raw Data May Bring Surge of Innovation, a Study Says” Steve Lohr, New York Times, May 13th, 2011 Presented by: Zhe Jiang.
1 © 2012 Oracle Corporation – Proprietary and Confidential Big Data Challenge – From EMR’s to Translational Research Miroslav Končar, PhD Oracle Healthcare.
Technology Council of Maryland Health IT Forum “Big Data” and the Real World.
© 2011 IBM Corporation Smarter Software for a Smarter Planet The Capabilities of IBM Software Borislav Borissov SWG Manager, IBM.
“Put the Power of Predictive Analytics in the Hands of Clinical Researchers” Filippos Katsampouris Marketing Manager Healthcare & Pharmaceutical Accounts.
Pharmaceutical Epistemology Jim Golden, Ph.D. Global Lead, Healthcare Data Analytics Accenture
Privacy and Security Workgroup: Big Data Public Hearing November 10, 2014 Deven McGraw, chair Stan Crosley, co-chair.
Building a Roadmap for Research IT John Brussolo Research IT Program Director September 6, 2012 © 2012 The Regents of the University of Michigan.
© 2009 IBM Corporation Let’s build a smarter planet: Healthcare 0 Smart healthcare: Achieve better quality and outcomes. SMART IS Establishing a strategic.
5 th Annual International Business Research Forum Globalization of the Pharmaceutical Industry Implications to Information Technology Bruce Fadem March.
Joseph C. Kvedar Director, Telemedicine Partners HealthCare Systems March 9, 2006.
Big Data – Big Opportunity Mohammad Khansari ITRC President Jan 2015 ITRC, Tehran, Iran.
Data Complexity in Healthcare The Coming Challenge Ella Mihov, Director, Healthcare Team.
Big Data Analytics with Excel Peter Myers Bitwise Solutions.
1 © Cloudera, Inc. All rights reserved. Alexander Bibighaus| Director of Engineering The Future of Data Management with Hadoop and the Enterprise Data.
Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.
Connecting the Healthcare Ecosystem Evolving the Infrastructure 2013 Comcast and Juniper Networks:
Big Data Javad Azimi May First of All… Sorry about the language  Feel free to ask any question Please share similar experiences.
Big Data BEGIN WITH THE END IN MIND Personalized medicine Disease prediction Uber-esque city services Smart homes, cars, appliances Revolutionize education.
@nmoneypenny Innovating New Products & Services with Enterprise Social Graphing: Naomi Moneypenny.
1 Cloud-Native Data Warehousing Bob Muglia. 2 Scenarios with affinity for cloud Gartner 2016 Predictions: By 2018, six billion connected things will be.
Big Data & Test Automation
OMOP CDM on Hadoop Reference Architecture
Fostering Workforce Partnerships
4/18/2018 6:56 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
MIS2502: Data Analytics Advanced Analytics - Introduction
Business Critical Application Platform
BIG DATA IN ENGINEERING APPLICATIONS
Accelerate Business Outcomes from Your Real World Evidence Initiatives with Saama and Microsoft Azure MICROSOFT AZURE APP BUILDER PROFILE: SAAMA TECHNOLOGIES.
Kate McCarthy, Senior Analyst
Social Media & Healthcare
Organization Mercy Headquarters Saint Louis, Missouri Industry
CIOs, IT, and Digital Transformation
The existential FMCG challenge: We are all in this together
Joseph C. Kvedar Director, Telemedicine Partners HealthCare Systems
Unit 5 Systems Integration and Interoperability
Data Quality: Practice, Technologies and Implications
KloudData and Delmock Technologies
Business Critical Application Platform
Powering real-time analytics on Xfinity using Kudu
Leveraging Payer Data to Jumpstart RHIOs
Finland, a Global Testbed for Personalized Cancer Research?
September 11, Ian R Brooks Ph.D.
Visual Analytics Sandbox
Tackling the U.S. opioid crisis using blockchain
Empowering Population Health
Big Data - in Performance Engineering
Big Data Young Lee BUS 550.
America’s Health Insurance Plans
From Data to Actionable Insights- When it matters!
Improve Patient Experience with Saama and Microsoft Azure
The future of Health Care, the Digitisation of the Medtech Industry and Regulatory Update Mark Steedman, PhD 4th December 2018.
Health IT Panel Discussion John McCandlish, Director–CGI National Healthcare Team 7/29/14 Updated March 2014.
State of the pharmacy market
Industrial Products Business challenge
Big DATA.
Strategy of big data Submitted by: Lehar Karthik Student ID:
Analytics, BI & Data Integration
The Role of Data and Analytics in the Healthcare Ecosystem
Using clinical trial data as real-world evidence
Moving from Health Care to Life Care
President and Chief Executive Officer
How Can Healthcare Analytics Drive Profits In Your Business?
How Is Precision Medicine Transforming The Health Care Industry?
Presentation transcript:

9/10/2018 Largest US Healthcare Dataset in Hadoop enables Patient-level Analytics in Near Real Time September 28, 2016 Navdeep Alam Director of Data Warehousing nalam@us.imshealth.com

Agenda Who is IMS Health Health care data ecosystem at IMS Opportunity and Challenges: Make a Greater Difference in Patient Healthcare Solution – Anonymous Patient Longitudinal Analysis Lessons Learned

Who is IMS Health? Market Healthcare Information, Technology and Services Solutions Deliver unique insights into diseases, treatments, costs and outcomes Experience Founded 1954, Operation 100+ Countries, 15,000 Employees, 55+ Billion Health Transactions Annually # of Customers 5000+ clients

Health Care Data Ecosystem IMS Health – Where Does Our Data Come From

Future Data Growth is Exponential Social Media, IOT, Genomics Billions More Transactions Billions of Anonymous Patients

Make a Greater Difference in Patient Healthcare Precision Medicine, Better Outcomes, Propel Research towards Cures Longitudinal Studies Find Patterns Across All Patients Predict and Influence Outcomes Help Reduce Healthcare Costs Clinical Trials and Drug Research Improvements Improve Provider Care

Challenges Obstacles to Realizing the Greater Opportunity Data Silos Reduced Data Currency Analytics Away from the Data Analytics Too Time Consuming and Expensive Cost High on Current Systems

Solution - Patient Longitudinal Records Organized for Fast Access and Reduced Data Shuffle Traditional Warehoused Data Rx n  Big Data Factory Dx t  Patient Longitudinal Records n t  EMR r  New Source Type  n Each color = Unique de-identified patient ID. Each shape = A type of patient data. Filled shapes = Data of interest Complex Nested Data Type

Solution - Different Storage Engines Storage to Match the Access Pattern Aggregates/Counts Web Speed (ms) Faceted Search Solr Complex Nested Type Patient Longitudinal Records n t  Web Applications Fast lookup of longitudinal Entity (i.e. Patient) HBase HUE RDBMS ETL Process Rest Deep Learning Analytics Longer Running Queries (min vs. days) Hive Nested Bucketed JDBC/SQL ETL Process Hive Partitioned BI/DW Workloads SQL

Hadoop Storage Engines Parquet/Hive vs. HBase vs. Kudu

Evolution of Different Storage Engines Storage to Match the Access Pattern with Kudu Complex Nested Type Patient Longitudinal Records n t  Aggregates/Counts Web Speed (ms) Faceted Search Solr Web Applications HUE RDBMS Fast lookup of longitudinal Entity (i.e. Patient) ETL Process Rest Deep Learning Analytics Longer Running Queries (min vs. days) JDBC/SQL Kudu BI/DW Workloads SQL

Anonymous Patient Longitudinal Analysis Rx (Prescriptions) and Dx (Medical Claims) Longitudinal Analysis

What does this do for us? Value Proposition See Patterns in Data Explore the Data Before Analysis Variety of Analysis in Parallel Time-to-Value Greatly Increased Reduced Cost Innovation

Rethink Everything! Lessons Learned Technology, Cultural, and Process Management Changes Rethink Everything!

Thank You Navdeep Alam Director of Data Warehousing 9/10/2018 nalam@us.imshealth.com