Predictive Models for Health and Social Care: A Feasibility Study

Slides:



Advertisements
Similar presentations
Pouring IT On Gareth Paterson - Regional Manager LTCC.
Advertisements

Wisconsin Department of Health Services Richard Miller Research Scientist Wisconsin Office of Health Informatics October 28, 2014 Matching Traffic Crash.
Supporting Carers in General Practice & role of RCGP GP Champions for carers Dr Sachin Gupta GP, Welwyn Garden City RCGP GP Champion for Carers, East of.
Better Care Fund why and how Dominic Harrison
Enhanced SPARRA Predictive Model & SPARRA Patient Alerts Risk prediction and service development Kathleen McGuire – Long Term Conditions Manager Ehealth.
28th March 2013 Debbie Newton Chief Operating & Finance Officer
Right First Time: Update. Overview Making sure Sheffield residents continue to get the best possible health services is the aim of a new partnership between.
© Nuffield Trust Inner North West London Integrated Care Pilot – year one evaluation 8 July 2013 Holly Holder Fellow in health policy Ian Blunt Senior.
© Nuffield Trust Annual Health Strategy Summit Dr Martin Bardsley Head of Research Nuffield Trust Twitter: #NTSummit.
Jan Hull Acting Director of Development
How do nurses use new technologies to inform decision making?
Key Health Data Launch The Role of the CBSA September 08.
Integration, cooperation and partnerships
Evaluation of Leicestershire’s Better Care Fund programme Elizabeth Orton, Consultant in Public Health Janine Dellar, Head of Public Health Intelligence.
Care Options for NHS Continuing Health Care (CHC) Wirral PCT Board – 12 February 2008 Tina Long - Director of Strategic Partnerships Sheila Hillhouse -
© Nuffield Trust July 2010 Trends in Emergency Admissions in England
Objective: Reducing Emergency Hospital Admissions.
Analysis of Virtual Wards: a multidisciplinary form of case management that integrates social and health care Martin Bardsley Director of Research Nuffield.
The Role of Virtual Wards in Reducing Unplanned Admissions
Creating a service Idea. Creating a service Networking / consultation Identify the need Find funding Create a project plan Business Plan.
SmartCare Marlene Harkis Service Development Manager Scottish Centre for Telehealth and Telecare.
National Evaluation of POPP: The Evidence Base Report authors and core team: Karen Windle, Richard Wagland, Julien Forder, Francesco D’Amico, Dirk Janssen,
SSRG annual workshop Balancing and Managing Risk 8th April 2008 Costing Children’s Services: Availability of Child Level Data Samantha Culley Centre for.
Satbinder Sanghera, Director of Partnerships and Governance
© Nuffield Trust Commissioning integrated care: insights from our research Dr Judith Smith Head of Policy, the Nuffield Trust Professor Chris Ham Chief.
Nurse-led Long term Conditions Management
© Nuffield Trust Predictive Risk 2012: Context Predictive R 13 June 2012 Martin Bardsley Head of Research Nuffield Trust.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care Improving Administrative Data for Public Reporting Anne Elixhauser.
Sina Keshavaarz M.D Public Health &Preventive Medicine Measuring level of performance & sustaining improvement.
Respiratory Benchmarking Packs Yorkshire and the Humber September 2010.
© Nuffield Trust June 22, 2012 Adam Steventon: Evaluating the Whole System Demonstrator trial Authors: Adam Steventon, Martin Bardsley Nuffield Trust.
The Audit Process Tahera Chaudry March Clinical audit A quality improvement process that seeks to improve patient care and outcomes through systematic.
Advancing Quality in Primary Care – What is Quality Improvement? 10 March 2011 Powys THB/IRH Paul Myres- Chair Primary Care Quality Forum.
© Nuffield Trust Can the voluntary sector help to prevent hospital admissions? Theo Georghiou & the Nuffield Research team 22 June 2015.
© Nuffield Trust Evaluation methods – where can predictive risk models help? Adam Steventon Nuffield Trust 8 July 2013.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Providing the evidence…..linking social care, housing support and health data Gillian Barclay & Ellen Lynch Scottish Government.
© Nuffield Trust Review of aggregate assessment of providers of health and social care in England ('Rating Review‘)
Transforming Community Services Commissioning Information for Community Services Stakeholder Workshop 14 October 2009 Coleen Milligan – Project Manager.
© Nuffield Trust November 2012 Evaluating the impact of the Marie Curie Nursing Service Xavier Chitnis, Theo Georghiou, Adam Steventon and Martin Bardsley.
Developing Quality Indicators & Dashboards for Dementia Adam Cook South East Coast Quality Observatory.
Complex Care Teams Context The Department of Health white paper “Our Health, Our Care, Our Say” ‘By 2008 we expect all PCTs and local authorities to have.
© Nuffield Trust 22 June 2015 Matched Control Studies: Methods and case studies Cono Ariti
Registering the care sector – next steps Dr Linda Hutchinson Director, Care Quality Commission National Care Association Conference, 21 October 2010.
New developments in resource allocation December 2011 © Nuffield Trust PBRA (person-based resource allocation): A resource allocation formula at general.
Hampshire Health Record Hampshire Health Record Improving clinical care through sharing information Stockport Health Record Awareness Event 16 th September.
Integrated Framework of Care Toolkit. Presentation Overview Drivers for change What is integration? Toolkit objectives Leutz Integrated framework Forms.
Access to data for local authority public health AGW Public Health Network Training Event: Public Health Data, Information and Intelligence 11 th November.
Older People’s Services The Single Assessment Process.
Central Norfolk Health & Social Care Central Norfolk Health and Social Care Better Care for Norfolk Key Partners: Norfolk & Norwich University Hospital.
© Nuffield Trust Predictive risk and health care: an overview Research summary Selected figures March 2011.
DEMONSTRATING IMPACT IN HEALTH AND SOCIAL CARE: HOSPITAL AFTERCARE SERVICE Lesley Dabell, CEO Age UK Rotherham, November 2012.
WEEK 9 supporting significant life events Olutoyin Hussain.
Commissioning Integrated Rehabilitation and Re-ablement Services? Cath Attlee and Ray Boateng 1.
© Nuffield Trust Social care and hospital use at the end of life Authors: Martin Bardsley and Theo Georghiou December 2010.
Predicting risk of hospital admission and extracting GP data David Osborne Senior Public Health Information Analyst NHS Croydon.
National Audit of In-patient Falls 2015 Presenter / title Date line Comparison of (Your site name) results against the national results for the 2015 National.
© Nuffield Trust Uses of linked administrative data sets Adam Steventon, Nuffield Trust Royal Statistical Society 29 January 2013.
The role of extra care housing in addressing the needs of people with dementia Key findings from “Opening Doors to Independence” – a three year tracking.
Hospital inpatient data James Hebblethwaite. Acknowledgements This presentation has been adapted from the original presentation provided by the following.
A Common Assessment Framework for Adults – Development 12 February 2008 Carl Evans Social Care, Local Government and Care Services Directorate Department.
South West Hepatitis C Needs Assessment Dr Maya Gobin Health Protection Services (South West)
The MOST project How have we changed the business model? 12 December 2012 Andrew McIntosh, Tunstall Healthcare Adam Steventon, Nuffield Trust.
Predicting who will need costly care Ray Beatty Care Services Efficiency Delivery Programme.
A ssociation of Public Health Observatories Hospital Activity data Roy Maxwell SWPHO & Bristol University Dr Richard Wilson Sandwell PCT.
How can we use geographic variation in unplanned admissions to improve efficiency? John Busby CLAHRC West.
Quality of Electronic Emergency Department Data: How Good Are They?
Parallel Sessions: Pathways & Prediction
Health and Social Services in the Department of Health
The Comprehensive Model for Personalised Care
Presentation transcript:

Predictive Models for Health and Social Care: A Feasibility Study Authors: Bardsley M, Billings J, Dixon J, Georghiou T, Lewis GH, Steventon A (2011) ‘Predicting who will use intensive social care: case finding tools based on linked health and social care data’, Age and Ageing 40(2): 265-270 February 2011

Background Key points Evidence that admission to a nursing home can be delayed or avoided by means of preventative ‘upstream’ interventions Increasingly, public services will have to become more proactive in identifying and managing risk in older people, in order to mitigate them as much as possible It will be important to identify and support not just those at highest risk of these costs, but also those currently at lower risk who might become higher risk in future Current methods of assessing risk largely rely on face to face assessments.  In health care this approach has been shown to be less accurate at predicting predicting future events (hospitalisation) compared to statistical models.

Predictive modelling BMJ in paper* in 2002 showed Kaiser Permanente in California seemed to provide higher-quality healthcare than the NHS at a lower cost. Kaiser identify high risk people in their population and manage them intensively to avoid admissions • Modelling aims to identify people at risk of high costs in future Use pseudonymous, person-level data In health sector a number of predictive models are available e.g. PARR++ and the combined model. *Getting more for their dollar: a comparison of the NHS with California's Kaiser Permanente BMJ 2002;324:135-143

Predictive Models Identify who will be where on next year’s Kaiser Pyramid

Patterns in routine data to identify high-risk people next year

Patterns in routine data to identify high-risk people

Patterns in routine data to identify high-risk people

Distribution of Future Utilisation is Exponential

Can we predict costly social care events in the same way? Do the data exist in local systems? Can we extract individual, person-level data? Can we link a wide range of health and social care data at the person level? Are the data accurate and complete enough to use? Can we build a valid statistical model?

Feasibility Project Funded by Department of Health Care Services Efficiency Delivery (CSED) programme over 18 months Worked with 5 sites to extract data sets Extracted person-level health & social care data sets Linked data from GP records (2 sites); GP register (all sites); Hospital (all sites); Social Care (all sites) Undertook exploratory analyses and ran a range of models Tested the impacts of different data sets on the models

Using health and social care data to predict health and social care use

Using routine data Less labour intensive so they can stratify the population systematically and repeatedly Avoid “non-response bias” Can identify people with lower, emerging, risk Important issues of confidentiality and consent to consider Linking data sources at individual level across health and social care is problematic where there is no NHS number in social care The tools are never 100% accurate Data may be missing from routine databases on certain groups

Predictive factors – examples

Information flows

Data collected From four ‘sites’ (~ PCT areas) Total seven organisations: 3 PCTs, 1 Care trust, 3 LAs Total 1.4M pop (range 100,000-700,000)

Data linkage - approach First instance: NHS number (encrypted) from LA In absence of NHS number: Central ‘batch tracing’? Shared PCT/LA databases? Ultimately: construction of ‘alternative IDs’ 97% of individuals in one site (population ~400,000) were found to have unique ‘alternative ID’.

Data linkage Groups of people in social care data – how many are we able to match to GP register list (of ages 75+)? Varies, but better for those with > service use

Data linkage Social & secondary care interface

Predictive value, sensitivity and specificity of the model incorporating a £5,000 threshold Predicting social care costs: feasibility study

Information on Social Care Needs

Simplifying and sorting

Individual histories

Transitions in care (75+ in one site)

Individual health and social care event timeline over a three-year period

Predictive Modelling Attempting to predict: For over 75s Admission to care home (or receipt of high intensity home care) or £5,000 increase in social care costs in one year Where person had no ‘significant’ costs in prior two years

Original models predicting change at £5k threshold

Diagram

Distillation flask

Trade off between PPV (blue line) and sensitivity (red line) according to different risk cut-offs

Which variables are important in pooled £1k model?

Models using lower £1k thresholds

Impact of adding new datasets

Iteration with Sites - Application Several sites said they would like to run the Combined Model and the social care model “side-by-side” Theographs thought to be very useful Differences between sites: some sites preferred small numbers of clients others wanted large numbers for mail-shots Regarded concerns over invasion of privacy as “a non-issue if the wording is right” Keen to use predictive models for existing or planned re-ablement services and multidisciplinary teams

Personal observations on social care data We could access user level social care data but... Different systems Issues of standardisation /coding etc and the absence of standard, structured coding schemes Some very detailed information collected but can be difficult to use in models We found it harder to obtain information on descriptions of needs Local concerns about data quality Note the history of comparative benchmarking  

© Nuffield Trust

Headlines We have created linked health/social care data sets in five sites (overall populations about 2 million people aged 75+) We modelled intensive social care: Models had satisfactory PPV but low sensitivity at a risk score threshold of 50 (although can be traded-off against each other) Mainly social care driven Though accuracy worse than PARR model, accuracy was comparable with SPARRA and the combined model Discussion with sites – they were less concerned with model performance than we were We tried dozens of ways to improve the basic model (5K) We modelled change in social care costs with lower thresholds: 1K models are much better but usefulness may be diminished

And the data have so much more to offer..... Cost modelling Iso-resource classification (individual budgets) Trajectories and transitions of care Evaluation (re-ablement) Information for - Commissioners and managers Professionals Service users and carers

Sign-up for our newsletter www.nuffieldtrust.org.uk/newsletter Follow us on Twitter (http://twitter.com/NuffieldTrust) February 2011 © Nuffield Trust