Camden Coalition of Healthcare Providers Evaluating
Camden Coalition of Healthcare Providers Agenda: 1.Why is evaluating difficult? 2.Developing an evaluation framework 3.The evaluation timeline
Camden Coalition of Healthcare Providers §1 Why is evaluating difficult?
Camden Coalition of Healthcare Providers having data
Camden Coalition of Healthcare Providers patients w/ complexities = complex intervention
Camden Coalition of Healthcare Providers finding an appropriate comparison group ~ ~
Camden Coalition of Healthcare Providers regression to the mean
Camden Coalition of Healthcare Providers regression to the mean
Camden Coalition of Healthcare Providers it takes time!
Camden Coalition of Healthcare Providers §2 Developing an evaluation framework
Camden Coalition of Healthcare Providers
Process Outcomes
Camden Coalition of Healthcare Providers Customized Data System Solutions
Camden Coalition of Healthcare Providers
Dashboards
Camden Coalition of Healthcare Providers Actions Taken Weekly scorecard to measure success and failure Daily operations dashboard to identify opportunities Weekly root cause deep dives by management team Problem The stated goal of our intervention was to see our patients once a week in person. Too many failures were occurring and our relationship with patients was diluting Results Reduced median days since last engagement Dramatically reduced process variability & outliers WEEK 1WEEK DAYS 38 DAYS Days Since Last In-Person Engagement
Camden Coalition of Healthcare Providers TimeNMinimumMaximumMeanStandard Deviation Pre Post Number of 6x month readmissions by enrollment date
Camden Coalition of Healthcare Providers §3 Choosing an appropriate evaluation timeline
Camden Coalition of Healthcare Providers Planning & Data Analysis Piloting and Early Evaluation More Robust Evaluation (through Randomization) Scaling Program Timeline
Camden Coalition of Healthcare Providers 80% Medical Studies
Camden Coalition of Healthcare Providers 20% Healthcare Delivery Studies
Camden Coalition of Healthcare Providers Key Issues Sample Size Number of treatment arms Randomizing before or after consent? Data (what’s collected administratively? -available for the control group? When? Timing – not too early and not too late Time, expertise, and funding to do it right Why? Clear, credible results on causal effects Helpful in attracting sustainable funding and scaling a program
Camden Coalition of Healthcare Providers Standard of Care Key Outcomes: reduced re-hospitalizations and ED visits in 12 month period following discharge CCHP’s Care Management RCTCCHP’s Care Management RCT n = 138 / 800