~PPT Howard Burkom 1, PhD Yevgeniy Elbert 2, MSc LTC Julie Pavlin 2, MD MPH Christina Polyak 2, MPH 1 The Johns Hopkins University Applied Physics Laboratory 2 Walter Reed Army Institute for Research Global Emerging Infections Surveillance & Response System San Francisco, CA November 17, 2003 American Public Health Assoc. 131 st Annual Meeting Estimation of Late Reporting Corrections for Health Indicator Surveillance

~PPT ESSENCE: An Electronic Surveillance System for the Early Notification of Community-based Epidemics l Earlier detection of aberrant clinical patterns at the community level to jump-start response l Rapid epidemiology-based targeting of limited response assets (e.g., personnel and drugs) l Communication to reduce the spread of panic and civil unrest

~PPT ESSENCE Biosurveillance Systems Monitoring health care data from ~800 mil. treatment facilities since Sept System receives ~100,000 patient encounters per day Adding, evaluating new sources –Civilian physician visits –OTC pharmacy sales –Prescription data –Expanding to nurse hotline, absenteeism data, animal health,… Developing & implementing alerting algorithms

~PPT Using Lagged Data Counts for Biosurveillance ESSENCE II data => hypothesis that earlier stages of an outbreak may be more detectable in office visit (OV) data than in emergency department data –Depends on existence, duration of typical prodrome for underlying disease –How to exploit this for earlier alerting? BUT, our electronic OV data is reported variably late, depending on individual providers QUESTION: How can a timely source of data with a reporting lag be used for biosurveillance?

~PPT Reporting of Civilian Office Visits Daily Regional Civilian Diagnosis Counts Respiratory Syndrome Group

~PPT Office Visit Reporting Promptness by Data Source Use of Kaplan-Meier “Failure Function” Curves to Represent Reporting Promptness

~PPT Using Lagged Data for Biosurveillance Approaches Two steps: estimate actual counts, apply algorithm –use recent promptness functions by day-of-week, other covariates –apply lateness factors to recent counts Brookmeyer R, Gail MH, AIDS Epidemiology: A Quantitative Approach. New York: Oxford University Press; 1994; Chapter 7 Use historically early reporting providers as sentinels Combined approach: use regression on counts with date and lag as predictors to determine whether recent reported data are anomalous Zeger, SL, See, L-C, Diggle, PJ, “Statistical Methods for Monitoring the AIDS Epidemic”, Statistics in Medicine 8 (1999) Linear regression using number of providers reporting each day

~PPT Reporting of ER/Outpatient Visits Apparent difference in reporting promptness between ER and other clinics ER: 50% reported by day 3 Outpatient: 80% reported by day 3

~PPT Reporting of Civilian Office Visits 21-day adjustment: Week 1

~PPT Concept: (applied in recent DARPA eval.) –tabulate # doctors or clinics reporting each day –use residuals of linear regression of daily data counts on # providers –accounts for known & unknown dropoffs by computing actual counts vs expected, given daily # providers –can include additional predictor variables Can apply process control alerting algorithms to residuals Significantly attenuates day-of-week effect Using Provider Counts to Adjust for Lagged Reporting

~PPT Counts of Clinic/MTF Pairs Military Outpatient Visit Data City-Wide Respiratory Diagnosis Counts Number of Clinics Reporting “Explains away” unexpected data dropoffs

~PPT Effect of Provider Count Regression Visit Counts and Residuals Day-of-Week Effect Attenuation Rise due to outbreak?

~PPT Effectiveness in DARPA Outbreak Evaluation Challenge