Key Performance Indicators, Centre Reports, and more Stephen McDonald
Barbecue talk
More “good” news
Indigenous incidence rates
Background A number of ongoing work themes exist within ANZDATA for generating output –Stock and flow figures –Annual Report –Contributor requests Responses to information needed for various projects –Research projects (internal and external analyses) –Outcomes reporting
Outcomes reporting Recent years have seen a growth of interest in outcomes reporting Centre reports have been part of ANZDATA for many years, with increasing emphasis in recent years –At “parent hospital level” –Limited distribution historically
Why measure outcomes?
Dialysis outcome
Variation in transplant outcomes
What is happening to centre reports? Greater reporting of demographics and comorbidities Adjusted analyses in transplanting centre and dialysis reports –Details of models supplied Graphs –Funnel plots –CUSUM plots (transplant)
Centre reports – graph 1
Centre reports – graph 2
But....
Adjusted graphs
How are reports derived?
You need a model Logistic regression model (transplant), Poisson model (dialysis) Adjusted for demographics, comorbidities (donor and XM variables) With this model, derive a probability of “expected” failure for each person / graft based on covariate matrix Compare this with actual outcomes
Which predictors are important? Predictive power of multivariate Cox model predicting graft survival, all DD transplants , with sequential addition of covariate groups
Factors within the control of centre –These may be why a particular centre gets good or bad results Factors that occur as a result of treatment decisions For example, don’t adjust for –Choice of dialysis modality, HD access –Use of immunosuppressives, rejection, 1 month graft function… Don’t adjust for…
Other graphical demonstrations of output Funnel plots are a static measure and summarise performance (relative to a comparator) over a fixed period of time. –Lack a dynamic element –Weight recent and distant results equally
Adding time – CUSUM Number of tx Cumulative sum O-E 01jan200401jan200501jan200601jan200701jan200801jan2009 Tx date Twoway CUSUM for a transplant centre
Removing credit for good deeds
Do we need to do more?
Why KPIs? Mortality is an insensitive and late indicators of problems –Hopefully rare –Outcome of complex series of events Incompletely ascertained –Important to monitor as best we can Key Process indicators –Simpler to understand, easier to address –Need to be valid and correctable (and related to meaningful outcomes)
KPI Project Dialysis KPI project commenced 2011 –At instigation of DNT committee 2 markers chosen – Peritonitis and HD access at first treatment –Deliberately limited to existing data collection NO additional data collected –Based on real time ANZDATA data collection
Variation in HD access
Variation in peritonitis rate 27
KPI reporting -- access Quarterly identified feedback to units
Peritonitis reporting
Where to from here? COMMUNICATE Improve data collection Improve access to results Enhance reporting –Add peritonitis rates –Access subdivided by late referral –Graphs etc etc Or is it all just too hard?
How do we view quality?
Centre reports -- SMR