2. Can we measure structured chronic care ? Michel Wensing Jochen Gensichen John Tooker

3. Contents the workshop Why measurement is important Patient and provider reports on chronic care Examples from U.S.A, and Europe Discussion on desired research and implications for practice and policy

4. Why measure chronic care ? To be able to optimize it (formative evaluation and internal improvement) To show its value (summative evaluation for transparancy, contracts, public reporting, P4P) But: is it measurable? Some say that structured chronic care is too complex to be measured

5. Specific challenges for measurement Chronic care often includes a range of health professionals - certainly from a patient or system perspective Chronic care implies things that may be absent and unknown to patients (and perhaps providers) Measure disease specific or generic aspects of chronic care?

6. Netherlands: PACIC questionnaire in general practice Validation study in 165 patients from 4 practices Wensing Van Lieshout Jung Hermsen Rosemann

7. Methods Diabetes patients and COPD patients, randomly sampled from practice registers PACIC (20 items): forward and backward translation, interviews with 15 patients, and adaptations Postal survey with reminders (70% response rate)

8. Description of the patients (n=165) Mean age (SD)68.0 (10.3) Percentage women47% Percentage medium/high education36% Percentage good/excellent health status55% Percentage who rated GP care as excellent57%

9. Floor and ceiling effects (examples) % in lowest category% in highest category PA: given choices about treatment to think about 25%20% DS: given a written list of thinkgs I should do to improve my health 39%24% GS Encouraged to go to a specific group or class to help me copy with my chronic illness 76%10% FU: Encouraged to attend programmes in the community that could help me 78%10%

10. PACIC domains metrics OverallPADSGSPSFU Nr items2033545 Mean2.93.23.52.53.33.1 Missing31%21%20%25%28%25% Alpha0.930.850.750.810.870.71 ICC0.910.850.660.760.860.66 Europep effect++++++ PEI effect-NS----

11. Diabetes versus COPD patients Diabetes patients scored higher than COPD patients on 14 of the 20 PACIC items This might be explained by better structured chronic care for diabetes patients, or by patient characteristics

12. Conclusions A translated and validated Dutch version of PACIC is available Reasonably good measurement characteristics, but some problems: - About 25% non responders - Floor and ceiling effects - Unexpected assocation with PEI

13. Chronic care and physician workload Secondary analysis of EPA data from 140 practices in 10 countries Wensing Van den Hombergh Van Doremalen Grol Szescenyi

14. Chronic care and physician workload in European primary care Secondary analysis of data from the EPA project

15. Background Delivery of chronic care is an important task of primary care Primary care practices are relatively small A higher volume of chronic patients may be associated with better performance and higher efficiency Many factors could influence such associations: international research needed

16. Methods Data from 140 practices in 10 countries (convenience samples) Physician workload = working hours per 1000 yearly attending patients Post-hoc measures based on EPA to measure aspects of the chronic care model Practice size: number of yearly attending patients Non-physician staff: total units of full time equivalance staff in the practice Mixed linear regression analysis models

17. Some descriptive figures (n=140 practices) Mean Yearly attending patients4337 Physician hours / 1000 patients15.0 Fte Non physician staff / 1000 patients0.81

18. Structured chronic care (n=140 practices) Theoretical range Mean Presence of staff in team meetings0 – 61.5 Procedures for preventive services0 – 53.0 Use of disease classification0 – 63.0 Use of email and internet0 - 32.2 Computerized medical records0 – 32.9 Use of advanced sotfware0 – 32.4 Access to sources of evidence0 – 42.3 Use of patiëet education materials0 - 42.8

19. Main findings Practice size was the single most important predictor of physician workload per 1000 patients: each additional 1000 patients was associated with 1.29 fewer working hours per week per 1000 patients More non-physician staff was associated with higher physician workload: each additional 0.1 fte led to an additional 1.6 physician hours per week per 1000 patients

20. Conclusions Practice size, not chronic care delivery, was the most important determinant of physician worklload Warning: observational research Physician workload per 1000 patients is a proxy measure for physician efficiency; larger practices are more efficient Involving more nurses in primary does not imply reduced physician workload, and may in fact imply higher workload

21. www.topaseurope.eu

22. Discussion Further research and development Implementation in policy and practice