1. Assessing CAHPS Clinician & Group Survey Results What Can CAHPS Database Do For You Janice Ricketts, CAHPS Database Manager, Westat 2011 AHRQ Annual Conference September 18, 2011

2. CAHPS Database National repository of data for selected CAHPS surveys Two major applications: o Benchmarking o Benchmarking to evaluate health system performance and support quality improvement o Research o Research on consumer assessments of quality Funded by AHRQ and administered by Westat through the CAHPS User Network 2

3. CAHPS Database Components 3 CAHPS Health Plan Survey Database –4.3 million records collected –12 Annual Chartbooks (1998 – present) CAHPS Clinician & Group Survey Database –Just launched in May 2011 330,747 completes 1,095 practice sites

4. Benefits of Participation Free service open to all survey users on a voluntary basis Submit data through an Online Data Submission System –Technical support, data submission specifications and submission training video Access to comparative results by survey version through an Online Reporting System Support to participants provided through –Custom analysis and reports –User network –Email and phone technical support 4

5. Online Submission 5

6. Online Reporting Supports selected CAHPS surveys maintained by the CAHPS Database –CAHPS Health Plan Survey –CAHPS Clinician & Group Survey Public portal available to everyone –Ability to view summary-level data only Password-protected portal accessible only to participants who contribute data –Ability to view your own results compared to selected benchmarks 6

7. Comparative Results in Online Reporting System (http://www.cahps.ahrq.gov)http://www.cahps.ahrq.gov 7

8. Top Box Scores Percent reporting most positive response for composites, rating, and question items across selected characteristics:  Region  Physician specialty  Practice ownership & affiliation  Number of visits per practice  Survey mode 8

9. Top Box Scores - Submitter 9

10. Frequencies View the distribution of scores for all response options. Allows users to run custom one-way and two-way frequencies by selected respondent and practice characteristics. 10

11. Barchart Results Display a graphical distribution of survey results that show the top, bottom, and middle response categories. 11

12. Barchart Results –Submitter Results Compare your results to National Distribution and practice site characteristics such as:  Region  Physician specialty  Practice ownership & affiliation  Number of visits per practice  Survey mode 12 Your Results

13. Percentiles 13

14. Downloadable Reports 14

15. Export Results to Excel 15

16. Physician Specialty Comparisons: Visit Version Top Box Scores 16

17. Additional QI Resources CAHPS Improving Quality site: http://www.cahps.ahrq.gov http://www.cahps.ahrq.gov –Case studies of QI initiatives –Supplemental survey questions –Archived Webcasts and presentations –Links to related resources 17

18. CAHPS User Support Services CAHPS User Network Web Site https://www.cahps.ahrq.gov CAHPS Database Technical support E-mail: NCBD1@ahrq.govNCBD1@ahrq.gov Phone: 888-808-7108 CAHPS Technical support E-mail: CAHPS1@ahrq.govCAHPS1@ahrq.gov Phone: 800-492-9261 18