1. Melissa Field Senior Information Analyst 21 May 2012 PRIMHD NGO Reports & Data Quality

2. Presentation Outline Part 1: PRIMHD NGO reports Running PRIMHD NGO reports in Infoview Part 2: PRIMHD Data quality Issues impacting reports Audit Reports Case Study – Wellink

3. PRIMHD NGO reports Four reports developed in conjunction with the PRIMHD NGO Advisory Group Each have different time periods –NGO Demographics – 12 monthly –NGO Activities – monthly –NGO Outcomes – 3 monthly –NGO Referrals – 6 monthly

4. NGO Demographics Table 1 & 2 –Clients seen by team, age, ethnicity and sex with DHB population comparisons Table 3 –Clients seen by another NGO and/or DHB and with contact and average length of stay (ALOS) information Table 4 –Average length of stay (ALOS) by Team

5. NGO Activity Table 1 –Clients seen by NGO of Service, Team Type and Team Name, showing Bed nights, Face to Face contacts and Other contacts Table 2 –Clients seen nationally by Team Type showing Bed nights, Face to Face contacts and Other contacts

6. NGO Outcomes Table 1 –Clients referred by NGO Team Type, DHB Team Type, DHB Team Name, Average Admission HoNOS, Average Discharge HoNOS and Average change in HoNOS

7. NGO Referrals Table 1 –Clients with their “Referral From” sources, by NGO of Service, Team Type and Team Name Table 2 –Clients with their “Referral To” sources, by NGO of Service, Team Type and Team Name

8. Business Objects Infoview To request Infoview access or to log in to Infoview go to: http://busobjxi.moh.health.nz/MOH.html

9. Logging on Go to http://busobjxi.moh.health.nz/MOH.html http://busobjxi.moh.health.nz/MOH.html

35. Key points to note Be mindful of how up to date your PRIMHD data submissions are –“No data to fetch” or a blank report may indicate no data has been submitted for that time period You do not need to wait for report to run –It’s ok to log out of Infoview or your machine and log back on later

36. NGOs reporting to PRIMHD As at 27/04/2011 we had the following number of NGOs reporting to PRIMHD: This is a huge number of organisations reporting – thank you! There are 30 NGOs yet to go live. FTPPRIMHD OnlineTotal 88147235

37. PRIMHD Compliance Details - FTP Full PRIMHD Compliance for NGOs submitting via FTP is awarded upon: –Successful completion of test scripts –File of at least one month’s worth of data achieving 98% –Satisfying a set of basic data quality checks Once reporting to PRIMHD, checks and monitoring by MoH continue to ensure on-going data quality. Note PRIMHD Compliance ≠ NGO Provider Completeness. If data is missing from your system or is not submitted, your PRIMHD data will be incomplete, even if you have full compliance.

38. Issues Impacting Reports Data Quality Issues –Zero length bednights –Incomplete volumes –Duplicated data – referrals and activities –Some teams not reporting –Error records – data not in PRIMHD Interpretation Issues –Is the report counting clients or activities? –What time period is it for? –Which organisation? –When was the report run – has the DM refreshed?

39. Audit Reports MoH developed a set of audit reports that can be run to show the data that makes up the reports. These can be valuable when trying to reconcile local data to the aggregated reports. Please feel free to request these to help verify your data.

40. On-going Work PRIMHD has been a steep learning curve for both MoH and NGOs. We have made a lot of progress and we are still learning as we continue to work with organisations. The following slides give details of a case study showing our work with one NGO.

41. Wellink Case Study (1) Background Details The Wellink Trust (Wellink) achieved full PRIMHD Compliance in July 2010. The data quality checks to grant full compliance have been increased significantly in the last year to try to catch any data quality issues before an NGO’s data goes into production. For Wellink a lot of data quality investigation was done after they had been given full compliance, and this highlighted several issues.

42. Wellink Case Study (2) MoH and Wellink worked closely together to resolve data quality issues:  Zero Length Bednights Bednights starting and ending on the same day were being reported by residential teams, giving a zero bednight count and affecting activity volumes. MoH worked with Wellink to identify the incorrect reporting and advise what was needed to address the issue. Wellink has made extract changes and is now correctly reporting bednights, meaning their activity volumes in PRIMHD are correctly reflecting the services provided.

43. Wellink Case Study (3)  Duplicate and overlapping referrals Wellink had reported a number of duplicate or overlapping referrals, where the same client had more than one referral for the same team at the same time. MoH worked with Wellink to identify the duplicate referrals and advise what was needed to address the issue. Wellink has made extract changes to remove the duplicates, meaning their referral volumes in PRIMHD are correctly reflecting the services provided. On-going monitoring continues to show no further duplicates are being submitted by Wellink which is great news!

44. Wellink Case Study (4)  Duplicate activity records Wellink had reported a number of duplicate activity records, where the exact activity details for a client were reported more than once. MoH worked with Wellink to identify the duplicate activities and advise what was needed to address the issue. Wellink has made extract changes to remove the duplicates, meaning their activity volumes in PRIMHD are correctly reflecting the services provided. On-going monitoring shows the number of activity duplicates from Wellink in PRIMHD remains very low.

45. Wellink Case Study (5)  Long Duration Contacts Wellink had reported a few contact activities with very long durations - some of these looked like 24 hour clock errors (e.g. starts at 08.45 and ends at 21.00). MoH worked with Wellink to identify the long duration activities. Wellink has corrected this data. Ongoing monitoring shows that there are no contacts from Wellink in PRIMHD with very long durations.

46. Wellink Case Study (6) MoH and Wellink – also worked together on: Team Detail Updates MoH updated Wellink’s PRIMHD Team Details to ensure the team names on the reports matched their local names. Record Deletions MoH deleted some data from PRIMHD on Wellink’s behalf, following a system change which altered their referral numbering. Audit Reports MoH provided audit reports to Wellink to help with their reconciliation of the PRIMHD reports to their local data.

47. PRIMHD Contact details Data or report enquiries: Melissa Field Senior Information Analyst Email Melissa_Field@moh.govt.nzMelissa_Field@moh.govt.nz Ph (04) 816 3310 Data Quality enquiries: Senior Data Quality Analyst/Auditor Ph (04) 816 3349