1. HMIS Data Quality Training 211 Orange County

2. Learning Objective This training is scheduled for 2 hours. Objective 1.Teach users how to find deficiencies in data using the management reports. 2.Train users how to correct data quality errors found in the management reports. 3.Review other reports that deal with the timeliness and completeness of data. 4.Teach users about HUD data standards, and what the expectations from 211 Orange County are in regards to these standards. 211 Orange County2 OCHMIS.org

3. Agenda Reports that will be covered: –Monthly Report Bundle Universal Data Elements_Agency Universal Data Elements_Agency_Details OC_Bed Utilization ProgramSpecificDataElementReport_Entry_Summary ProgramSpecificDataElementReport_Entry_Results ProgramSpecificDataElement_Exit_Summary ProgramSpecificDataElement_Exit_Results Client_Service_Aging_Report –Data Timeliness Reports Data Timeliness report OC_Data Timeliness at Service Entry OC_Data Timeliness at Exit Date –Other Data Quality Reports Client Last Permanent Zip Code Report Family Type and Size Validation Report 211 Orange County3 OCHMIS.org

4. Universal Data Elements_Agency Report Purpose of the report –Lists the number and percentage of clients that had a response entered for each HUD Universal data element. –Also lists the number and percentage of clients that had a blank response, or responded “don’t know” or “refused” for each data element. 211 Orange County4 OCHMIS.org

5. Universal Data Elements 3.1 Name 3.2 Social Security Number 3.3 Date of Birth 3.4 Race 3.5 Ethnicity 3.6 Gender 3.7 Veteran Status 3.8 Disabling Condition 3.9 Residence Prior to Project Entry 3.10 Project Entry Date 3.11 Project Exit Date 3.12 Destination 3.13 Personal ID 3.14 Household ID 3.15 Relationship to Head of Household 3.16 Client Location 3.17 Length of Time on Street, in an ES or Safe Haven 211 Orange County5 OCHMIS.org

6. Expectations from 211 Orange County All programs participating in HMIS (whether or not they are HUD-funded) should make an effort to have an answer (excluding don’t know, refused or data not collected) for all Universal Data Elements for 100% of their clients. 211 Orange County6 OCHMIS.org

7. Why this Expectation? 211 Orange County reports to HUD the percentage of clients that have a response (excluding don’t know, refused or data not collected) for each of the Universal Data Elements CoC wide. Programs that are NOT HUD-funded are also included in this count. We have to meet a certain threshold for each data element as a CoC in order to continue to receive HUD funding. This means that your data quality can impact whether or not other Orange County agencies receive their funding! 211 Orange County7 OCHMIS.org

8. Universal Data Elements_Agency Report Now you try! Are any of the data elements “Percentage” complete under 100%? –If yes, do you know how to troubleshoot that and find out why? (we’ll tell you on an upcoming slide) 211 Orange County8 OCHMIS.org

9. OC_Bed Utilization Report Purpose of the report –Shows number of units and beds These numbers come from the HIC surveys submitted by each program at the beginning of each year. –Provides a count of the number of clients that are active in each program at a POINT IN TIME –Includes the number of clients in each household type –Includes the percent occupancy for each program (active clients/total beds) –Used to verify whether or not the clients enrolled in the program are also entered in HMIS by looking at number of clients. NOTE: If your program does not have any beds or vouchers, you do not need to run this report. This report should be run at least monthly to ensure your bed utilization is “normal,” which in most cases should be between 65% and 105%. 211 Orange County9 OCHMIS.org

10. Expectations from 211 Orange County All housing programs should have a bed utilization between 65% and 105%. –Less than 65% bed utilization usually indicates one of the following: Some clients who have been enrolled in a program have not been entered in the HMIS Not all beds are available for occupancy (ie. remodel) –Over 105% bed utilization usually indicates one of the following: Some clients that have left the program have not been exited in HMIS Beds are at capacity including using cribs or cots which weren’t included in the HIC. 211 Orange County10 OCHMIS.org

11. Why this Expectation? All housing programs (whether or not they are HUD funded) are included on the HIC (Housing Inventory Count), which is a list of all homeless beds in Orange County. The bed utilization for each program should be within this range (65%-105% utilized). 211 Orange County submits an AHAR (Annual Homelessness Assessment Report) yearly for each program type (emergency, transitional, permanent supportive housing) –We cannot qualify to submit the AHAR report if our bed utilization as a CoC is outside of the bed utilization range. –If we do not qualify to submit the AHAR report, the CoC loses points on the CoC APR which could equate to Orange County losing money, which equates to individual agencies receiving reduced funding. 211 Orange County11 OCHMIS.org

12. OC_Bed Utilization Report Now you try! Do the number of clients look correct for each program? Do the number of clients in households with children look correct? Do the number of clients in households without children look correct? Is the bed utilization between 65%-105%? –If not, do you know why? How do you troubleshoot that? 211 Orange County12 OCHMIS.org

13. Universal Data Elements_Agency_Details Purpose of the report –Troubleshoot the results of the Universal Data Elements_Agency report –Troubleshoot the results of the OC_Bed Utilization report –Find clients that have “don’t know,” “refused,” “data not collected” or blank responses for any of the Universal Data Elements. –See a list of clients that were active at some point during the reporting period for each program. –Find other data quality errors. This report should be run at least monthly. Orange County’s threshold goal for data quality is 100% for all data elements. 211 Orange County13 OCHMIS.org

14. Finding Issues Export the Universal Data Elements_Agency report to Excel for troubleshooting. –Troubleshooting the Universal Data Elements_Agency report You can filter any data element by response to see which clients have “don’t know,” “refused,” “data not collected” or blank responses which need data to be entered. –Troubleshooting the OC_Bed Utilization report For programs that are over or under utilized, look at the list of clients to determine which client(s) have an incorrect entry/exit dates or missing exit dates. 211 Orange County14 OCHMIS.org

15. Correcting Issues Don’t Know, Refused, Data Not Collected or blank responses on the Universal Data Elements_Agency report –Go to the client’s Manage Snapshot page, and correct the data on the client’s program entry snapshot (snapshot 1). –If the client has been exited from the program, the enrollment will have to be reactivated to edit the snapshot. Clients with incorrect entry dates –Go to the client’s program entry page, change the client’s program entry date, and save (if the enrollment is exited, it will need to be reactivated). Clients with incorrect exit dates –Reactivate the client. Go to the client’s program exit date, click on exit client out of program, and enter exit date. (If you don’t have access to reactivate clients, sign up for the Mark for Delete training) 211 Orange County15 OCHMIS.org

16. Universal Data Elements_Agency_Details Report Now you try! 1.Export the report to Excel 2.Add a filter to the column header 3.Filter a data element for blanks, “don’t know” and/or “refused” Does your data set have very many records with missing data? If HMIS is missing data, –Do you have the information in the client file? –Did you ask the client the question at intake/exit? 211 Orange County16 OCHMIS.org

17. Program Specific Data Elements Reports Reports –ProgramSpecificDataElementReport_Summary –ProgramSpecificDataElementReport_Results –ProgramSpecificDataElement_Exit_Summary –ProgramSpecificDataElement_Exit_Results Purpose of these reports –Summary reports list the percentage of clients that had a response for each program specific data element at entry and exit. –Results reports list each client that was active in the program during the reporting period, and their answers to the program specific data elements. –If the Summary level report shows missing data elements, use the Results report to drill down at a client level to see who has missing data. This report should be run at least monthly. Orange County’s threshold goal for data quality is 100% for all data elements. 211 Orange County17 OCHMIS.org

18. Program Specific Data Elements 4.1 Housing Status 4.2 Income and Sources if yes, indicate all sources and dollar amounts for the sources that apply 4.3 Non-Cash Benefits if yes, indicate all sources that apply 4.4 Health Insurance 4.5 Physical Disability* 4.6 Developmental Disability* 4.7 Chronic Health Condition* 4.8 HIV/AIDS* 4.9 Mental Health Problem* 4.10 Substance Abuse* 4.11 Domestic Violence If yes, ask when experience occurred 4.12 Contact 4.13 Date of Engagement 4.14 Services Provided** 4.15 Financial Assistance Provided** 4.16 Referrals Provided** 4.17 Residential Move-In Date 4.18 Housing Assessment Disposition 4.19 Housing Assessment at Exit NOTE: For data elements with asterisk (*) that are answered yes, also answer questions below –Expected to be of long-continued and indefinite duration and substantially impairs ability to live independently –Currently receiving services or treatment for this condition? (at entry) –Received services/treatment while in the program? (At annual assessment and at exit) Data elements with 2 astericks (**) pertain to specific funding source 211 Orange County18 OCHMIS.org

19. Expectations from 211 Orange County All HUD-funded programs should make an effort to have an answer (excluding “don’t know,” “refused” or “data not collected”) for all Program Specific Data Elements for 100% of their clients. Non-HUD-funded programs who have agreed to participate in HMIS should also make an effort to have answers for 100% of their clients. 211 Orange County19 OCHMIS.org

20. Why this Expectation? HUD is taking steps to become more strict with their data thresholds, and we want to be prepared when a threshold is set since they are retroactive. 211 Orange County20 OCHMIS.org

21. Finding Issues Run the results report for the same reporting period as the summary report. For any program specific data elements that are less than 100%, you can filter that data element for blank, “don’t know”, “refused” or “data not collected” responses to see which clients are missing data. 211 Orange County21 OCHMIS.org

22. Correcting Issues Client has blank, “don’t know,” “refused” or “data not collected” responses for program specific data elements –Go to the client’s program entry or exit page (depending on the report you ran), enter the client’s data for those data elements, and save. 211 Orange County22 OCHMIS.org

23. Program Specific Data Elements Now you try! 1.Export the report to Excel 2.Add a filter to the column header 3.Filter a data element for blanks, “don’t know,” “refused” and/or “data not collected” Does the make-up of the clients on the report match the clients actually enrolled in the program? (ie. gender, age, veteran status, etc.) 211 Orange County23 OCHMIS.org

24. Client_Service_Aging_Report Purpose of this report –Lists the last service date for all clients that were active during the reporting period. –The report is broken into a list of clients that are still active, and a list of clients that have been exited. –For active clients, the report lists the number of days between the last service date and the current date. –For exited clients, the report lists the number of days between the last service date and the client’s exit date. *This report is required for all Supportive Services Only and Outreach programs. 211 Orange County24 OCHMIS.org

25. Expectations from 211 Orange County Clients that have not had a service in the last 30 days should be exited from HMIS (with some exceptions). Clients that have not received any services while in the program should have their enrollment deleted from HMIS (with some exceptions). 211 Orange County25 OCHMIS.org

26. Why this Expectation? In most cases, if a client has not received a service in more than 30 days, the client is no longer participating in the program, and should be exited. Similarly, if a client has not received a service while enrolled in the program, the client is not participating in the program, and their enrollment should be deleted. 211 Orange County26 OCHMIS.org

27. Finding Issues Clients without services for more than 30 days –Filter the <30 days column by blank fields to see a list of clients that have not received services in over 30 days. Clients that never received a service –Filter the last service date column by “missing” to see client’s that do not have any services listed for their enrollment. 211 Orange County27 OCHMIS.org

28. Correcting Issues Client without services for more than 30 days –Go to the client’s services provided or case notes page to add new services for the client OR exit the client from the program on the last date the client received a service. Clients that never received a service –Go to the client’s services provided or case notes page to add new services for the client OR delete the client’s enrollment from the program. 211 Orange County28 OCHMIS.org

29. Client_Service_Aging_Report Now you try! 211 Orange County29 OCHMIS.org

30. Data Timeliness Reports Reports –Data Timeliness report –OC_Data Timeliness at Service Entry –OC_Data Timeliness at Exit Date Purpose of these reports –To compare the date a client entered or exited a program or received services to the date the data was entered in HMIS. 211 Orange County30 OCHMIS.org

31. Expectations from 211 Orange County All data should be entered into HMIS within 3 days of the date it occurred. 211 Orange County31 OCHMIS.org

32. Why this Expectation? HUD requires each CoC to set a data timeliness policy for the agencies to follow. The less lag time there is between the date the entry, exit, or service occurred and the date it is entered in HMIS, the more likely it is that the data is accurate and complete. 211 Orange County32 OCHMIS.org

33. Finding Issues The Data Timeliness reports group data by programs, and have 7 columns for the number of days an entry, exit, or service has been lagging. To find clients that have data outside of our guidelines, filter the details section by lag time that is more than 3 days. Please note: Data timeliness issues that have already occurred cannot be corrected. This report is to determine what your data timeliness currently is, and if future data needs to be entered in a more timely manner. 211 Orange County33 OCHMIS.org

34. Data Timeliness Reports Now you try! 211 Orange County34 OCHMIS.org

35. Client Last Permanent Zip Code Report Purpose of this report –This report is grouped by program, and lists the number and percentage of clients whose last known permanent address was in each zip code. –The number and percentage of clients that are missing a zip code is also included. –Only programs with clients that are missing zip codes have been included on this report. 211 Orange County35 OCHMIS.org

36. Client Last Permanent Zip Code Report Now you try! 211 Orange County36 OCHMIS.org

37. Family Type and Size Validation Report Purpose of this report –Find clients whose family type does not match their family size. –This report only lists clients that have inconsistencies in their family type and family size data. 211 Orange County37 OCHMIS.org

38. Finding Issues Clients whose family size does not match their family type –These clients will have a false indicator which means that their family size or family type does not match the column header under which the false indicator appears Unaccompanied = 1 Single parent >= 2 Two parents >= 3 Adults no children >=2 Foster parent >= 2 211 Orange County38 OCHMIS.org

39. Correcting Issues # of Family Members is Correct, but Family Type is Incorrect –Go to the client’s Manage Snapshot page, and correct the family type on each client’s program entry snapshot (snapshot 1). –If the client has been exited from the program, the enrollment will have to be reactivated to edit the snapshot. Family type is Correct, but # of Family Members is Incorrect –Go to the client’s Client Intake_v5 page, and make sure all clients have the same Household ID and Family ID. Also make sure that all family members are listed in the household members grid. –Go to the client’s program entry page, click on edit snapshot, and click on reset to reset the client’s snapshot. The number of family members is automatically calculated based on the number of clients in the household. –If the client has been exited from the program, the enrollment will have to be reactivated to edit the snapshot. 211 Orange County39 OCHMIS.org

40. Family Type and Size Validation Report Now you try! 211 Orange County40 OCHMIS.org

41. Validating Active Clients On a monthly basis, validate the number of active clients for your project –Verify the correct number of active clients by running the Universal Data Elements report 211 Orange County41

42. Validating Exited Clients Once a month, validate the number of exited clients for your project –Verify if you have the correct number of exited clients by running the Universal Data Elements. –Verify if the clients have the correct destination by running the Program Specific Data Elements 211 Orange County42

43. Universal Data Element Details Report Run the Universal Data Elements Detail Reports by entering the parameters requested Review the Entry Date and Exit Date fields. –Entry date with no exit date (active clients) –Entry date with exit date (inactive clients) 211 Orange County43

44. Universal Data Elements Details Report Now you try! 211 Orange County44 OCHMIS.org

45. Data Quality Checklist - Short This form was created to assist users in validating their data quality and reduce the corrections that need to be made. 211 Orange County45 OCHMIS.org

46. Data Quality Checklist - Long 211 Orange County46 OCHMIS.org This checklist was created as a check and balance of each data quality item.

47. Questions? HMIS Help desk –(714) 589-2360 –HMIS-Helpdesk@211oc.orgHMIS-Helpdesk@211oc.org Website –http://ochmis.org/hmis-help/data-quality- reports/http://ochmis.org/hmis-help/data-quality- reports/ 211 Orange County47 OCHMIS.org