1. Cross-site Evaluation Update Latino ETAC

2. Goal of Cross-site Evaluation To facilitate and conduct a rigorous evaluation of innovative and effective service delivery interventions for Latino/as living with HIV across demonstration sites.

3. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

4. Cross-Site Qualitative Evaluation Andrés Maiorana Sophia Zamudio-Haas

5. Objectives To describe the interventions and the barriers and facilitators that affect their implementation To identify best practices regarding community engagement, testing, linkage, and retention in care To better understand the experiences of patients related to testing, linkage, and engagement in care

6. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

7. Interview Elements Key Informant InterviewsClient/ Patient Interviews Number of Interviews 6 per site Total N= 120 6 per site Total N= 120 Time pointsYears 2 and 4 Anticipated Length 45- 60 minutes ModeFace-to-face or telephone; Audio recorded Face-to-face; Audio Recorded DomainsPerceptions and experiences of implementation staff, intervention barriers and facilitators, participant responses to linkage and engagement efforts, lessons learned Intervention experiences, perceptions of identity as relate to care seeking behavior, perceptions of living with HIV and experiences with medical care

8. Cross-Site Quantitative Evaluation Starley Shade

9. Objectives To assess the effect of demonstration projects on: –Engagement in HIV care continuum, and –Patient health outcomes. To assess how pre-disposing factors, enabling factors and need mediate or moderate the effectiveness of demonstration projects –Identification of factors guided by Transnational Framework specific to Latino/a experiences in the US

10. Objectives To assess the cost, cost-efficiency and cost- effectiveness of demonstration projects

11. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

12. Participant Survey Participant survey in production –Available in English and Spanish Version 2 available –Please upload and implement Version 3 will be produced in the coming weeks –Please provide any feedback on errors identified by December 31, 2014

13. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

14. Medical Data Abstraction Specifications produced according to Ryan White Services Report (RSR) for 2014 –Approved by HRSA Data for patients enrolled during the first three months (3) of intervention implementation will be required five (5) months after initiation of the intervention –(e.g. If your intervention started in November 1, 2014, we would expect information for participants enrolled through January 31, 2015 to be submitted by March 31, 2014) ETAC will conduct a webinar to provide instructions for submission of data (January 2015)

15. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

16. Costing ETAC will work with demonstration sites to report the annual cost of planning and implementation of demonstration site interventions. Costing categories include: –Personnel –Recurring costs –Capital investment (one-time costs) –Infrastructure (space)

17. Costing Demonstration sites will be asked to report on costs by: –Period (pre-implementation vs. post- implementation) –Activity (community engagement, testing, patient navigation, case management) –Intervention target (identification, linkage, retention, etc.) –Source of resources (HRSA SPNS grant vs. “in- kind” costs)

18. Costing Costs associated with local and cross-site evaluation will be represented separately and are not included in the cost of demonstration site intervention implementation.

19. Costing Demonstration sites should identify one programmatic person (preferable one responsible for the budget) and one financial person to participate in costing activity ETAC will conduct an webinar in January 2015 to introduce costing activity to demonstration sites After webinar, ETAC will contact sites to set up time to discuss costing activity with each site

20. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

21. HIV Testing Aggregate data –Number tested –Number tested HIV-positive Number enrolled –Number of new HIV diagnoses Number enrolled

22. Evaluation Components HIV testing data Intervention exposure Participant survey Medical data abstraction Costing Local evaluation Key informant interviews Participant interviews Qualitative Quantitative

23. Intervention Exposure Routinely collected data on units of service –Community engagement –Outreach –HIV testing –Patient navigation –Case management

24. Intervention Exposure Demonstration sites will be responsible for uploading data for eligible participants every month to secure web portal. –Demonstration sites will create and use their own tools for data collection –Data must be submitted in a standardized format

25. Intervention Exposure Data elements –Date –Participant ID –Intervention provider Outreach worker, promotoras, patient navigator, case manager, etc. –Provider type Peer, non-clinical provider, clinical provider

26. Intervention Exposure Data elements (continued) –Intervention Activity Social network engagement, ARTIS session, escort to medical visit, etc. –Intervention target Stigma reduction, identification, linkage, retention, etc. –Minutes

27. Timeline Intervention Implementation –Ongoing Local Evaluation –Ongoing Cross-site Qualitative Evaluation –Start data collection in the Spring/Summer Giving sites to some time to recruit clients/patients and implement linkage to care interventions If possible, coordinate with site visits

28. Timeline Cross-Site Quantitative Evaluation –Participant Surveys Ongoing –Medical Chart Abstraction January 2015 - Webinar to introduce specifications March 2015 - Webinar to describe how to upload data April 2015 - Launch –Costing January 2015 - Webinar, calls with sites –Intervention Exposure January 2015 - Define specifications February 2015 - Webinar to describe how to upload data March 2015 - Launch

29. Thank You Questions?