Use of Social Media to Improve Engagement, Retention, and Health Outcomes along the HIV Care Continuum Evaluation and Technical Assistance Center (ETAC) University of California, Los Angeles

Purpose Recap, solidify timelines, address issues related to assessment tools Multi-site evaluations (ACASI surveys) Baseline Six-month Intervention exposure REDCap Backend data Medical chart data Costing information

Multi-site evaluation (ACASI) Baseline In the field Chance for commentary in a few minutes Six-month First draft presented this afternoon (open forum) Further discussion during future webinar ETAC deliverable: 6M ACASI ready February, 2017

Multi-site evaluation (ACASI) Assessment schedule Recruitment / enrollment began Oct 2016 Time points: Baseline, 6, 12, and 18 months) up to 18 months Follow-up scheduling Ideal: one month before / after designated follow-up Allowable: 2 weeks before / 4-weeks after designated follow-up Upload to ETAC web portal: weekly for several iterations, then monthly Data collection will end 6 months before the end of the study period (February 2019)

Multi-site evaluation (ACASI) ACASI notes Sites with local evaluations Store local evaluation in same folder as multi-site evaluation if you want interviews to be linked (multi-site evaluation to transition to local evaluation upon completion) MSE MSE Local eval Local eval

Multi-site evaluation (ACASI) ACASI notes Incomplete interviews Normal procedures: End of each day, Rename / move interview data (.QAD file) and move text files of interview responses (.RTF files). Problems related to restarting incomplete interview Renamed / relocated .QAD file: ACASI program will look for .QAD file in original location and with original name. .RTF file in original location: ACASI program will overwrite .RTF file with data from point where incomplete interview is restarted.

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solutions Don’t rename .QAD file that contains incomplete interview. Okay to move at end of day and move back to original location to finish incomplete interview. Move .RTF file for participant with incomplete interview before restarting. You will have two .RTF files for that participant and will need to rename one of them.

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solution example Mon: Complete interview for participant 1 and have incomplete interview for participant 2 At the end of the day, move the .QAD and .RTF files as you normally would but do not rename the .QAD file. Monday .QAD, .RTF files (Don’t rename) 1, 2i

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solution example Tues: Complete interview for participant 3. Participant 2 returns to finish interview. (1) Move the Tues .QAD file but do not rename (can leave .RTF file in place). Tuesday .QAD file (Don’t rename) 3

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solution example (2) Move the Mon .QAD file back to original folder. Complete interview for participant 2. Monday .QAD file 1, 2i

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solution example (3) Rename / move the Mon .QAD and .RTF files (don’t normally rename .RTF files but do so here so one is not overwritten if they are all stored in the same location). Monday .QAD, .RTF files (Rename) 1, 2

Multi-site evaluation (ACASI) ACASI notes Incomplete interview solution example Still Tues: Participant 4 comes in to be interviewed. (4) Move the Tues .QAD file back to original folder. Complete interview for participant 4 so that Tues .QAD file now contains data for participant’s 3 and 4. At the end of the day, follow usual procedures: rename .QAD file and move .QAD / .RTF files. Tuesday .QAD file 3, 4

A Brief History of ETAC Time Year 2 Sept 2016 Oct 2016 Recruitment / baseline data collection began – ACASI, intervention exposure (monthly upload) Feb 2017 6M ACASI ready for sites Mar-April 6M data collection begins Mar 2017 1st backend data upload (monthly) 1st cost data upload (annual, same for all sites) Aug 2017 Year 3 Sept 2017 Oct 2017 1st medical chart data upload (every 6m) Aug 2018 Year 4 Sept 2018

Multi-site evaluation (ACASI) Comments / questions?

Intervention Exposure Human engagement (social media / in-person) Individual encounters with participants recorded daily, either by Using REDCap form provided by ETAC Uploading data from site-specific forms (weekly for a few iterations, then monthly) Same as ACASI upload schedule

Intervention Exposure REDCap data elements for individual encounters Interviewer ID Participant ID Date Type of contact In-person, e-mail, Facebook, text messaging, Kik, WhatsApp, A4A/Radar, Badoo, Grindr, Jack’d, SCRUFF, PHone/voice, other Location of in-person contact (skipped if not in person) Medical office, non-medical office, outside Who initiated contact Staff, participant

Intervention Exposure REDCap data elements for individual encounters Total # of messages sent today Total # of messages received today Topics discussed Regular check-in, following up on previous conversation, appointment reminder, missed appointment, retention in care, viral suppression Prescription reminder, medication adherence Participant seeking information, problem-solving / overcoming barriers to care, utilization of support services, health literacy, skills building, social support, enrollment in project, other Other notes

Intervention Exposure Comments / questions?

Intervention Exposure Social media component Personalized Backend data Entire sample (not personalized) Partly captured by typology ETAC will need short write-up on details for publication e.g., How many messages were sent on a daily basis, etc.

Backend Data Client Platform (App / website) Site Date Participant ID Sender (Provider vs client) Recipient (Provider vs client) Content Healthscore Platform (App / website) Time log - # times logging in Deletion of app Wish list ETAC realizes backend data will vary across sites. We welcome additional variables not listed here.

Backend Data Activities Time spent in app / site Number of activities engaged in on app / site Time spent in each activity # hits per function / page # posts (activity in social part of app / site) # private messages (activity in social part of app / site) Reminders confirmed / ignored

Backend Data Next steps / deliverables January 2017 Sites to finalize what data can be collected / shared with ETAC March 2017 Begin uploading backend data through ETAC web portal (weekly for a few iterations, then monthly) Same as ACASI / individual participant contact upload schedule

A Brief History of ETAC Time Year 2 Sept 2016 Oct 2016 Recruitment / baseline data collection began – ACASI, intervention exposure (monthly upload) Feb 2017 6M ACASI ready for sites Mar-April 6M data collection begins Mar 2017 1st backend data upload (monthly) 1st cost data upload (annual, same for all sites) Aug 2017 Year 3 Sept 2017 Oct 2017 1st medical chart data upload (every 6m) Aug 2018 Year 4 Sept 2018

Backend Data Comments / questions?

Costing Annual cost of planning and implementation of demonstration site interventions including: Infrastructure (facility costs) Capital investment (one-time costs) Recurring costs Personnel All costs reported separately by funding source SPNS versus non-SPNS funds Local / cross-site evaluation costs not included in the cost of demonstration site intervention implementation

Costing A little more on each costing category Infrastructure (facility costs) Facility space (square footage) and rental cost, space allocation for project Capital investment (one-time costs) ≥ $100 and expected to last longer than a year Description, Date acquired, how (purchased, rented, free), new / used, item value, price paid Recurring costs Description, average price per month or unit, quantity purchased, total amount

Costing Further details during future webinar A little more on each costing category Personnel Initials, job title, salary+benefits, hours on project Hours broken down by Time period (pre-implementation, implementation, management / oversight / other activities) Activity (community engagement, testing, patient navigation, case management) Intervention target (identification, linkage, retention, etc.) Further details during future webinar

Costing Web portal upload schedule (same for all sites) Costing data Annually one month after FFR FFR due Jan 31 Begin: March 2017 End: March 2019 (Year 4) Costing data Entered into forms to be provided by ETAC

A Brief History of ETAC Time Year 2 Sept 2016 Oct 2016 Recruitment / baseline data collection began – ACASI, intervention exposure (monthly upload) Feb 2017 6M ACASI ready for sites Mar-April 6M data collection begins Mar 2017 1st backend data upload (monthly) 1st cost data upload (annual, same for all sites) Aug 2017 Year 3 Sept 2017 Oct 2017 1st medical chart data upload (every 6m) Aug 2018 Year 4 Sept 2018

Comments on costing data?

Medical Chart Data Abstraction Abstraction of routinely collected data from: HIV testing Patient care HRSA Ryan White Services Report (RSR) Variables based on prior SPNS initiative Variables should be available for extraction from patient data ETAC to finalize variable list by Dec, 2016

Medical Chart Data Abstraction Web portal upload schedule (every 6m) Begin: 6m after 1st 6m of recruitment e.g., Begin recruitment Oct, 2016 → upload Oct, 2017 Every 6m after that through Feb 2019 (Year 4) Data options Abstract data directly from medical files and upload Sites needs to ensure that list of requested variables are contained in data file Data entry in ETAC forms

A Brief History of ETAC Time Year 2 Sept 2016 Oct 2016 Recruitment / baseline data collection began – ACASI, intervention exposure (monthly upload) Feb 2017 6M ACASI ready for sites Mar-April 6M data collection begins Mar 2017 1st backend data upload (monthly) 1st cost data upload (annual, same for all sites) Aug 2017 Year 3 Sept 2017 Oct 2017 1st medical chart data upload (every 6m) Aug 2018 Year 4 Sept 2018

Medical Chart Data Abstraction Comments / questions?

Final comments / questions? Thank You Final comments / questions?