Complementing Routine Data with Qualitative Data for Decision Making: Understanding the "Why" Behind Program Data Day 1 - Session 1 Note to Facilitator: If the group is unfamiliar with MEASURE Evaluation, be sure to briefly explain MEASURE Evaluation to the group – “USAID’s primary vehicle for supporting monitoring and evaluation of public health programs worldwide” – and briefly describe its focus on trying to improve the use of that information in programmatic decision making o improve services offered to beneficiaries. This is also the time to acknowledge anyone who has helped with coordinating the workshop logistics and the organization sponsoring the workshop and/or workshop participants. This workshop was developed based on field experiences where decisions are often made based on anecdotal evidence or “gut” instincts. In some cases, no data at all are reviewed, in other cases M&E data are reviewed in light of other data, but often questions still remain to truly understand why the program is not meeting its objectives. This workshop will help individuals know when they need to collect additional data, particularly qualitative data, and how to collect, analyze, and use those data for programmatic improvements. This workshop is geared toward public health/clinic staff working at the national or district level/government or NGO/private sector. It is appropriate for program officers, leaders, M&E officers, and others involved in public health programs.

Introductions Let’s take a minute to introduce ourselves – please say your name, position, organizational affiliation, and one thing you hope to get out of this workshop.

Workshop Objectives Understand when to consider other data to further understand program performance Identify qualitative data collection methods appropriate for answering questions about program performance Build skills in collecting, analyzing, and interpreting primary qualitative data with a specific focus on in-depth interviews Build skills in applying qualitative findings to program improvements By the end of this session, the learner will be able to:

Workshop Design Understand key steps for collecting and analyzing information to understand program performance. Provide an overview of qualitative methods and experience developing questions, collecting primary data, and analysis . It is NOT a comprehensive course in qualitative research methods. Note to Facilitator: Review workshop design

References Aujoulat, I., Luminet, O., Deccache, A. Jack, S.M. MacLean, L., Meyer, M., Estable, A Maman, S. Ryan, G.W. & Bernard, H.R. Sandelowski, M. Spradley, J. Ulin, P.R., Robinson, E.T., & Tolley, E.E. Note to Facilitator: Mention the references that were used in the development of the material.

Agenda Overview Day Session Day 1 Session 1: Overview Session 2: Using Data to Improve Programs Session 3: Conduct Further Research Day 2 Continued – Session 3: Conduct Further Research Session 4: Planning for Qualitative Data Collection Session 5: Study Implementation Day 3 Session 6: Data Management and Analysis Day 4 Session 7: Making Data-informed Programmatic Decisions Note to Facilitator: Go over the agenda and make any necessary logistics announcements.

Workshop Methods Plenary presentations Group discussions Small group work The workshop will use a variety of methods to engage participants – it is heavily dependent on learner participation, and sharing of examples and perspectives. For a successful workshop, we need a commitment from everyone to participate and share the wealth of experiences you have in your field.

Housekeeping and Ground Rules Breaks Keeping to the agenda Cell phones turned off Full participation Others? Note to Facilitator: Ask participants to set the ground rules for the training (i.e., no cell phones, take turns speaking, etc.). Ask participants to list their expectations for the training. List these expectations on flip chart paper. When finished, post expectations on the wall. Make sure the expectations remain posted throughout the duration of the workshop.

Activity 1: Individual Pre-test Please fill out Activity 1: Individual Pre-test and return to the facilitator Note to Facilitator: Pass out a copy of Activity 1: The Individual Pre-test. Ask participants to take a few minutes to fill it out. Note that each participant will be asked to complete an evaluation form at the end of the training but that comments, thoughts, and suggestions are welcome throughout the workshop — either one-on-one during a break or at the beginning or end of the day during feedback sessions.

MEASURE Evaluation is funded by the U. S MEASURE Evaluation is funded by the U.S. Agency for International Development (USAID) and the U.S. President's Emergency Plan for AIDS Relief (PEPFAR). Views expressed in this presentation do not necessarily represent the views of USAID, PEPFAR or the U.S. government. MEASURE Evaluation is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill in partnership with Futures Group, ICF International, John Snow, Inc., Management Sciences for Health, and Tulane University.