Evaluation of the Indianapolis, Indiana September 2002 – August 2003 Stamp Out Syphilis Coalition

Evaluation Methodology Participatory session with coalition members to determine key questions. Interviews with key informants / stakeholders Survey of coalition members Focus groups (2): social service professionals / coalition members Attendance records Capacity-building session

What made the evaluation successful? Questions were developed and prioritized by members of the coalition. Evaluation team members contributed qualitative, quantitative, and coordination expertise. Data were collected from multiple sources, enabling triangulation. Use of third-party evaluation team working together with internal leaders and stakeholders.

What challenges were encountered? More interviews were needed with stakeholders who were instrumental in the initial stages of the coalition. Focus group of social service professionals was compromised by the scope of the participants who attended. Attendance data provided a somewhat limited view of coalition involvement. Internal evaluation capacity-building was difficult to coordinate. More time needed for stakeholder feedback following data collection and prior to the generation of the final report.

How did the evaluation improve the program? Increased rigor of goal measurement (including baselines, projections, target dates, indicators, and quarterly reporting protocols) Additional marketing efforts designed to communicate successes of the coalition on multiple levels. Increased outreach efforts intended to update key stakeholders in the community on the status of syphilis in the community and the related efforts of the coalition.