1. Evaluating with Perspective: Mobilizing Community Participation in Program Evaluation …its not too late!

2. Community Based Participatory Research Equitably involves all members (community members, organizational representatives, and programmers and researchers) in all aspects of the program initiative; (assessment, program development, implementation, evaluation, dissemination, funding. Equitably involves all members (community members, organizational representatives, and programmers and researchers) in all aspects of the program initiative; (assessment, program development, implementation, evaluation, dissemination, funding. Enables all partners to contribute their expertise, with shared responsibility and ownership; Enables all partners to contribute their expertise, with shared responsibility and ownership; Integrates the knowledge gained with interventions to improve the health and well-being of community members. Integrates the knowledge gained with interventions to improve the health and well-being of community members.

3. Community members have an extensive set of skills, strengths and resources which can be harnessed to address the social determinants of health and to promote good program outcomes.

4. Evaluation? (CDC Evaluation Workgroup) Engage stakeholders Engage stakeholders Describe the program Describe the program Focus the evaluation design Focus the evaluation design Gather credible evidence Gather credible evidence Justify conclusions Justify conclusions Ensure use and share lessons learned Ensure use and share lessons learned

5. Who are the stakeholders? Modified from CBPR Toolkit (Cassandra Ritas) Unconcerned Interested Invested Impacted Targeted

6. Engage Stakeholders Those who are involved with the development of the program Those who are involved with the development of the program Those affected by the program Those affected by the program Users of the information Users of the information

7. CBPR transitions people from being “affected” by the program to people who are “involved” with the program AND “users” of the data.

8. Community Based Participatory Evaluation: Sharing Power and Privilege Bi-directional Education/training Bi-directional Education/training Sharing culture relevance Sharing culture relevance Giving back to the community Giving back to the community Navigating the “system” Navigating the “system” Confidence in “back-up” support Confidence in “back-up” support

10. Describe Program (relative to Community Based Participatory Evaluation) Discuss need for evaluation Discuss need for evaluation Understand expectations Understand expectations Clearly define Activities/Resources Clearly define Activities/Resources Discuss Stages of Development Discuss Stages of Development Rely on Community Context Rely on Community Context –Who defines “community”? Develop a evaluation logic model Develop a evaluation logic model

11. Evaluation Design Purpose Purpose Discuss who are Users of this information Discuss who are Users of this information Discuss Uses for the evaluation Discuss Uses for the evaluation Address questions ( what we want to know ) about the evaluation Address questions ( what we want to know ) about the evaluation –Ex. Who defines “trauma” and how does it get measured? Identify potential methods/ sampling Identify potential methods/ sampling

12. Gather credible evidence Identify Indicators/Standards Identify Indicators/Standards Identify sources of data collection (sampling methods) Identify sources of data collection (sampling methods) Adapted “Western-based” tools? Adapted “Western-based” tools? Collect quality data Collect quality data Identify effect size Identify effect size Logistics in collection (ex. times, places, literacy levels) Logistics in collection (ex. times, places, literacy levels)

13. Train the community for data collection

14. Interview target and affected communities

15. Justify Conclusions (based on evidence) Previous standards, programs… Previous standards, programs… Analysis/Synthesis Analysis/Synthesis Interpretation Interpretation Judgment/Significance Judgment/Significance Recommendations Recommendations

16. Dissemination of results Include community in decision-making Include community in decision-making Community members to present findings/outcomes to broader community (those impacted/invested/interested) Community members to present findings/outcomes to broader community (those impacted/invested/interested) discuss results with policy makers/funders discuss results with policy makers/funders present at conferences present at conferences

17. Funding Identifying funding sources Identifying funding sources Including community in the next RFP Including community in the next RFP Speaking on behalf of the program at foundations, universities, other “interested” non-profits or for profit organizations. Speaking on behalf of the program at foundations, universities, other “interested” non-profits or for profit organizations.

18. Did the impetus for the programming come from the community? Is attention given to barriers to participation, with consideration of those who have been underrepresented in the past? Can the research facilitate collaboration between community participants and resources external to the community? Do community participants benefit from the research outcomes? Is there attention to or an explicit agreement between researchers and community participants with respect to ownership and dissemination of the research findings? Community-Based Participatory Research: Implications for Public Health Funding Minkler, Blackwell, Thompson and Tamir. (2003) What are funders looking for in Community Based Programs?

19. How do you demonstrate Outcomes for Community Based Participatory Programs? Show demonstrated, measurable outcomes of intentional, directed community participation Show demonstrated, measurable outcomes of intentional, directed community participation Are new community structures or problem- solving mechanisms in place as a result of the project? Have new leaders emerged? Is there evidence of a deeper sense of community ownership or civic participation? Community-Based Participatory Research: Implications for Public Health Funding Minkler, Blackwell, Thompson and Tamir. (2003)