1. HOUSEKEEPING
All participants are automatically muted by webinar administrators.
Please type any questions using the Chat feature.
This Webinar will be recorded and posted on websites of the participant CBA programs.

2. THIS WEBINAR IS PART OF THE GRANT WRITING PREPAREDNESS SERIES
CO-HOSTED BY:
SHARED ACTION,
AIDS PROJECT LOS ANGELES
CAPACITY FOR HEALTH,
ASIAN AND PACIFIC ISLANDER
AMERICAN HEALTH FORUM
CA STD/HIV PREVENTION
TRAINING CENTER

3. TODAY’S WEBINAR: Shared Action at AIDS Project Los Angeles,
WAS DEVELOPED BY:
Shared Action at AIDS Project Los Angeles,
a Capacity Building Assistance Program, in Los Angeles

4. WHO WE ARE:
We are funded by The Centers for Disease Control and Prevention (CDC) to provide FREE trainings and one-on-one technical assistance for community-based organizations (CBOs) on:
Organizational Infrastructure and Program Sustainability,
Evidence-Based Interventions (EBIs) and Public Health Strategies, and
Monitoring and Evaluation.

5. DEVELOPING EVALUATION PLANS
Andi Zaverl
Experience:
CBA Evaluation Specialist
Education:
Claremont Graduate University
Chapman University

6. Developing an Evaluation Plan
This Webinar will be recorded and made available through our websites along with copies of the slides

7. LEARNING OBJECTIVES By the end of this Webinar, participants will:
Be able to explain the importance of developing an Evaluation Plan.
Be able to identify the 5 key elements to include in an Evaluation Plan.

8. What is an Evaluation Plan?
An Evaluation Plan is a written document that outlines policy and procedure on how each of your objectives (outcome and process) will be evaluated to ensure that your program’s goal is met.

9. What’s the Purpose? 6. Monitoring and Evaluation
Develop a Monitoring and Evaluation Plan- Funded applicants must work with CDC to develop and implement a process monitoring plan and conduct routine monitoring and evaluation for each intervention and/or service they provide. For applicants that are selected for funding, CDC will provide a template and technical assistance for developing a process monitoring plan at the time of award. At a minimum, the monitoring plan will include the following:
Program goals and measurable objectives.
Activities that will be conducted to meet the objectives.
Data collection plans, proposed staffing, timelines, and tools.
How data will be used, by whom, and when to measure progress towards meeting objectives.
Procedures to ensure that data quality and security are consistent with CDC guidelines.

10. Purpose Other than being required:
Increases efficiency of the evaluation.
Ensure evaluation is planned from the beginning.
Reduces duplicate work.
Increases use of evaluation findings.

11. Evaluation Plan Elements
Description of your program (e.g. background, design)
Purpose of the Evaluation
Objectives, Indicators, Logic Model
Evaluation Methods
Report and Information Transfer

12. An Example Intervention:
Community Promise:
Community Level Intervention
Uses Peer Advocates and Role Model Stories to diffuse HIV Prevention information to persons at risk.

13. Evaluation Plan Elements
Description of your program (e.g. background, design)
Purpose of the Evaluation
Objectives, Indicators, Logic Model
Evaluation Methods
Report and Information Transfer

14. I. Description of your program
Brief description of:
Type of Intervention
Target Population
Geographical Coverage
Goals

15. II. Determining the purpose
What is the primary purpose of the evaluation?
Who is most likely to need and use the information obtained?
How will the information be used?

16. III. Objectives, Indicators and Logic Model
List of Process and Outcome objectives
Process Objective
Outcome Objective:
List of Indicators: expected outcomes

17. Performance Indicators
Indicator Year 1 Year 2 Year 3
 Knowledge 10% 15% 15%
 Retention 70% 75% 80%

18. IV. Evaluation Methods
Gather data
Analyze
Use findings

19. Methods- Collecting Data
Variables (e.g., demographics, KABB, participation, marketing)
Data collection methods
Formative evaluation/Community Assessment: Literature review, existing data, focus groups, interviews
Process and Outcome monitoring: Sign-in sheets, risk-assessments, pre and post, follow-ups, behavioral commitment forms, etc.
Paper or computer-based
Describe

20. For Example:
By December 31, 2011, the program staff will recruit 50 African American MSM at high risk for HIV to participate in HIV 101 workshop.
The program staff will collect data from the participants on age, gender, ethnic background, sexual behavior and place of recruitment.

21. Methods- Collecting Data (cont’)
Staffing Pattern:
Personnel involvement in the evaluation
Qualification skills
Resources:
Hardware and software
Confidentiality/Protection
Special infrastructure needs

22. Methods-Analysis Data management Statistical analysis Organizing data
Transforming data to electronic base
Storage of data
Statistical analysis
Description of statistical processes (e.g., frequencies, tables, special statistics)
Triangulation

23. V. Report
Description of how the findings will be presented to the funders and opportunities to diffuse the information to other stakeholders.

24. Evaluation Plan Remember to include:
Program Description (e.g. background, design)
Purpose of the Evaluation
Objectives, Indicators, Logic Model
Methods (e.g. variables, collection methods)
Report
Add examples maybe?
Background and Logic Model
brief description of the history and current status of the program as well as of the logic model, which is a simple desciption of how the activities carried out within the program are related to the expected outcomes.
Purpose of the Evaluation
Evaluation Questions
The specific questions the evaluation will answer. Such questions should be closely aligned with the evaluation purposes,
Evaluation Methods
Overall design strategy to answer the evaluation questions, including a plan to collect and analyze data.
Team Composition and Participation
Procedures and Logistics
Specify the various procedural requirements of evaluation, including evaluation activities at the project level, the general schedule - duration, phasing and timing considerations
Reporting and Assuring Use
Budget

25. Evaluation Plan for this Grant Proposal
Describe the applicant’s goals for development and implementation of enhanced HIV testing.
Provide objectives, a list of minimum steps to achieve objectives
Describe how and at what point data collection will occur.
Describe how monitoring and evaluation data will be used, by whom, and when.
Describe how any technical assistance needs associated with meeting program monitoring and reporting requirements will be identified and met.

26. Evaluation Plan Template
Question
Indicators
Data Sources/
Methods
Person Responsible
Timeline 1. 2. 3.

27. Evaluation Plan Template
1.Focus
What will we evaluate (which program or aspect of a program)?
2. Questions
What do you want to know?
3. Indicators-Evidence
How will we know it?
4. Timing
When should we collect data?
5. Data Collection
Sources
Who will have this information?
Methods
How will we gather the information?
Sample
Who will we question?
instruments
What tools shall we use? 1. 2. 3. 4. a. b. c.

28. Evaluation Plan Template
6. How will the data be analyzed?
7. How will the data be interpreted?
8. How will the results be communicated?
To Whom
When? Where? How?

29. Evaluation Plan Template

30. Conclusions Remember: Always check with funder for their requirements.
Be as thorough as possible.
Evaluation plan ensures a more effective evaluation.

31. Any Questions?
Thank You!

32. Additional Resources
Slides and a recorded version of this webinar will be available on the following websites:
-AIDS Project Los Angeles- Shared Action -Capacity 4 Health, APIAHF -CA STD/HIV Prevention Training Center
Contact us for individualized capacity building assistance