1. Context Evaluation knowing the setting Context Evaluation knowing the setting

2. How Different Can Schools Be? What factors would you want to consider? What factors would you want to consider?

3. How Different Can Schools Be? Student / Family Population Student / Family Population –Linguistic / Cultural Diversity –Special Needs Children –Poverty Status Community Support Community Support Funding / Resources / Facilities Funding / Resources / Facilities Management / Climate / Support Management / Climate / Support Teaching Staff Teaching Staff

4. Context Impacts Evaluation How can context impact program implementation? How can context impact program implementation? How can context impact choice of evaluation activities? How can context impact choice of evaluation activities? How can context impact program effectiveness? How can context impact program effectiveness?

5. CIPPI Model Context Context Input Input Process Process Product Product Impact Impact The goal is to make INFORMED judgments about Program merit or value. The goal is to make INFORMED judgments about Program merit or value.

6. The Nature of Evaluation Tasks The goal is to make INFORMED judgments about Program merit or value. The goal is to make INFORMED judgments about Program merit or value. Making judgments requires good interpretation skills. Making judgments requires good interpretation skills. As with all interpretive tasks, Context is King. As with all interpretive tasks, Context is King.

7. Context Evaluation The central task in a Context evaluation is the development of a thorough understanding of the setting within which the Program operates and the conditions under which the treatment is delivered. The central task in a Context evaluation is the development of a thorough understanding of the setting within which the Program operates and the conditions under which the treatment is delivered.

8. Evaluation Strategies Key Informant Interviews Key Informant Interviews Site Visits Site Visits Records Review Records Review

9. Initial Questions What is the mission of the Program? What is the mission of the Program? What long-term and mid-term goals has the Program set for itself? What long-term and mid-term goals has the Program set for itself? What specific objectives is the Program trying to meet? What specific objectives is the Program trying to meet?

10. Target Population Who are the intended beneficiaries, or target population, of the Program? Who are the intended beneficiaries, or target population, of the Program? What are their needs? What are their needs? Has the program done any formal needs assessment? Has the program done any formal needs assessment?

11. Stakeholders Who are the stakeholders of the Program? Who are the stakeholders of the Program? What are the attitudes and expectations of stakeholders? What are the attitudes and expectations of stakeholders? How do the stakeholders feel about the evaluation of the program? How do the stakeholders feel about the evaluation of the program?

12. Stakeholders Describe the relationship between the Program and the stakeholders. Describe the relationship between the Program and the stakeholders. Describe any other relevant facets of the Program’s external relations and reputation in the community. Describe any other relevant facets of the Program’s external relations and reputation in the community.

13. Program Needs What needs does the Program have? What needs does the Program have? Does the Program have the resources it needs to deliver the intended services? Does the Program have the resources it needs to deliver the intended services?

14. Program Needs What barriers does the Program face in attempting to meet: What barriers does the Program face in attempting to meet: –its objectives? –the needs of the target population?

15. Audience for the Evaluation Who are the stakeholders of the evaluation? Who are the stakeholders of the evaluation? What decisions will be based on the results of the evaluation? What decisions will be based on the results of the evaluation?

16. Program History and Structure Describe the funding, governance, and management structure of the Program. Describe the funding, governance, and management structure of the Program. Are there Agency / Program / Organizational policies that might impact the success of the Program? Are there Agency / Program / Organizational policies that might impact the success of the Program?

17. Program History and Structure What is the history of the Program? What is the history of the Program? What community / political / social conditions have influenced the Program in the past? What community / political / social conditions have influenced the Program in the past?

18. Document Cooperation Evaluate the cooperation of the Program throughout the context evaluation process (i.e. access to documents, stakeholders, data sources, etc.). Evaluate the cooperation of the Program throughout the context evaluation process (i.e. access to documents, stakeholders, data sources, etc.).

19. Conclusion Given all of the contextual information you have been able to obtain, does the Program have a reasonable chance to succeed? Given all of the contextual information you have been able to obtain, does the Program have a reasonable chance to succeed?