1. Agenda Paper 2. What is a literature review? Logframes and program theory Logframes exercise Designing an evaluation exercise. Many thanks to Analia Jonovich, a previous TF for this course, for designing this logframes and evaluation exercise.

2. From paper 1 to paper 3… Paper 1 Identify problem Describe problem in context Paper 2 Literature review: understanding the causes for your problem and/or why some solutions seem to work Paper 3 Provide specific solutions (policy or program)

3. What is a literature review? Select a topic, and within that topic, a question you would like to answer. Synthesize the body of research that you have reviewed, not each paper individually. What elements do they have in common, i.e., results, conclusions, implications? What elements do they have that are disparate? What overall conclusions can you make from this review of the research in relation to your question/topic? What implications do these conclusions have for policy in general? And for the specific context that you have chosen?

4. What paper 2 IS NOT… A paper comparing two countries A paper comparing data about your problem across different contexts A more detailed description of your problem A summary of the research done in some area In paper 2 we compare research to answer a question

5. Logical frameworks… From: The World Bank: http://www.wau.boku.ac.at/fileadmin/_/H81/H811/Skripten/811332/811332_G3_log-framehandbook.pdf

6. Program theory… Increased student achievement Teacher salaries increase ? ?

7. Program theory… Teacher salaries increase Teachers work harder and prepare better for classes Student’s understanding of material improves Increased student achievement Abler teacher teach more effectively Teacher morale improves Abler people are attracted into teaching School districts hire abler teachers ?

8. Program theory… Teacher salaries increase Teachers work harder and prepare better for classes Student’s understanding of material improves Increased student achievement Abler teacher teach more effectively Teacher morale improves Abler people are attracted into teaching School districts hire abler teachers

9. Program theory… Teacher salaries increase Teachers work harder and prepare better for classes Student’s understanding of material improves Increased student achievement Abler teacher teach more effectively Teacher morale improves Abler people are attracted into teaching School districts hire abler teachers

10. Program theory... And Logical Frameworks Impact Outcome Output Impact Outcome Output

11. Narrative SummaryPerformance Indicators M&E / SupervisionImportant Assumptions Goal: What is the overall, supergoal? -how will we know it’s been achieved? -what evidence will we use, and who is responsible for collecting/ evaluating the evidence? -What are the risks regarding the strategic impact? D.O. -What assumptions must hold true in order to reach this goal? Outputs: Components: Program theory... And Logical Frameworks ? ? ? Consider filling in the narrative summary first (top to bottom), then the assumptions (bottom to top), then the indicators and M&E.

12. Narrative SummaryPerformance Indicators M&E / SupervisionImportant Assumptions Goal: Increased student achievement - Student knowledge, skills, attitudes will increase (including higher order skills) -systematic program evaluation that links motivation to achievement -Risks: will there be a long- term impact? -Would the increases need to continue forever? -undermining teacher intrinsic motivation? -cheating? Objective: More effective student learning – more quickly and to a higher level - Student test scores will increase - Create a testing instrument or find an existing measure (+.25 SD from baseline); school admin, teachers, external testing system -That teachers could increase student learning, with an increase of salary (motivation) - have control over student learning (even in spite of motivation) Outputs: teacher salary will increase - Teacher payroll will increase by -Audit payroll office; internal and external - +10% -schools can make decisions -Other budgetary concerns are met (city, county level) -union agreement Components: More funds available to the schools - %change in school budget -school budget = +10%; audit; internal/external -schools can make decisions about salaries -community will bear more taxes -HR procedures in place to hire Program theory... And Logical Frameworks

13. Logical Framework Activity Develop your own logical framework for the PIIE? What is the program theory supporting this program? Is there more than one “program theory” here?