Public Policy Evaluation Office National Department of Planning Executive Evaluation E2 Public Policy Evaluation Office National Department of Planning

Comparison with other well known methodologies Impact Primary data Source: final beneficiary Counterfactual scenario Allow to attribute impacts on final beneficiaries Robustness Highly demanding of time and $$ E2 Secondary data Sources: documents and key actors Give order and establishes relations between design, operative structure, inputs, outputs, and outcomes It concentrates in operative issues Don't establish cause effects relations Results Primary and secondary data Sources: Mixed Establishes outputs, outcomes in the short, mid and long time Rebuild the value chain Analyze goals and sustainability of achievements Don’t analyze operations neither allow to attribute cause effects relations Information Process Strengths Weaknesses

Pacific Plan Program Example E2 Results evaluation To analyze information use and produced To analyze focalizations tools To evaluate core and support processes To evaluate project selection criteria To identified and evaluate supervision mechanism and project monitoring To determine national policy coordination mechanism To produce adjust plans E2 Results evaluation Pacific Plan Program To determine socioeconomic changes in population To evaluate institutional capacity changes To evaluate beneficiaries perception of actions or results To evaluate goals accomplishment and logic frame Ti verified facilities and its sustainability

e2 e2 Analytical framework SINERGIA Evaluación de Programas Gubernamentales - EPG CHILE Budgetary constraints and complexities Information problems e2 design with wide participation of experts. Pilots in different sectors and government levels. Adjust and reinvention. SINERGIA Diagnosis process e2 Absent of evaluations and problems with those existents Program Assestment Rating Tool Review – PART USA

E2 Questions Target Users Need to know in a short time why a program is not working properly ? Need to have a reference to evaluate the program in the future? Programs Managers Planning Offices Need to order Program information and processes? E2 Produce standard and comparable information among programs Allows to evaluate a major number of programs that need analysis Intersectorial Evaluation Comite Support redesign processes and realignment of strategies, and budgetary decisions

Methodological approach Theoretical Model Logic Frame Program Cycle Processes

Information si no Qualification Criteria 1 a 4 or yes / no Description based on documental information. DESK REVIEW Rebuild missing information using other sources. Field work no ¿Is internal information enoughtto describe the program? si Description complete Program evaluation Qualification Criteria 1 a 4 or yes / no

Evaluation topics Strategic design Operations management Inputs Institutional framework Strategic management, monitoring and evaluation Results Inputs

Turns into standard indicators by topics Evaluation process Turns into standard indicators by topics

Standard indicators

Information analysis Information is: Disposable Up to date Timely Complete Information quality about design

Products Description (Logic Frame) Evaluation Information Check Box Conclusions, global diagnosis, and adjusts plans.