Ricardo Furman Senior Evaluation Officer- Geneva Factors to consider in Independent evaluations from ILO-IPEC experience in Latin America… Ricardo Furman Senior Evaluation Officer- Geneva __________________________ International Labour Organization   EIA Evaluation and Impact Assessment Section International Programme for the Elimination of Child Labour (IPEC)

Working in Child labour elimination…

Child Labour concept Work that deprives children of their childhood, their potential and their dignity and that is harmful to physical and mental development. It refers to work that is mentally, physically, socially or morally dangerous and harmful to children and interferes with their schooling.,

International Programme for elimination of Child Labour-IPEC Objective: effective abolition of child labour (as defined by States and ILO) A rights-based decent work approach to economic and social development ILO Conventions: 138: minimum age for employment for children 182: worst form, of child labour not allowed for all children

IPEC multi-strategy approach Assist countries, through concrete actions/ advice, in enhancing awareness of all stakeholders, to implement international labour standards on child labour in a sustained manner National Action Plans act as the political frameworks that encompass the whole range of activities towards child labour elimination

Strategic activities: Legal framework and enforcement National capacities development, policies and mainstreaming Supporting workers and employers organizations in the “real economy” Direct action (livelihoods and social services) Research, data collection and analysis Advocacy, awareness raising and social mobilisation Evaluation and Impact Assessment

The independent mid-term and final evaluation process

A highly consultative process… Preparation of TORs: stakeholders are asked for inputs and potential evaluators. Draft TORs prepared by EIA and 2nd opportunity to provide comments Evaluation field phase: leaded by evaluation team Stakeholder workshop at national level (if possible also at subnational levels) at end of the field phase

… a highly consultative process Preparation of evaluation report: stakeholders revise the draft for comments (for the final version) Post-evaluation workshop ( report finalised and circulated): national and local stakeholders leaded by national government to discuss implementation of evaluation recommendations. Management response to the evaluation report by project team Promote the use of evaluation report by reflecting it in new project design, good practices, etc.

Some reflection on our experience with independent evaluations

Reflections I Not all stakeholders understand how to get involved in an evaluation process: how their voices can be heard There are various opportunities in preparation, implementation, and reporting, and even post reporting phases. Still more support is required to build an evaluation culture in all stakeholders for active inclusion (macro initiatives in LA are ongoing)

Reflections II There are difficulties to capture the project development and results from government stakeholders due to their high turnover: A factor to consider when selecting persons to interview, schedule evaluation and presenting the data in the evaluation report. On going systematization could mitigate this fact.  This reminds that the evaluation is not only a technical process, but also a political one.

Reflections III Projects have limited capacities to demonstrate credible and rigorous evidence of outcomes and impacts Theory-based approach evaluations have been used in IPEC to establish judgement by evaluators While methodologically valid, not all stakeholders find it enough solid to named credible IPEC answer has been to develop Integrated/ Comprehensive M&E Strategies to contribute to credible evaluations

Reflections IV Evaluation of multi-country projects require a specific methodology because are more complex projects or programmes There is a trend in donors to focus more on this type of project Specific evaluation methodologies has to be developed within the independent evaluation model Complexity has to be internalised by donors (including increase of budget)

__________________________ International Labour Organization   Thank you! For additional information, please contact: Ricardo Furman Evaluation and Impact Assessment Section of IPEC furman@ilo.org