Isabel Vogel for ESPA. Isabel Vogel for ESPA, 24 January 2012 What is theory of change? Structured technique for understanding how and why a programme.

Slides:

Advertisements

Similar presentations

Tools for Policy Influence. RAPID Programme SMEPOL, Cairo, February, Practical Tools.

Advertisements

Making it work: co-producing impact evaluation. Professor Imogen Taylor Department of Social Work and Social Care.

Outputs, outcomes and impacts Using Theory of Change to plan, develop and evaluate your initiative.

Outcome mapping. Outcome Mapping Developed by the evaluation unit of Developed by the evaluation unit of

Making Evidence-Based Education Policy Ontario Research Chairs in Public Policy Symposium Carol Campbell Ontario Institute for Studies in Education, University.

What You Will Learn From These Sessions

Assessing the Impact of Socio-Economic Sciences and Humanities: Perspectives from the UK Irene Hardill, Professor of Public Policy, Northumbria University,

Measuring policy influence: like measuring thin air? John Young:

Evaluating Collaboration National Extension Family Life Specialists Conference April 28, 2005 Ellen Taylor-Powell, Ph.D. Evaluation Specialist University.

Good Evaluation Planning – and why this matters Presentation by Elliot Stern to Evaluation Network Meeting January 16 th 2015.

Role of RAS in the Agricultural Innovation System Rasheed Sulaiman V

UKCDS/DFID/IDRC Workshop: Evaluation of Research Impact Margaret Macadam, Principal Impact Evaluation Manager, ESRC.

1 Theory of Change Chesapeake Bay Funders Network Program Evaluation Training Workshop OMG Center for Collaborative Learning January 9-10, 2008.

Dissemination pathways Science and policy

Landscape functions and people Bangkok, October 2009 Collaborative learning.

Knowledge Translation: A View from a National Policy Perspective KU-02 Conference Oxford, England July 2, 2002.

Action Planning Guidance Illinois Public Health Institute.

Urban-Nexus – Integrated Urban Management David Ludlow and Michael Buser UWE Sofia November 2011.

Impact on the research dance floor Line dance, tango or ceilidh? Drs. Astrid Wissenburg Economic and Social Research Council / Research Councils UK.

Paper Title: “The influence of gender in the relation between Participatory Monitoring and Evaluation, and Citizen Empowerment” Conference Paper by: Kennedy.

Lessons from RAPID’s work on research-policy links John Young.

(c) 2014 Michael Sikes, Ph.D. Theory of Change: Bridging Ideas, Actions, and Results Michael Sikes, Ph.D. (805)

1 OPHS FOUNDATIONAL STANDARD BOH Section Meeting February 11, 2011.

Canadian Cancer Society Manitoba Division: Knowledge Exchange Network (KEN) & CancerCare Manitoba Manitoba Integrated Chronic Disease Primary Prevention.

Assessing the impact of research and KTE activities Sandra Nutley.

Contribution Analysis: An introduction Anita Morrison Scottish Government.

Measuring and Improving Practice and Results Practice and Results 2006 CSR Baseline Results Measuring and Improving Practice and Results Practice and Results.

Impact evaluation: External and internal stakes Impact evaluation seminar - 2 to 6 December, Phnom Penh.

Why Theory Matters Jackie Green

Logic Models and Theory of Change Models: Defining and Telling Apart

Boston Geneva San Francisco Seattle Beginning the Evaluation Journey with FSG KCIC Boot Camp March 24, 2010 Prepared for:

RAPID Outcome Mapping Approach Simon Hearn, ODI 16 April 2010 Bern, Switzerland.

Tony Karbo, Ph.D. AHSI/UPEACE Africa Program.  Action or inaction taken by interested entities such as NGOs, Think Tanks, government departments, ministries,

Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.

Integrating Knowledge Translation and Exchange into a grant Maureen Dobbins, RN, PhD SON, January 14, 2013.

International Health Policy Program -Thailand Reflection on experience in using JANS with sector strategy Phusit Prakongsai, MD. Ph.D. International Health.

Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program Chad Green, Program Analyst Lynn McNally, Technology Resource Supervisor.

School Improvement Partnership Programme: Summary of interim findings March 2014.

The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.

Regional Educational Laboratory at EDC relnei.org Logic Models to Support Program Design, Implementation and Evaluation Sheila Rodriguez Education Development.

 Welcome, introductions  Conceptualizing the evaluation problem  stakeholder interests  Divergent and convergent processes  Developing evaluation.

Hosted by: Funded by: Research into Reality Overcoming the challenges of knowledge exchange Foundation for the Future Research Conference 26 th – 28 th.

Sharing experience on research uptake: a funder’s perspective Nina Marshall Deputy Head, International Development Research Team, ESRC.

Thinking about research impact contributing to society and the economy Tara Fenwick (reflecting ESRC influence but not representing it!)

Preparing proposals for funding RIMC Research Capacity Enhancement Workshops Series : “Achieving Research Impact”

REFLECTION ON BEST PRACTICES AND SCALING-UP MULTI- RELIGIOUS ACTION Sarajevo, Bosnia | July 24-26, 2015.

Transforming Patient Experience: The essential guide

Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.

Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher

Evaluation design and implementation Puja Myles

The Ohio STEM Learning Network: A Study of Factors Affecting Implementation Spread and Sustainability.

 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.

Outcomes Focused planning NHS Health Scotland

Influencing Policy through Research: Introduction to Principles and Tools Arnaldo Pellini:

Theory of change: ‘Description of a sequence of events expected to lead to a particular desired outcome’, Rick Davies For whom? Defined by whom? Significant.

Capacity Development Results Framework A strategic and results-oriented approach to learning for capacity development.

Presentation By L. M. Baird And Scottish Health Council Research & Public Involvement Knowledge Exchange Event 12 th March 2015.

Department of Social Development National Conference Early Childhood Development Conference “Tshwaragano Ka Bana” 29th March 2012 The National Integrated.

Implementation Science: Finding Common Ground and Perspectives Laura Reichenbach, Evidence Project, Population Council International Conference on Family.

Renewing our focus on Impact Becky Murray Nairobi, 15 March 2016 Twitter: #impactafrica.

Monitoring and Evaluating Rural Advisory Services

Workshop to develop theories of change

Monitoring and Evaluating Rural Advisory Services

Capacity Development in GLDC

Claire NAUWELAERS, independent policy expert

Logic Models and Theory of Change Models: Defining and Telling Apart

Evaluating support to capacity development

Regulated Health Professions Network Evaluation Framework

Community engagement and co-design

INTERMEDIATE OUTCOMES ACTIVE, ENGAGED CITIZENS

Presentation transcript:

Isabel Vogel for ESPA

Isabel Vogel for ESPA, 24 January 2012 What is theory of change? Structured technique for understanding how and why a programme is likely to contribute to long-term change, in the issue context

Freire Examine beliefs about poverty and development Reflect then act 1970s Evaluation, recurring programme failure Carol Weiss, Michael Quinn Patton, Patricia Rogers Critical examination of assumptions about change 1980s Linear logic models? No context, oversimplification Expected and positive changes 2010s Context for change and others active in it What needs to change and why Programme’s contribution Theory of change Isabel Vogel for ESPA, 24 January 2012 Theory of Change: Evolution not revolution

Zoom out… Isabel Vogel for ESPA, 24 January 2012 SITUATIONAL DRIVERSSocio-economic, political,Technological factorsExisting policies,practices, beliefsOther actors in research,policy and practiceCapacity of targetgroups to respondReceptiveness of contextOrganizations,resources,systems, skills MEDIUM TERM CHANGES Indirect influence – policy shapers, knowledge networks, planners, practitioners, stakeholder groups MEDIUM TERM CHANGES Indirect influence – policy shapers, knowledge networks, planners, practitioners, stakeholder groups SHORT-TERM CHANGES What changes, by whom? Direct influence – partners, collaborators, Immediate research users Research programme Quality evidence, capacities, stakeholder engagement Engagement, involvement Capacity to respond Behaviours and practice for change Long-term change or impact for people Adapted from S. Montague, 2002 Awareness, reception of new knowledge

Breaks down change into feasible stages: short-term, medium-term and long-term Critical examination of cause-effect assumptions, research-based change, contextual drivers, collaborators Evidence and reality check strategies and activities Identify intermediate changes and indicators Evaluation questions Impact-aligned research design, research uptake, monitoring and evaluation Isabel Vogel for ESPA, 24 January 2012 How does theory of change help?

Isabel Vogel for ESPA, 24 January 2012 conceptual model of impact feasible research contribution story that can be evidenced sense of purpose and momentum ‘rough guide’ to change that can be revised and adapted as the journey unfolds... Theory of change…

Strategies for enhancing research impact Established relationships and networks with user communities Portfolios of research activity that build credibility and reputation with research users User-engagement and knowledge exchange strategies Developing applications for policy and practice with non-academic partners Working with knowledge brokers as amplifiers and network providers Involving users at all stages with research Good infrastructure, leadership and management support Sources: ESRC Impact work; Nutley et al 2010; health research impact studies Contextual awareness Isabel Vogel for ESPA, 24 January 2012

ESPA Theory of Change: Impact Isabel Vogel for ESPA, 24 January 2012 Boundary where development actors in policy, planning and implementation take over Research evidence taken up and applied

Isabel Vogel for ESPA, 24 January 2012 ESPA ToC: Outcome level User communities? Receptiveness of context? Acceptance of new ideas? Existing practices and beliefs? Policy knowledge network ideas Likely behaviour changes?

Isabel Vogel for ESPA, 24 January 2012 ESPA Theory of Change: Output level Nature of research? User needs and demand? New capabilities needed? Different institutional patterns?