`Show me your impact`: Evaluating historic memory & racism in Guatemala Colleen Duggan International Development Research Centre (IDRC), Canada American.

Slides:



Advertisements
Similar presentations
Theory-Based Evaluation:
Advertisements

Workshop Mapping Estonian Universities Frans Kaiser & Marike Faber, Tartu (Estonia) 21 March 2011.
Awareness and Inclusion: Towards the institutionalisation of SiS Catalyst activities March 4, 2014.
Frameworks for Assessment of Student Learning: Questions of Concept, Practice, and Detail Christine Siegel, Ph.D. Associate Professor of School Psychology.
Teaching inclusively - How can you harness student knowledge and experience? Professor Christine Hockings Xiaogan University transnational.
Effective Teaching Behaviours in Using High Fidelity Simulation
Validation of non formal and informal learning – the case of Portugal Glasgow, 17 May 2012 Elsa Caramujo National Agency for Qualification and Vocational.
Parent teacher evening 20/2/12
GRDG690 Action Research: Literacy Week 3: Methods, Data Collection & Ethics Gloria E. Jacobs, Ph.D.
Project NEStLeD Move Forward VIA University College Project NEStLeD NESTLED (Nurse Educator Simulation Based Learning) Project Leonardo Transfer of Innovation.
Qualitative Data Analysis: An introduction Carol Grbich Chapter 4: Critical Ethnography.
An Overview of the New HCPSS Teacher Evaluation Process School-based Professional Learning Module Spring 2013 This presentation contains copyrighted material.
Brendan Halloran Transparency and Accountability Initiative Beyond Theories of Change: Working Politically for Transparency.
Welcome Maria Hegarty Equality Strategies Ltd. What ? Equality/Diversity Impact Assessment A series of steps you take that enable you to assess what you.
U.S. OFFICE OF SPECIAL EDUCATION PROGRAMS 2009 PROJECT DIRECTOR’S CONFERENCE WASHINGTON, D.C. DONNA M. SOBEL, PH.D. ASSOCIATE PROFESSOR UNIVERSITY OF COLORADO.
Models for Evaluating MSP Projects Evaluation of Professional Development Programs MSP Regional Conference Dallas, Texas February 7, 2007 Norman L. Webb.
Building Capacity in Chinese and Arabic Pam Delfosse World Languages Education Consultant Claire Kotenbeutel Critical Language Fellows Project Consultant.
Step 6: Implementing Change. Implementing Change Our Roadmap.
Teacher Keys Effectiveness System Forsyth County Schools Orientation May 2013 L.. Allison.
Performance Assessments (or PBL) J.H. MacMillan (2011) Classroom Assessment – Principles and Practice for Effective Standards-Based Instruction, 5th ed.,
Performance Assessments. Students construct responses and knowledge Create products, or perform demonstrations to provide evidence of their knowledge.
Supporting voluntary and community action supporting voluntary and community action Measuring Outcomes How do we understand the changes we are making …
1 Assessing for Learning Workshop Presented at CCRI February 23, 2005 Peggy Maki, Ph.D.
The EU – China Mayor’s Forum 19 th September Brussels The importance of cities ‘Investing in Heritage’ as a catalyst for regeneration Brian Smith.
Challenges and Ways Forward Dipta Bhog, Nirantar, A Centre For Gender and Education, New Delhi.
7 th European Feminist Research Conference Utrecht, 4-7 June 2009 GEMIC: A project on Gender, Migration and Intercultural Interactions in the Mediterranean.
Reflection and exchange process Scenario-based method.
The contents of this presentation were developed under a grant from the US Department of Education, #H323A However, these contents do not necessarily.
Impact evaluation: External and internal stakes Impact evaluation seminar - 2 to 6 December, Phnom Penh.
W w w. w e s t o x o n. g o v. u k Sharing the evaluation of an arts based memory club Arts Development UK Conference - 29 Nov 2013 Hannah Cervenka Arts.
Evaluation Team Progress Collaboration Grant 252.
IWMI- Asia Uptake, Priorities and Synergies Farah Ahmed Coordinator for research into Impacts, Asia.
1 Using Logic Models to Enhance Evaluation WESTAT Center to Improve Project Performance (CIPP) Office of Special Education Programs Amy A. Germuth, Ph.D.
Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.
Donor perspectives on planning and evaluation Janice Astbury The J.W. McConnell Family Foundation.
Evaluating Teacher Training changing classroom practices Richard Lambert, Ph.D.
Instructional Strategies for the workshop will include a combination of: Organizational Strategy Characteristics Delivery Strategy Characteristics Management.
WRITING A Learning Experience An Overview Daemen College Teacher/Quality Leadership Partnership Pat Loncto.
Regional Educational Laboratory at EDC relnei.org Logic Models to Support Program Design, Implementation and Evaluation Sheila Rodriguez Education Development.
Practice of INSET in Mathematics and Science Teachers and its Impact on Quality of Basic Education in Kenya By ADEA-WGMSE.
INTERNATIONALIZING TEACHING & LEARNING. Intercultural, international, and global flows of technology, economy, knowledge, people, values and ideas Individual.
TSHM Docent Training Session 2 Docenting Methods.
restricted external Evaluating the vinspired 24/24 programme Ewan King, director OPM 30 September
Developing an Effective Evaluation to Check for Understanding Part 2 Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.
Disabled and Teacher ALDinHE 2015 Southampton University 1 st April 2015 Dr Zrinka Mendas Lord Ashcroft International Business School Anglia Ruskin University.
SJI Impact Assessment 2014 Based on Impact Assessment for Development Agencies – Learning to Value Change (Chris Roche, Oxfam, digital file 2010)
International engagement: m & e meeting Monitoring & Evaluation: an introduction for practitioners Liz Allen.
AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.
GEPRISP Te Kotahitanga. GEPRISP GoalExperiencesPositioningRelationshipsInteractionsStrategiesPlanning GEPRISP A framework for Te Kotahitanga.
Writing a Professional Development Plan.  Step 1–Identify Indicators to be Assessed  Step 2 –Determine Average Baseline Score  Step 3 –Develop a Growth.
Pathways Project Evaluation Objective #1: To change classroom pedagogy and improve the ability of faculty to effectively integrate Internet-based tools.
What is conflict? SALTO Cultural Diversity w w w n e t u n i n l/ y o u t h.
Teaching Gardner’s multiple Intelligences Theory as a tool for differentiation: Intelligence for opening doors.
ASK STANDARDS Assessment and Accountability CNS 610 Written & Narrated by: Kelcie Dixon Western Kentucky University.
11 PIRLS The Trinidad and Tobago Experience Regional Policy Dialogue on Education 2-3 December 2008 Harrilal Seecharan Ministry of Education Trinidad.
By Dr. Talat AnwarAdvisor Centre for Policy Studies, CIIT, Islamabad Centre for Policy Studies, CIIT, Islamabad
Supporting community action on AIDS in developing countries ‘Evaluating HIV and AIDS-related advocacy’ Skills Building Session International.
`Show me your impact`: Evaluating historic memory & racism in Guatemala Colleen Duggan International Development Research Centre (IDRC), Canada American.
Engaging teachers as agents of peace and social cohesion: Understanding impact Yusuf Sayed Presented at CIES Taking Stock and Looking Forward Annual Conference.
Equality and diversity – session 2
Corporate-level Evaluation of IFAD’s Decentralization Experience
Melanie Taylor Horizon Research, Inc.
The Relevance of Culture in Evaluation and Assessment
Evaluation tools training
Engendering Change Mid-Term Learning Review
Seminar on the Evaluation of AUT STEM Programme
Follow up workshop on the Evaluation of AUT STEM Programme
Ohio Standards for the Teaching Profession EHHS Conceptual Framework
Presentation transcript:

`Show me your impact`: Evaluating historic memory & racism in Guatemala Colleen Duggan International Development Research Centre (IDRC), Canada American Evaluation Association Conference, Nov. 2009

Case Context: Guatemala`s conflict, historic memory and (re) education

CIRMA-IDRC Partnership : Moving research into action for social change National Campaign for Interethnic dialogue, Our Diversity is our Strength! – Museum expo – Group dialogue – University teaching series

How do we know if it`s `working`? M & E Framework Development of an M & E Framework Outcome Mapping design Data collection instruments: Entry and exit questionnaires, records of attendance, weekly reports by expo museum guides, interviews of expo attendees, participant observation; media monitoring

What actually happened? Deployed in three regions: 117,000 visitors or 1% of the population Supported by 17 national and international donors Reactions: Postive and negative; diverse, unpredictable National and international interest – adapt for other contexts Summative evaluations: 2007, 2008

What worked: Learning through M & E  Mass exposure and the creation of a neutral space to discuss a socially contentious issue (unexpected outcome)  Young people a critical group, potential change agents or champions (validated assumption)  Teachers are critical – but could be detractors (useful program improvement)  Some parts of the expo more effective for generating cognitive change (content change)

What didn`t work: Challenges encountered, opportunities missed  Critical importance of defining data use  External context: Balancing power differentials between funders and funded  Organisational context : internal power struggles  Clash of linear and systems approches in: - M & E - Theory of change  Illusive program theory  Falling into the `project trap`

How the story ends… Re-launch of expo, February 2009 New pedagogy & strategy for teacher training Part of history curricula M & E strategy redesigned: Clearer intent, multiple, mixed methods Challenges of integrating M & E into donor strategies

Thank - you! Note: Photographs in this presentation were taken from Learning Workshop on Representing Class, Ethnicity, Gender, and Race to the Public, (Powerpoint presentation) December, Tani Marilena Adams, CIRMA, Guatemala