1. `Show me your impact`: Evaluating historic memory & racism in Guatemala Colleen Duggan International Development Research Centre (IDRC), Canada American Evaluation Association Conference, Nov. 2009

2. Case Context: Guatemala`s conflict, historic memory and (re) education

3. CIRMA-IDRC Partnership 1998- 2003: Moving research into action for social change National Campaign for Interethnic dialogue, Our Diversity is our Strength! – Museum expo – Group dialogue – University teaching series

4. How do we know if it`s `working`? M & E Framework Development of an M & E Framework Outcome Mapping design Data collection instruments: Entry and exit questionnaires, records of attendance, weekly reports by expo museum guides, interviews of expo attendees, participant observation; media monitoring

5. What actually happened? Deployed in three regions: 117,000 visitors or 1% of the population Supported by 17 national and international donors Reactions: Postive and negative; diverse, unpredictable National and international interest – adapt for other contexts Summative evaluations: 2007, 2008

6. What worked: Learning through M & E  Mass exposure and the creation of a neutral space to discuss a socially contentious issue (unexpected outcome)  Young people a critical group, potential change agents or champions (validated assumption)  Teachers are critical – but could be detractors (useful program improvement)  Some parts of the expo more effective for generating cognitive change (content change)

7. What didn`t work: Challenges encountered, opportunities missed  Critical importance of defining data use  External context: Balancing power differentials between funders and funded  Organisational context : internal power struggles  Clash of linear and systems approches in: - M & E - Theory of change  Illusive program theory  Falling into the `project trap`

8. How the story ends… Re-launch of expo, February 2009 New pedagogy & strategy for teacher training Part of history curricula M & E strategy redesigned: Clearer intent, multiple, mixed methods Challenges of integrating M & E into donor strategies

9. Thank - you! Note: Photographs in this presentation were taken from Learning Workshop on Representing Class, Ethnicity, Gender, and Race to the Public, (Powerpoint presentation) December, 2006. Tani Marilena Adams, CIRMA, Guatemala