1. Arts Measuring the impact of the cultural dimension in international development Dr Vicki-Ann Ware, School of Music – Conservatorium, Monash University Kim Dunphy, Deakin University 3-4 May 2012

2. 2 Setting the scene 3 rd May 2012Measuring the impact of the arts in ID

3. 3 Today: measuring the impact of the cultural activities in ID Focus on measuring the impact of the arts in ID Why are we interested in this? Caveats: –Arts culture; one subset –Work in progress feedback welcome! 3 rd May 2012Measuring the impact of the arts in ID

4. 4 Outline of presentation Description of initial project leading to this exploration of measurement Case studies Some possible explanations Thoughts going forward 3 rd May 2012Measuring the impact of the arts in ID

5. 5 Systematic review 3 rd May 2012Measuring the impact of the arts in ID

6. 6 Systematic review Methods Progress to date –Identified 214 articles thus far –24 evaluations –37 alternative research/critique –80 case studies –26 policy documents –25 practice/process issues –~ 40 articles analysed thus far Discovery: measurement issues 3 rd May 2012Measuring the impact of the arts in ID

7. 7 Case studies 3 rd May 2012Measuring the impact of the arts in ID

8. 8 Case study (1) Braden, S. and M. Mayo (1999). "Culture, community development and representation." Community Development Journal 34(3): 191-204. Clear theory of change Project designed, based upon the evidence underpinning this theory of change Case study clearly describes population involved, process and outcomes effective, rigorous However: –No tool for measuring extent of effectiveness. –Not experimental design...yet.... 3 rd May 2012Measuring the impact of the arts in ID

9. 9 Case study (2) Nogueira, M. P. (2006). "Reflections on the impact of a long term theatre for community development project in Southern Brazil." Research in Drama Education: The Journal of Applied Theatre and Performance 11(2): 219-234. This study: two projects, two approaches in one location Research question: what are the benefits of long-term theatre practice in this community? Approach one: cultural renewal (based on Krugli and Dasté) Approach two: Theatre for Development, based on Freire and Boal Data collected through interviews A range of challenges and positive changes documented. Voice of community privileged in assessing research question. 3 rd May 2012Measuring the impact of the arts in ID

10. 10 Case study (3) Assertions with no evidence No critical reflection on artistic practices or outcomes 3 rd May 2012Measuring the impact of the arts in ID

11. 11 Some possible explanations 3 rd May 2012Measuring the impact of the arts in ID

12. 12 Why dont artists measure the impacts of their work? Resourcing Training Worldview Issues with research methodologies 3 rd May 2012Measuring the impact of the arts in ID

13. 13 Are research methods part of the problem? Community arts is about process at least as much as product need methods which explore processes more than products Community arts do not start with a hypothesis to be (dis)proved 3 rd May 2012Measuring the impact of the arts in ID

14. 14 Why is this important? Purpose of measurement Building profile and developing integral place for arts in ID Improving resourcing for arts in ID 3 rd May 2012Measuring the impact of the arts in ID

15. 15 Conclusions 3 rd May 2012Measuring the impact of the arts in ID

16. 16 Final thoughts We know intuitively that the arts can be powerful, but the evidence is weak. Values alignment.... This evidence needs to be strengthened.... 3 rd May 2012Measuring the impact of the arts in ID

17. 3 rd May 2012Measuring the impact of the arts in ID17 Any comments or questions? Contact details: Vicki-Ann Ware: vicki-ann.ware@monash.eduvicki-ann.ware@monash.edu