Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods

1.Introduction to the Knowledge Transfer Partnership (‘KTP’) project 2.Outline current strategies in impact evaluation 3.The KTP method and progress 4.Summary of conclusions Aim of the session

Knowledge Transfer Partnership: Designing and implementing a longitudinal impact evaluation strategy Design and implement a strategy to evaluate the kinds of social impact being made by UnLtd Award Winners The foundation for Social Entrepreneurs Department of Geomatic Engineering

The landscape of impact evaluation Evidence-based research -use of both qualitative and quantitative methods Markers of success -used to measure impact Deductive methods -common practice in impact evaluation

Current impact evaluation strategies: the deductive approach Hypothesis Observation Confirmation/rejection of hypothesis Deductive approach: An approach to developing or confirming a theory that begins with abstract concepts and theoretical relationships and works toward more empirical evidence (Neuman, 2006, pp.59)

The problem… Hypothesis -Reliant on what we understand about Social Entrepreneurs -Reliant on what we understand about impact Observation -Methods are designed to gather evidence to support of reject hypothesis Confirmation/rejection of hypothesis -Knowledge of social entrepreneurs is specific and limited

Mapping Social Entrepreneurs: an example of deductive approaches to evaluation Source: UnLtd research, 2005

Inductive approach to impact evaluation Observation Pattern/Trend Tentative hypothesis Theory Inductive approach: An approach to developing or confirming a theory that begins with concrete empirical evidence and works toward more abstract concepts and theoretical relationships (Neuman, 2006, pp.60) Qualitative interviews Questionnaires/ Surveys

Combining GIS and qualitative methods Qualitative research: To observe and gather information about social entrepreneurs’ experience of creating social impact Geographic Information Systems/ Science: Provides ‘a tool for representing and visualizing environments beyond the scope of everyday life’ (McLafferty, 2002, pp.265) A more comprehensive and more critical view of social impact Inductive direction

The project stages STAGE 1: Review of literature STAGE 2: Research tool design STAGE 3: Field work STAGE 4: Data analysis STAGE 5: Results Pilot Study In depth interviews, focus groups, online surveys, mapping ATLAS.ti, SPSS, GIS

Introducing GIS Geographical Information Systems and Science -Computer systems that can capture, store, analyse and manage any data with a spatial reference -Is recognised for its ability to support qualitative research that that seeks to understand the socio-spatial contexts of individual experiences -can teach us how to enhance social impact

Data analysis and impact mapping Coding of qualitative data Categories of impact Further testing on broader population Impact maps

Impact Maps Source: UnLtd research, 2005 No’ of jobs created through projects > Projects run by those aged 25-30

Pilot study results Award Winners identify social impact as: Changes to attitude Change to behaviour Skill provision Removing barriers to social inclusion Improving community cohesion Reducing crime Providing support “Impact for me is making people sit up and listen… and about creating a difference” “think that we’ve given a lot of grooms a little boost, a bit of confidence…” “If you’re making 50,000 pounds or if you’re on limited income support…you should have the benefit of being treated as a client and not as a service user. And that’s the whole idea behind wanting to run [this project]” “…the BGA can make them feel a bit more inclusive, socially inclusive in the area that they’re in”

Summary of conclusions Deductive approaches to impact evaluation provide partial knowledge about social impact By adopting an inductive approach we can develop a more comprehensive understanding about social impact Incorporating GIS with inductive/qualitative methods encourages a more in-depth and critical approach to understanding impact

Laura Fry Knowledge Transfer Associate, UCL, UnLtd Mordechai (Muki) Haklay Senior Lecturer, UCL Lea Esterhuizen Head of Research, UnLtd