…….So What, Proving You Are Making a Difference Workshop 2 …….So What, Proving You Are Making a Difference

Discuss at your Tables…. What difference are you trying to make in your work and for whom? 

How do you Prove you are making a difference?

It is vitally important that you are clear on: To Prove you are making a difference….. It is vitally important that you are clear on: what you do ……and why it makes a difference i.e. have a ‘Theory of Change’

Theories of change

Theory of Change

Learning from the Youth Crime & Sport Evaluation Dr. Carolynne Mason, Loughborough University

Why ‘prove’? Benefits … Improved services Improved ability to demonstrate results to stakeholders Increased funding Improved strategy Barriers…. Lack of funding and resources Perceived lack of skills Not knowing what to measure Not knowing how to measure

Stages in ‘proving’ Identify your aims and objectives Outline indicators of success – Who? What? How? Collect and record data relating to the indicators Make sense of your data – Successful? Share your findings with your audiences

Aims Identify the critical success factors underpinning effective sport-based projects (Process) Gather robust evidence demonstrating the impact of the pilot projects using youth-related ASB data in order to analyse potential financial cost savings (Impact) Theory of change outlines both the impact (outputs and outcomes) and the process (enabling factors that underpin success) 5 mins

The individual participant Project level Community level Impact on who? The individual participant Project level Community level

Intervention/Project Level Success Indicators Individual Level Intervention/Project Level Community Level   Increased self-esteem, confidence Improved relationship with police Increased community engagement Health benefits No of participants No of hours of sports/education delivery Volunteer hours Training opportunities Qualifications gained No of YP entering employment/education Incidences of youth related ASB, Criminal Damage, Alcohol/Drug-related ASB, Youth Offending Community Cohesion Community Safety Fear/Experience of crime

Collecting data Views monitoring data Surveys of young people Qualitative interviews with stakeholders Secondary data analysis – SportWorks Analysis of ASB data and a cost-benefit analysis

Impact on young people

Community Impact

Sportsworks

Police Data

Discuss at your tables…. Who does your work impact on? What are the indicators of your success? What data can you use to demonstrate or ‘prove’ your success?   10 mins

Randomised controlled trials Before/after measures Climbing the evidence ladder… Systematic Reviews (Based on level 3-5 studies) 5 Randomised controlled trials 4 Before/after measures Multiple site comparisons 3 Two site comparisons 2 No comparison site 1 One-off measure Statements about ‘what works’ Statements about ‘what’s promising’ Study designs increasingly rule out potential alternative causes Study designs cannot rule out potential alternative causes Statements about possible impact 20

Social Value James Williams - HACT

Social Value HACT and Street Games working closely to connect Housing Associations and sports organisations. Working together to adopt UK Social Value Bank. Launched in 2014 100+ proxy £values and linked to wellbeing uplift Person centred approach often involving pre and post questionnaire approach.

Social Value UK Social Value Bank provides a way of measuring value for money Tests the impact of your work Recognised by major funders the Government and Housing Associations

Social Value What value do you put on fear of crime ? How much does it improve your wellbeing ? UK Social Value Bank can measure this.

Social Value Sports projects run with Housing Associations MCFC, CACT, Everton in Community plus many others. How effective are they in reduction in fear of crime or worrying levels of ASB ? Perception is everything !! Can we develop more values ?

Any Further Questions?

Contacts Ceris.anderson@streetgames.org C.L.J.Mason@lboro.ac.uk james.williams@hact.org.uk