#YDF2017

Greater Manchester (GM) and Surrey Safe Drive Stay Alive Greater Manchester (GM) and Surrey First performances November 2014 Annual attendance 10,000 Total attendance 20,000 Total performances 49 First performances April 2005 Annual attendance 12,000 Total attendance 126,000 Total performances 211

SDSA GM and Surrey working together

background & history April 2013 - GM Police and SDSA Surrey both featured in BBC3’s ‘Licence to Kill’ November 2013 - GM Police, GM FRS and NWAS attended SDSA Surrey’s VIP performance July 2014 - SDSA GM purchased licence to use new SDSA Surrey films for 5 years November 2014 - SDSA Surrey first used new films November 2014 - SDSA GM delivered first year of performances, using Surrey films, with SDSA Surrey support March 2015 - SDSA GM and Surrey commissioned Road Safety Analysis (RSA) to undertake an Independent evaluation October 2015 - First questionnaire issued.

evaluation methodology prototype willingness model The Prototype Willingness Model (PWM) was used to create questions for the SDSA evaluation. It incorporates questions on willingness, intentions, attitudes, subjective norms and behaviour to see if SDSA has any effect on any of these elements of the model. Intentions are often positive in young people but willingness, vulnerability, social norms and attitude could be better indicators of likelihood to engage in risky behaviour.

evaluation methodology questionnaires, groups, study period, sample size Joint construction GM - Online Surrey - Paper copies, delivered and collected by hand Study period 12 months and 3 stages October 2015 (Pre performances) Feb/March 2016 (3 months post) October 2016 (12 months post) Groups Intervention group Comparison group Year 12 students Matched respondents (individuals) Sample sizes achieved Intervention/Comparison Pre 2166/308 3 months 1909/482 12 months 1096/479

evaluation results sample sizes

evaluation results 3 months Examples of Key findings Friends’ Likelihood (Unlikelihood) - Net changes* Greater Manchester Surrey 65% drink alcohol before driving (+12%) 42% use mobiles to text or call (+15%) 77% take drugs & drive (+3%) 52% exceed town speed limit (+8%) 45% exceed motorway limit (+12%) 48% exceed rural speed limit (+10%) 56% not wear seatbelt (+11%) 63% drink alcohol before driving (+7%) 36% use mobiles to text or call (+15%) 77% take drugs & drive (+3%) 49% exceed town speed limit (+9%) 42% exceed motorway limit (+10%) 45% exceed rural speed limit (+10%) 58% not wear seatbelt (+10%) *Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.

evaluation results 3 months Examples of Key findings Friends’ Approval (Disapproval) - Net changes* Greater Manchester Surrey 72% drink alcohol before driving (+9%) 51% use mobiles to text or call (+15%) 82% take drugs & drive (+3%) 51% exceed town speed limit (+10%) 42% exceed motorway limit (+11%) 48% exceed rural speed limit (+11%) 57% not wear seatbelt (+12%) 60% drink alcohol before driving (+7%) 32% use mobiles to text or call (+20%) 77% take drugs & drive (+3%) 34% exceed town speed limit (+11%) 29% exceed motorway limit (+10%) 34% exceed rural speed limit (+11%) 41% not wear seatbelt (+12%) *Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.

evaluation results 3 months Summary Based on the Prototype Willingness Model Safe Drive Stay Alive positively affected: Willingness Friends’ Likelihood Family approval Friends’ Approval Attitudes Many measures for each showed statistically significant differences between the Intervention Group and Comparison Group. Safe Drive Stay Alive did not effect: Vulnerability Parents’ Likelihood Passengers

evaluation results 12 months Report Extract - Methodology and results ‘The evaluation has provided a unique insight into the efficacy of Safe Drive Stay Alive, through: the employment of large sample sizes consistent monitoring over time the use of a comparison group and utilising an adolescent-based behaviour change model to measure against. Many evaluations of young and pre-driver education do not employ all or most of these elements’. ‘Many of the successes from the 1st report are still present …the improvements at 12 months in social norms, attitudes and willingness are all really positive’ Tanya Fosdick, Road Safety Analysis, March 2017

evaluation results 12 months Key findings ‘Success’ was based on finding three conditions using ANOVA statistical tests. 13 questions met all three conditions, showing statistically significant improvements. These were: Willingness to use mobile phones Willingness to speed on rural roads Willingness to speed on the motorway Friends’ likelihood to drink and drive Friends’ likelihood to use their mobile and drive Friends’ likelihood to speed on the motorway Friends’ likelihood to speed on rural roads Friends’ likelihood to speed in town Friends’ approval if the respondent sped on the motorway Friends’ approval if the respondent sped on rural roads Friends’ approval if the respondent sped in town Attitudes towards being able to handle one drink and drive Attitudes towards friends making fun of them driving sensibly

evaluation & report recommendations Key findings & recommendations Passenger related behaviours Did not improve to a statistically significant extent The intervention should be adapted to include more passenger focus. Personal Vulnerability Did not increase to a statistically significant extent Highlighting the alternative consequences of risky behaviour could be effective - such as loss of freedom and mobility and the resulting social stigma Credible coping mechanisms could be provided - either through SDSA itself or follow up lessons. Attitudes towards certain behaviours did not improve to a statistically significant extent after SDSA. These included passenger related behaviours, such as challenging irresponsible behaviour; taking lifts from drink or drug drivers; understanding their responsibilities as a passenger; and seatbelt wearing. The strong driver focus in SDSA could mean that messages about passenger responsibility are not absorbed. Lastly, the perceived vulnerability of respondents, where they feel more likely to be involved in a collision if they engage in risky behaviours, did not increase after SDSA. To increase vulnerability, highlighting the alternative consequences of risky behaviour could be effective, such as loss of freedom and mobility and the resulting social stigma. In addition to increasing perceived vulnerability, perceived efficacy could be explored. Credible coping mechanisms could be provided (either through SDSA itself or follow up lessons), with support to show attendees that they are capable of engaging in the safe behaviour.

evaluation & report recommendations Coaching Speakers - SDSA GM Speaker Workshops - style / content / relevance Ensure clear “take home” messages about risks and consequences Passenger responsibility messages strengthened Include wider range of consequences

extended learning & wider use of BCTs Follow up Tutor Resource SDSA GM - 2015 & 2016 - Why? Colleges attending in 2014 and 2015 requested it SDSA has faced some criticism as a single solution to reducing risk taking behaviours over the longer term - need to utilise more Behaviour Change Techniques Students clearly leave SDSA with the intention of staying safe The resource allows them to explore what this means for them as individuals

extended learning & wider use of BCTs Follow up Tutor Resource SDSA GM - Process Proposal to GM Casualty Reduction Partnership Commissioned Brainbox Research (Dr Fiona Fylan) Literature Review Focus Groups in GM colleges Draft content put forward to our Project Team Tested in 4 colleges Approval and design

extended learning & wider use of BCTs Follow up Tutor Resource Modules Compulsory Optional Impulsivity - 1 hour Pressure - 1 hour Mobiles - 30 mins Drugs and Alcohol - 30 mins SDSA GM has now shared resource with SDSA Surrey, SDSA Lancashire, and Devon and Cornwall and is willing to share with others road safety organisations. www.SafeDriveGM.co.uk Possible future GM and Surrey collaboration to evaluate the additional impact of using the Tutor Resource.

extended learning & wider use of BCTs Young Driver’s Guide SDSA Surrey - 2015 & 2016 Following evaluation findings (SDSA Surrey): Issue dates changed for November 2016 performances Year 13 students received in the following January Year 12 students to receive in the following June Nearer to driving age of 17 with potentially increased relevance to recipients Continue to be delivered direct to school or college In addition, First Car contacts each school/college before delivery date, reminding of use and benefits.

extended learning & wider use of BCTs Road Safety GB Connect SDSA Surrey - 2017 SDSA Surrey purchased & aims to promote and develop the use of the Road Safety GB Connect in 2017/18. Aiming to: Build an online audience Create compelling communications Evaluate and improve communications

sharing knowledge, resources, good practice, research and developments Road Safety Performances Forum Road Safety Performances Forum SDSA GM and Surrey are members Meets twice yearly Share good practice; such as funding, extended learning and evaluation Welcomes new members Next meeting, Hertford, 12 July 2017

conclusion

SDSA Surrey & GM working together Conclusion SDSA Surrey & GM working together Tangible benefits to working across geographical boundaries Delivering similar live ‘performances’ with similar aims, objectives, formats, content and outcomes Reaching large numbers of vulnerable drivers and passengers (22 000 pa) Prompting a real interest amongst this large audience group Different regions and socio-economic groups, but with similar evaluation results Extending contact and learning, using a range of BCTs, to further improve outcomes Will continue sharing experiences, learning and findings. Mark Taylor Surrey Fire & Rescue Service mark.taylor@surreycc.gov.uk Lesley Allen Greater Manchester Fire & Rescue Service allenl@manchesterfire.gov.uk

thank you.

#YDF2017