1. #YDF2017

2. Greater Manchester (GM) and Surrey
Safe Drive Stay Alive
Greater Manchester (GM) and Surrey
First performances
November 2014
Annual attendance
10,000
Total attendance
20,000
Total performances 49
First performances April 2005
Annual attendance 12,000
Total attendance 126,000
Total performances
211

3. SDSA GM and Surrey working together

4. background & history
April GM Police and SDSA Surrey both featured in BBC3’s ‘Licence to Kill’
November GM Police, GM FRS and NWAS attended SDSA Surrey’s VIP performance
July SDSA GM purchased licence to use new SDSA Surrey films for 5 years
November SDSA Surrey first used new films
November SDSA GM delivered first year of performances, using Surrey films, with SDSA Surrey support
March SDSA GM and Surrey commissioned Road Safety Analysis (RSA) to undertake an Independent evaluation
October First questionnaire issued.

5. evaluation methodology prototype willingness model
The Prototype Willingness Model (PWM) was used to create questions for the SDSA evaluation.
It incorporates questions on willingness, intentions, attitudes, subjective norms and behaviour to see if SDSA has any effect on any of these elements of the model.
Intentions are often positive in young people but willingness, vulnerability, social norms and attitude could be better indicators of likelihood to engage in risky behaviour.

6. evaluation methodology questionnaires, groups, study period, sample size
Joint construction
GM - Online
Surrey - Paper copies, delivered and collected by hand
Study period
12 months and 3 stages
October 2015 (Pre performances)
Feb/March 2016 (3 months post)
October 2016 (12 months post)
Groups
Intervention group
Comparison group
Year 12 students
Matched respondents (individuals)
Sample sizes achieved
Intervention/Comparison
Pre /308
3 months 1909/482
12 months 1096/479

7. evaluation results sample sizes

8. evaluation results 3 months
Examples of Key findings
Friends’ Likelihood (Unlikelihood) - Net changes*
Greater Manchester
Surrey
65% drink alcohol before driving (+12%)
42% use mobiles to text or call (+15%)
77% take drugs & drive (+3%)
52% exceed town speed limit (+8%)
45% exceed motorway limit (+12%)
48% exceed rural speed limit (+10%)
56% not wear seatbelt (+11%)
63% drink alcohol before driving (+7%)
36% use mobiles to text or call (+15%)
77% take drugs & drive (+3%)
49% exceed town speed limit (+9%)
42% exceed motorway limit (+10%)
45% exceed rural speed limit (+10%)
58% not wear seatbelt (+10%)
*Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.

9. evaluation results 3 months
Examples of Key findings
Friends’ Approval (Disapproval) - Net changes*
Greater Manchester
Surrey
72% drink alcohol before driving (+9%)
51% use mobiles to text or call (+15%)
82% take drugs & drive (+3%)
51% exceed town speed limit (+10%)
42% exceed motorway limit (+11%)
48% exceed rural speed limit (+11%)
57% not wear seatbelt (+12%)
60% drink alcohol before driving (+7%)
32% use mobiles to text or call (+20%)
77% take drugs & drive (+3%)
34% exceed town speed limit (+11%)
29% exceed motorway limit (+10%)
34% exceed rural speed limit (+11%)
41% not wear seatbelt (+12%)
*Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.

10. evaluation results 3 months
Summary
Based on the Prototype Willingness Model
Safe Drive Stay Alive positively affected:
Willingness
Friends’ Likelihood
Family approval
Friends’ Approval
Attitudes
Many measures for each showed statistically significant differences between the Intervention Group and Comparison Group.
Safe Drive Stay Alive did not effect:
Vulnerability
Parents’ Likelihood
Passengers

11. evaluation results 12 months
Report Extract - Methodology and results
‘The evaluation has provided a unique insight into the efficacy of Safe Drive Stay Alive, through:
the employment of large sample sizes
consistent monitoring over time
the use of a comparison group and
utilising an adolescent-based behaviour change model to measure against.
Many evaluations of young and pre-driver education do not employ all or most of these elements’.
‘Many of the successes from the 1st report are still present …the improvements at 12 months in social norms, attitudes and willingness are all really positive’
Tanya Fosdick, Road Safety Analysis, March 2017

12. evaluation results 12 months
Key findings
‘Success’ was based on finding three conditions using ANOVA statistical tests.
13 questions met all three conditions, showing statistically significant improvements. These were:
Willingness to use mobile phones
Willingness to speed on rural roads
Willingness to speed on the motorway
Friends’ likelihood to drink and drive
Friends’ likelihood to use their mobile and drive
Friends’ likelihood to speed on the motorway
Friends’ likelihood to speed on rural roads
Friends’ likelihood to speed in town
Friends’ approval if the respondent sped on the motorway
Friends’ approval if the respondent sped on rural roads
Friends’ approval if the respondent sped in town
Attitudes towards being able to handle one drink and drive
Attitudes towards friends making fun of them driving sensibly

13. evaluation & report recommendations
Key findings & recommendations
Passenger related behaviours
Did not improve to a statistically significant extent
The intervention should be adapted to include more passenger focus.
Personal Vulnerability
Did not increase to a statistically significant extent
Highlighting the alternative consequences of risky behaviour could be effective - such as loss of freedom and mobility and the resulting social stigma
Credible coping mechanisms could be provided - either through SDSA itself or follow up lessons.
Attitudes towards certain behaviours did not improve to a statistically significant extent after SDSA.
These included passenger related behaviours, such as challenging irresponsible behaviour; taking
lifts from drink or drug drivers; understanding their responsibilities as a passenger; and seatbelt
wearing. The strong driver focus in SDSA could mean that messages about passenger
responsibility are not absorbed.
Lastly, the perceived vulnerability of respondents, where they feel more likely to be involved in a
collision if they engage in risky behaviours, did not increase after SDSA. To increase vulnerability,
highlighting the alternative consequences of risky behaviour could be effective, such as loss of
freedom and mobility and the resulting social stigma. In addition to increasing perceived
vulnerability, perceived efficacy could be explored. Credible coping mechanisms could be provided
(either through SDSA itself or follow up lessons), with support to show attendees that they are
capable of engaging in the safe behaviour.

14. evaluation & report recommendations
Coaching Speakers - SDSA GM
Speaker Workshops - style / content / relevance
Ensure clear “take home” messages about risks and consequences
Passenger responsibility messages strengthened
Include wider range of consequences

15. extended learning & wider use of BCTs
Follow up Tutor Resource
SDSA GM & Why?
Colleges attending in 2014 and 2015 requested it
SDSA has faced some criticism as a single solution to reducing risk taking behaviours over the longer term - need to utilise more Behaviour Change Techniques
Students clearly leave SDSA with the intention of staying safe
The resource allows them to explore what this means for them as individuals

16. extended learning & wider use of BCTs
Follow up Tutor Resource
SDSA GM - Process
Proposal to GM Casualty Reduction Partnership
Commissioned Brainbox Research (Dr Fiona Fylan)
Literature Review
Focus Groups in GM colleges
Draft content put forward to our Project Team
Tested in 4 colleges
Approval and design

17. extended learning & wider use of BCTs
Follow up Tutor Resource
Modules
Compulsory
Optional
Impulsivity - 1 hour
Pressure - 1 hour
Mobiles - 30 mins
Drugs and Alcohol - 30 mins
SDSA GM has now shared resource with SDSA Surrey, SDSA Lancashire, and Devon and Cornwall and is willing to share with others road safety organisations.
Possible future GM and Surrey collaboration to evaluate the additional impact of using the Tutor Resource.

18. extended learning & wider use of BCTs
Young Driver’s Guide
SDSA Surrey & 2016
Following evaluation findings (SDSA Surrey):
Issue dates changed for November 2016 performances
Year 13 students received in the following January
Year 12 students to receive in the following June
Nearer to driving age of 17 with potentially increased relevance to recipients
Continue to be delivered direct to school or college
In addition, First Car contacts each school/college before delivery date, reminding of use and benefits.

19. extended learning & wider use of BCTs
Road Safety GB Connect SDSA Surrey
SDSA Surrey purchased & aims to promote and develop the use of the Road Safety GB Connect in 2017/18.
Aiming to:
Build an online audience
Create compelling communications
Evaluate and improve communications

20. sharing knowledge, resources, good practice, research and developments
Road Safety Performances Forum
Road Safety Performances Forum
SDSA GM and Surrey are members
Meets twice yearly
Share good practice; such as funding, extended learning and evaluation
Welcomes new members
Next meeting, Hertford, 12 July 2017

21. conclusion

22. SDSA Surrey & GM working together
Conclusion
SDSA Surrey & GM working together
Tangible benefits to working across geographical boundaries
Delivering similar live ‘performances’ with similar aims, objectives, formats, content and outcomes
Reaching large numbers of vulnerable drivers and passengers ( pa)
Prompting a real interest amongst this large audience group
Different regions and socio-economic groups, but with similar evaluation results
Extending contact and learning, using a range of BCTs, to further improve outcomes
Will continue sharing experiences, learning and findings.
Mark Taylor Surrey Fire & Rescue Service
Lesley Allen Greater Manchester Fire & Rescue Service

23. thank you.

24. #YDF2017