1. Development and Testing
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018

2. Design & Development (cog testing & dress rehearsal)
Methodological pilot
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018

3. Methodological pilot November to December 2015.
Carried out by field teams at NatCen and ONS.  
34 interviewers carried out the fireldwork
Methodological pilot

4. Objectives of methodological pilot
the coverage of the connection across selected areas of England;
the speed of the connection in these areas;
the performance of the DAWBA tool using the dongles in terms of the ease of use and display of questions and response options.

5. Overview of the task connecting to the internet using a dongle;
once connected, completing the online DAWBA twice;
recording the time;
completing and returning a short feedback form.

6. Programme DAWBA into CAPI Conclusion and impact
Time taken extremely variable, in most cases much longer than in the NatCen office with good wifi connection.
Online data collection not a viable option.
Programme DAWBA
into CAPI

7. Design & Development (cog testing & dress rehearsal)
PUBLIC CONSULTATION
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018

8. Objectives of consultation
Which existing topic areas the survey should continue to cover;
Whether there were new question areas that should be included;
Where new question areas were suggested, which areas these should replace in the survey.

9. Consultation process Launched in November 2015 Closed January 2016
Also group discussion with 10 young people aged 16 to 24 years

10. Response to consultation
More than 600 people and organisations viewed the online consultation.
225 of these submitted responses.
Respondents covered a range of areas including academic, clinical, public, private and the voluntary sector. Also responses from members of the public.

11. Findings – New Content
47 new topics were suggested by respondents. The most popular topics for inclusion were online activity and its impact on children and young people’s mental health.
Cyberbullying was the second most popular suggestion.
Respondents also suggested broadening the scope of certain topics

12. Findings – Removing Content
42 separate topics/questions were suggested to be removed.
Varied widely. Most common was the smoking, drinking and drug use section from the self-completed child questionnaire.
Most common: did not want anything to be removed from the survey.

13. Outcome – questionnaire content
Other topics and questions included:
Social media
Cyberbullying and bullying
Service use
School exclusions/truancy
Stressful life events
Sexual identity
Club participation
Smoking, drinking & drug use
Social networks
Caring responsibilities
Parents being in the Armed Forces
Longstanding and limiting illness
Scales included on the survey:
Rosenberg self-esteem
WEMWBS (Warwick Edinburgh Mental Wellbeing Scale)
Social support score
Family functioning (FAD)
Parental mental health (GHQ12)

14. Design & Development (cog testing & dress rehearsal)
COGNITIVE TESTING
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018

15. Method (1 of 2)
Participants were recruited via a recruitment agency and interviews were carried out in South East London, East Sussex and Hampshire.
12 parents of 11 to 16 year olds (30 minute interview)
20 young people aged 11 to 19 were interviewed (90 minutes with year olds, 60 minute interview with year olds)

16. Method (2 of 2) The testing explored:
First impressions of advanced materials (advanced letter, information leaflet, data linkage consent form)
Willingness to take part in the survey
Ability to easily answer survey questions (including new modules on social media and cyberbullying)
Sensitivity of questions

17. Findings Improvements to study documentation
Social media: some questions newly developed and others taken from a survey carried out by OfCom.
Cyberbullying: adapted questions from the British Crime Survey, the Millennium Cohort Study and some versions of a bullying questionnaire.
Language was simplified, the length of the response options shortened and the time frames reduced.

18. Design & Development (cog testing & dress rehearsal)
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018

19. Aims To test: administrative procedures
interviewers’ perceptions of the survey
survey materials
order and flow within the interview
interview length

20. Method of Dress Rehearsal
June 2016
Sample: selected randomly from Health Survey for England and Scottish Health Survey 2015 (consented to re-contact)
440 addresses issued to interviewers
Survey referred to as:
“National Study of Health and Wellbeing:
Children and Young People”

21. Advance Letters 2 to 16 year olds: Letter sent to the parent/carer
Letter sent to the young person

22. Information Leaflets

23. Length, order and flow Broadly in line with what we aimed for
Updated some CAPI wording (including interviewer instructions)
Briefing points for interviewers, e.g.:
Expect some longer interviews
Cover DAWBA in more depth
How to deal with participants who become upset
Recorded video message from Professor Robert Goodman for mainstage

24. Teacher survey Gives nominated teacher the contact card
Interviewer collects teacher name, school name and address (of either teacher or school)
Parental consent given to contact teacher
Child chooses specific teacher to contact
Information pulled out from CAPI
Cleaned
Teachers sent a questionnaire

25. Consent to Teacher Survey

26. Findings – Teacher Survey
Methodology and response at three key stages:
Gaining participant consent to the teacher survey
Inviting teachers to participate
Completing the on-line questionnaire
July 2016.

27. 1. Consent stage findings
Good consent rate.
Expanded briefing content interviewers received about the importance of the teachers’ involvement in the study.
Worked closely with Robert Goodman to ensure interviewers were given the right training and tools.

28. 2. Invite stage findings
We needed better contact details (insufficient or bounce back):
Interviewer briefing point
Edubase
CAPI input improvements
Sample cleaning

29. 3. Participation Challenge of getting Teachers’ attention…
Teacher response rate lower than anticipated
Also analysed a number of metrics (e.g. % s opened, % links clicked on)
Introduced a number of measures to improve
Challenge of getting
Teachers’ attention…

30. Some examples:
Supporting statement (and logos) from Department for Education and Department of Health:
“Mental health problems affect children’s education and life chances. By taking part in this important national survey you will be contributing vital information that will help the Department of Health and the Department for Education improve mental health support for children and young people across England. We thank you for your time: your response will help us to make a difference.” 

31. Head teacher & Teacher letters

32. Paper questionnaire and optimal reminders
Introduced a Paper Questionnaire (up to 2) as well as online option
Developed optimal reminder strategy (separate report)

33. Ethics and CAG approval
Public consultation
Design & Development (cog testing & dress rehearsal)
Mainstage fieldwork
Report published
Contract awarded
Methodological pilot
Sep 2015
Nov 2015
Jan 2016
Feb - Aug 2016
Jan – Oct 2017
Nov 2018
Final ethics approval
Approval for MIDAS