Presentation is loading. Please wait.

Presentation is loading. Please wait.

STANDARDISED INTERVIEWER TRAINING, ACCREDITATION AND QUALITY PROCEDURES ON THE MILLENNIUM COHORT STUDY AGE 14 SURVEY Nickie Rose, Anne Conolly and Rachel.

Similar presentations


Presentation on theme: "STANDARDISED INTERVIEWER TRAINING, ACCREDITATION AND QUALITY PROCEDURES ON THE MILLENNIUM COHORT STUDY AGE 14 SURVEY Nickie Rose, Anne Conolly and Rachel."— Presentation transcript:

2 STANDARDISED INTERVIEWER TRAINING, ACCREDITATION AND QUALITY PROCEDURES ON THE MILLENNIUM COHORT STUDY AGE 14 SURVEY Nickie Rose, Anne Conolly and Rachel Williams – Ipsos MORI Kate Smith – UCL Institute Of Education, London

3 Background Standardisation key to achieving high quality survey data
Various techniques used, and constantly evolving MCS6 is very complex Diverse study elements MCS5 – high quality training and quality control programme Demands and requirements change each sweep Complex studies present various challenges Drew on international best practice Reviewed entire training and fieldwork monitoring programme

4 The Millennium Cohort Study
Follows the lives of over 19,000 children in the UK born in 2000/01. Cohort has been surveyed at key development ages and stages of life: 9 months (2001-2) 3 years (2003-4) 5 years (2006) 7 years (2008) 11 years (2012) 14 years (currently)

5 The Millennium Cohort Study
9m Age 3 Age 5 Age 7 Age 11 Age 14 Parents interview Cognitive assessments Physical measurements Young person questionnaire Older siblings Interviewer observations Teacher survey Consent to data linkage Saliva samples Time use record Activity monitors 5

6 The main challenges Quantity of training content Nature of content
Number of interviewers to train

7 The quantity of content
Assessed amount we had to cover Made decisions on most effective and efficient way to train Training implemented was multi-faceted 3 day face-to-face briefings for all interviewers Practice of non-standard elements with 14 year olds Pre-tasks prior to briefings Practical exercises during briefings Homework during briefings Accreditations in non-standard elements Detailed briefing slides and instructions

8 Completing consent booklets, using barcodes
Learning techniques Active learning Workbooks Completing ECS Completing consent booklets, using barcodes Scenarios– reluctant respondents, managing household visit

9 Briefing folders MCS6 MCS5

10 Non-standard interviewing elements
The nature of content Non-standard interviewing elements Physical measurements Cognitive assessments Saliva sample collection Placement of time-use diary Placement of accelerometer

11 Training films

12 Accreditation Saliva Prepare tube Collect a saliva sample
Complete despatch slip Height Assemble height measure Take an accurate measurement (and enter into CAPI) Dismantle equipment Weight and body fat Check scales are in correct mode Enter required information from CAPI

13 The number of interviewers
Considerable interviewing resource required Could not impact on overall study timetable

14 Face-to-face briefings
Reviewed how we had previously done them Used traditional briefing style at previous sweeps Considered full conference-style briefings Adopted event-style briefings

15 Face-to-face briefings
Briefing structure (Days 1 & 2) Main conference room c.45 interviewers 7-8 trainers Introduction / Wrap-up Training overview Study overview Overall admin Break-out room 1 12-15 interviewers 2-3 trainers Break-out room 2 12-15 interviewers 2-3 trainers Break-out room 3 12-15 interviewers 2-3 trainers Specific training modules Group work (6-7 ints) Group work (6-7 ints) Group work (6-7 ints) Group work (6-7 ints) Group work (6-7 ints) Group work (6-7 ints) Practical exercises

16 Designed to ensure consistency and quality of training
Training the trainers Designed to ensure consistency and quality of training ‘Train the Trainer’ developed at MCS5 Improved for MCS6 Managing event-style briefings How to accredit others Presentation skills Adapted session for Field RCs

17 Quality control and exception reporting

18 Electronic contact sheet checks

19 Data quality checks ECS means data quality checks carried out more quickly Discrepancies between CAI and ECS – duplications and missing data ECS data checking Routing checks - data flooding Frequency of soft checks being triggered Editing of improbable values

20 Recommendations Reviewing previous training and drawing on international best practice greatly improved quality of training and increased standardisation What we learned Build in time for producing briefing folders – early sign offs Make more use of films Event-style briefings – resource needs careful planning; rooms and personnel Benefits to overall timetable, less fatigue for trainers ECS gives more control over interviewer behaviour Reviewing fieldwork quality procedures improved efficiency and improved outputs

21 THANK YOU nickie.rose@ipsos.com


Download ppt "STANDARDISED INTERVIEWER TRAINING, ACCREDITATION AND QUALITY PROCEDURES ON THE MILLENNIUM COHORT STUDY AGE 14 SURVEY Nickie Rose, Anne Conolly and Rachel."

Similar presentations


Ads by Google