Neil Millar Clinical Director Enhancing quality assurance through a NES Psychology trainee survey -Stages to the process Neil Millar Clinical Director

Overview of stages 1a: Pre-pilot - Review of evidence base & Delphi process 1b: Pre-pilot - dissemination of pre-pilot survey to trainees, supervisors, HOS, Programme staff 2: pilot survey (mandatory) – dissemination of pilot survey via Questback and data analysed using factor analysis to generate factor structure for final survey.

Stage 1a: pre-pilot – developing the quality indicators & question items   This stage involves identifying quality indicators and item generation based on: A review of previous survey tools used across applied psychology training courses and standardised tools developed A brainstorming session with the working group to further identify quality indicators and as a credibility check of items generated Working group to review preliminary quality indicators and develop operational definitions and further question items relevant to each indicator

Stage 1b: Pre-pilot – trainees to be sent pre-pilot survey An initial pre-pilot survey tool developed. This tool would include a larger number of items than would be required in the final survey tool This would then be sent to trainees, HOS, Programme staff & supervisors to comment on the suitability (clarity & relevance) of questions asked and also to add or comment on further items to be included Responses used to form the pilot survey

Stage 2: Piloting of survey Pilot stage – this involves the larger pilot set of items being set up on Questback for dissemination to trainees across all 4 courses for completion about their placement and supervision experiences This also includes larger number of questions than will be included in final survey Likert type scale responses completed by trainees The outcome from this process would be to then subject the data to both exploratory and confirmatory factor analysis Develop the factor structure for the final survey to be used The data generated from this pilot survey would only be used to generate the final survey tool and NOT used for quality assurance/feedback purposes

Timeline Pre-pilot (1a) = February – May 2016 Pre-pilot (1b) = June – July 2016 Pilot survey (2) = August – October 2016 Aim to have final survey developed = November/December 2016