UKCAT Future Developments (Research) Research Panel Jon Dowell, John Mclachlan, Paul Dennis, Rachel Greatrix
Inform about basis of access Wet appetite with UKCAT WP related data Produce discussion about potential WP research Inform UKCAT re likely data requirements Generate interest to propose studies. Objectives 2UKCAT Research Panel
Introductions - who and why here? In groups of about 4 – discuss what WP related research you’d like to be able to do (Post its) Task 3UKCAT Research Panel
History Key objective since outset which stumbled over Concerns regarding the need for consent Technical issues with data formats Possibly also ‘academic undercurrents’ Outcome was that few schools agreed to provide progress data and not clear what could legitimately be done with it. 4UKCAT Research Panel
Core Principles Can proceed without individual consent provided – Data / identities adequately protected – Work in ‘legitimate interests’ of UKCAT Requires ‘buy in’ from universities Access open to contributing universities Eager to support worthwhile work whatever the outcome 5UKCAT Research Panel
Research Strategy Establish Progress data collection More structured data management Four core themes Predictive validity Widening participation Non-cognitive attributes Open call (including bespoke additional data) 6UKCAT Research Panel
Progress Process redesigned with legal guidance University agreements coming in re progress data(12/26) Data collection details being clarified and discussed on individual basis Data exchanges with Pearson VUE and UCAS now OK Data ‘management’ via Paul Dennis, Oxford Data collected from the first four cohorts who took the test in the 2006 – 2009 application rounds will have ‘full’ UCAS data available Research ‘contract’ drafted Timetable for ‘calls’ WP – mid 2010 Predictive validity Late 2010 Support – up to 10K/study 7UKCAT Research Panel
Numbers with UCAS Data Total All UKCAT Full Match with UCAS No application data (%) No UCAS data at all Basic UCAS matching 8UKCAT Research Panel
Total All UKCAT Missing NSSEC data (%) Missing WP Data overview
Class Class Class Class Class Distribution (%) by NS-SEC (Both parents declared) 10UKCAT Research Panel
Total Single-parent/Carer Two-parent/Carer Potential valid data Still missing Single-parent families 11UKCAT Research Panel
Class Class Class Class Class Combined data (%) 12UKCAT Research Panel
Overall Class Class Class Class Class Single parent families year courses (WP?) 13UKCAT Research Panel
Broader data overview Current NS-SES (74%), UCAS SES (65%), Postcode, school code UCAS - Uni choices, A level, degree, Highers UKCAT cognitive data (subscales/Total) Anticipated Confirmed entry (from 2007) Progress and performance data each year 14UKCAT Research Panel
What studies would be worth doing with this resource? Now? (Post its) Future? (Post its) UKCAT WP Research 15UKCAT Research Panel
Choose one study What data would you require to do it? (Post its) UKCAT WP Research 16UKCAT Research Panel
All research must be performed ‘on behalf of UKCAT’ (a DPA requirement) Under ‘contract’ to and in ‘legitimate interests’ of UKCAT Individual identity protected by data provider, analyst and Board Schools identity ‘respected’ Data security ensured All with access to data required to sign ‘contract’ to this effect. Funding could cover incidental research costs, materials, data transfer, security and analysis (including any statistical consultancy required) and travel and subsistence. UKCAT is a charity and is not able to fund ‘ full economic costing ’ or provide university overheads. The ‘rules’ 17UKCAT Research Panel
Conclusion UKCAT research strategy has been delayed but is back on track – live in July is target for first call, re WP. The quality of whole resource depends on widespread participation, which requires careful management. There is potential for a wide range of studies. (But ensure your university is going to provide performance data) We anticipate being able to fund reasonable costs for work we are commissioning. 18UKCAT Research Panel