Evaluation in the Early Years: The Maths Champions Programme Challenges and Practical Considerations Lyn Robinson & Vic Menzies Centre for Evaluation and Monitoring (CEM) Durham University

What is Maths Champions? One-year, online training programme delivered by the National Day Nursery Association (NDNA) with the aim of improving the knowledge, skills and confidence of nursery practitioners in order to improve the quality of maths provision within their setting. A dedicated ‘Maths Champion’ within each setting is trained to deliver the programme to non-graduate practitioners.

The Evaluation Participants: 120 PVI nurseries, in areas of high deprivation, two armed (intervention or control) cluster randomised controlled trial. Primary outcome: Maths Attainment at the end of nursery measured using pre and post Assessment Profile on Entry for Children and Toddlers (ASPECTS). Secondary outcomes: Reading and phonological awareness scores (ASPECTS), practitioner confidence, changes to nursery environment (ECERS-3, ECERS-E).

Parental consent: Three stage process, Challenges to Address through Piloting Number of eligible children: Who fulfil eligibility criteria (being three years old at the start of the intervention, due to attend school in 2016 and attend nursery for at least 15 hours per week). Parental consent: Three stage process, (1) ASPECTS, (2) follow-up, (3) NPD Data collection: Training and trialling of nursery staff for data collection, child attendance. NPD request: Ongoing. 6 PVI undertaking MC this year, recruited NDNA. £250 Amazon vouchers for taking part.

Challenges so Far Recruitment and attrition: Changes to children’s attendance, they can attend more than one nursery and can go on holiday whenever they like. Nursery settings: Less understanding of research, but [appear] easy to work with! Assessing attainment in the Early Years: IT facilities, young age of children, missing Summer born children, balance of low costs and minimal time for pre-test but post-test requires multiple visits by a researcher and more time. NPD: Creative thinking required for follow-up as children attending PVI nurseries. Children from one nursery are less likely to attend the same school, unlike those who attend school nurseries. Pilot to determine % of matches.

Thank you for listening! cem.org @CEMatDurham cem.org/blog Any questions? Lyn.Robinson@cem.dur.ac.uk Victoria.menzies@cem.dur.ac.uk cem.org @CEMatDurham cem.org/blog