Innovations in on-screen testing and reporting Cambridge Schools Conference May 2017 John Murray Oliver Greene

Agenda Presentation title over 2 lines Welcome Cambridge and on-screen Summative and Mid-stakes Classroom based products Try a test Close Formative on-demand testing Benefits and challenges to you Structure to reflect your agenda

The Cambridge approach Why on-screen testing? Customer demand is growing Learners increasingly work on screen Assessment must reflect learning Market forces and competition. The Cambridge approach Led by best practice, not technology A gradual evolution and rollout Extensive trialling of materials before release Paper-based options will continue to be available.

What are we developing? There will be two main strands to our on-screen offer Formative – on-demand Cambridge Progression Tests Secondary 1, IGCSE and A Level Formative – classroom-based Resource Plus Mid-stakes Cambridge Secondary 1 Checkpoint Summative Research and pilot programmes Checkpoint 2016 Essentially a CB version of the existing paper test, with some changes as needed. Checkpoint tests can be taken by schools in a two week window, meaning that any technical problems can be addressed without time zoning restrictions. Progression Tests 2016  Administered by a teacher at a time that suits them - usually at the end of a school year. Class details are entered once, and then a test booking is made by the teacher. Learners then take the test in one go or in groups. The teacher then logs in and marks specific items that cannot be automarked. They can then view reports. This is exactly the process followed by the paper version, but the administration and marking is time consuming and consequently take-up is growing, but not universal IGCSE Topic Tests Topic tests are designed to be delivered close to the point of learning. This increases their formative value, allowing early intervention by teachers in their planned programme and enabling students to address weaknesses.  Time-saving for teachers – often they would be making up their own quizzes or tests at the end of topics. Authentic materials (including examiner feedback) but low stakes. IGCSE and A Level Summative tests High-stakes tests that will allow candidates to take at least one component (as an option) on computer rather than paper. Initially over four phases, these tests will primarily focus on essay questions. Entries will be managed just like paper versions, but schools will need to have computers for each candidate and install Connect Plus software etc. prior to the 'mock' date. 

Summative and Mid-stakes on-screen tests Taken during an exam series, leading to a report or certification Administered by Exams Officers using CIE Direct Delivered using a secure portal A combination of auto and examiner marking Available for Secondary 1 Science Checkpoint since 2016.

Formative – Classroom-based products Rich questions Research led Designed to identify learner misconceptions Test learners’ emerging skills and understanding Closer to the point of learning. Enhance current classroom support

Formative – Classroom-based products Resources Plus Infographics Skills pack experimental skills & techniques Planning & observations Interactive example candidate responses (ECRs) Videos Master video Teacher walkthrough Virtual experiment

Formative – Classroom-based products Infographics Skills pack Interactive example candidate responses (ECRs) Briefing lesson Videos

Formative on-demand Testing On-demand formative assessments for teachers: Learner management On-screen or paper-based test delivery Analytics and reporting. Cambridge products Secondary 1 Progression Tests in English, Maths & Science.

Formative on-demand Cambridge products on the horizon IGCSE/A level Progression Tests Designed to support teaching and learning in the classroom Taken on completion of a unit within a syllabus at IGCSE or A Level Cover specific syllabus content and align with assessment objectives Provide valuable feedback for teachers on progress within their class Available on screen only There will be 10-12 tests available for each subject, two per term Available 2018 for Cambridge IGCSE Biology, Physics, Chemistry.

Formative on-demand progression test Try a test! Formative on-demand progression test https://cambridge.inspera.no Wi-Fi.HK via HKU

What does it mean for you? Benefits Assessments will match the mode of learning, and reflect our lives A more appropriate assessment for digital learners On-screen Progression Tests will reduce the administrative overhead for teachers. Challenges Changes to test administration technological requirements and whether or not schools are equipped to deal with the challenges Some topic areas translate much less easily.

Some feedback from schools

Questions?