1. Predicting Future Attainment: Is GCSE Always the Answer ? Dr Robert Clark ALIS Project Manager

2. Making Predictions

3. . 0246802468 Subject X How CEM Predictions are made… A* / A C Regression Line – specific to each subject or Trend Line or Line of Best Fit

4. Some Subjects are More Equal than Others…. E D C B A C Grade BAA* Average GCSE Physics Maths Psychology Sociology Latin Photography English Lit >1 grade Using a trend line specific to each subject / qualification is of critical importance

5. Subject X However…. Do we really know this ? GCSE or … ? ?

6. Measuring Ability

7. Choice of Baseline Average GCSE Score CABT (Computer Adaptive Baseline Test) Why 2 Baselines ? Measuring Ability

8. Why 2 Baselines ? Average GCSE correlates very well to A-level / IB etc, but by itself is not sufficient…. What is a GCSE ? Students without GCSE ? Years out between GCSE & A-level ? Reliability of GCSE ? Prior Value-Added ?

9. The Effect of Prior Value Added Beyond Expectation +ve Value-Added In line with Expectation 0 Value-Added Below Expectation -ve Value-Added Average GCSE = 6 Do these 3 students all have the same ability ?

10. Do students with the same GCSE score from feeder schools with differing value-added have the same ability ? How can you tell if a student has underachieved at GCSE and thus can you maximise their potential ? Has a student got v.good GCSE scores through the school effort rather than their ability alone ? How will this affect expectation of attainment in the Sixth Form ? Can you add value at every Key Stage ? Baseline testing provides a measure of ability that (to a large extent) is independent of the effect of prior treatment. Appropriate Baseline

11. Computer Adaptive Baseline Test (CABT) Test performed online – results automatically transmitted to CEM. Minimal installation / setup required - if any. Adaptive – difficulty of questions changes in relation to ability of student. Efficient – no time wasted answering questions that are far too easy or difficult. Wider range of ability Less stressful on students – more enjoyable experience than paper test. Less demanding invigilation. Test designed to be completed in 1 hour or less. No materials to courier In 2010 / 2011 over 68,000 students sat this test in Alis To try it out… www.intuproject.org/demos

12. X

13. Baseline & Predictive Feedback

14. Intake Profiles

15. IPR... Full Alis 2009 Demo School (999) Banana, Brian ? Studying : Maths Physics Chemistry Biology

16. Prediction Reports Probability of achieving each grade Expected Grade Predictions Based on GCSE Predictions Based on Baseline Test

17. Which predicted grades are the most appropriate for this student ?

18. Predictions Based on GCSE (7.0) B C B Predictions Based on Test (106) C B D B C What is this Students ability ? What Grades should we expect her to get ? If she gets Cs instead of Bs, is this a problem ?

19. Predictive Feedback Real Life Examples

20. Student 1

21. Student 2

22. Student 2 - IPR

23. Student 3

24. Student 3 - IPR

26. Impact of Baseline Choice on VA Scores

27. Same School - Spot the Difference ? GCSE as Baseline Test as Baseline

28. GCSE as Baseline Test as Baseline

29. A2 Biology GCSE as Baseline Test as Baseline

30. A2 Biology GCSE as Baseline Test as Baseline Student A Student B

31. A2 Biology Student A BaselineGradePointsPredicted Points VA (Residual) GCSEA120122.4-2.4 TestA12090.629.4 Student B BaselineGradePointsPredicted Points VA (Residual) GCSEA*140128.111.9 TestA*140100.139.9 How well did these students perform ?

32. Dr Robert Clark Alis Project Manager robert.clark@cem.dur.ac.uk 0191 33 44 193