1. Life beyond levels Analysing school performance using scaled scores
Paul Charman
Managing Director, FFT

2. Analysing performance using scaled scores
The national picture: FFT’s research & analysis
Analysing your 2016 results
Improving school performance in 2017

3. The national picture: How did we get here?

4. 2016 KS2 national results (provisional)
74%
72%
70%
66%
53%
© FFT: Life Beyond Levels 2016

5. National KS2 Reading standards (1997-2016)

6. Pupil characteristics and the context of your school

7. 2016 Gender attainment gaps
+11%
+13%
Gap
+8% 0%
+7%
© FFT: Life Beyond Levels 2016

8. Impact of month of birth % Expected Standard in Rd, Wr & Ma
15% gap
53%

9. Impact of both term of birth AND gender
63%
Girls born in September
21% gap
42%
Boys born in August

10. Impact of gender, term of birth AND disadvantage
69%
40% gap
63%
57%
53%
53%
50%
42%
29%
Not FSM6
FSM6
Born in Sept
Born in Aug
Girls
Boys

11. Closing the gap: disadvantaged pupils
No significant change in the attainment gap between 2015 and 2016
All analyses from

12. Closing the gap: disadvantaged pupils
All analyses from
The progress gap has increased by around 1/2 scaled score in 2016 to 1.1 (Reading) and 0.9 (Maths)

13. School context and pupil progress
EAL
Not
White
Not
FSM
Not
SEN
Not
White
EAL
Boys
Not
FSM
Not
SEN
Girls
Not
mobile
Not
mobile
White
Not
EAL
Boys
White
Not
EAL
FSM6
Mobile
Girls
FSM6
Mobile
SEN
SEN
Gender
FSM6
SEN
Ethnicity
EAL
Mobile
Reading
Maths
All analyses from

14. Floor and coasting standards Where is your school?

15. Floor and coasting standard - Reading
2,000 schools
Low progress
High attainment
6,000 schools
High progress
High attainment
Floor and coasting – it’s all about progress. Focus on that and you will be fine.
5,000 schools
Low progress
Low attainment
2,000 schools
High progress
Low attainment

16. Schools at risk …. (Regional)
Reading
Writing
Maths
All analyses from

17. Schools at risk (Ofsted)
Outstanding Good Requires improvement Inadequate
Reading
Writing
Maths
All analyses from

18. KS2 Writing

19. Reading vs Writing by LA (2016)

20. School-level variation: reading & writing

21. What’s changed in Aspire for 2016 results?

22. + FFT Aspire dashboards FFT Aspire School dashboard PDF dashboard
School leaders
Governors
Subject / key stage coordinators
PDF dashboard
For printing and use offline
Interactive dashboard
To explore data in more detail +

23. KS2 Overview report Overview report shows attainment & progress
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
Overview report shows attainment & progress
Compare your performance to the national average
Significance indicated by green ‘+’ and red ‘-’ symbols
Also shows where there has been a significant change in performance (‘↑’ or ‘↓’)

24. KS2 Overview report
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
Two progress options – Value Added (VA) and Contextual Value Added (CVA)
We use DfE VA where available/applicable and FFT VA for other indicators
Use CVA for a more realistic assessment of school effectiveness

25. Measuring pupil progress (KS2)
DFE VA indicators
Reading scaled score
Maths scaled score
GPS scaled score
Additional FFT
VA indicators
% pupils achieving expected standard (RWM)
% pupil achieving high standard (RWM)
VA scaled score (reading, maths and GPS)
% achieving expected standard (for each subject)
% achieving high standard (for each subject)
Example 1:
VA scaled score
Example 2:
% expected standard (RWM)
Actual
Expected VA
School A
106.3
107.4
- 1.1
School B
105.8
105.3
+ 0.5
Actual
Expected VA
School A
80%
85%
- 5%
School B
75%
71%
+ 4%

26. KS2 Overview report (lower half)
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
3 highest performing groups (positive VA/CVA progress)
3 lowest performing groups (negative VA/CVA progress)

27. KS2 Attainment & progress report
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2

28. Attainment & Progress Ranks
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
Ranks range from 1 (highest) to 100 (lowest)
Ranks from approx can be seen as ‘average’

29. KS2 Attainment & progress report
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2

30. Comparing results over time
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
Scaled scores are based on mark distributions.
By using distributions from 2014, 2015 and 2016, we can go backwards and compare results over time

31. KS2 Attainment & progress report (lower half)
Actual results and pupil progress for key subject and combined indicators
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2

32. Lowest performing groups
KS2 Pupil Groups report
Highest performing
groups
Use this report to compare the performance of pupil groups in your school
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
Lowest performing groups

33. KS2 Subjects report
Analysis of all subjects on a single page (useful summary for governors)
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2

34. KS2 Pupils report Show the 3 pupils from activity Reveal pupil 1 first4 5 6 7 8
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2
© FFT: Life Beyond Levels 2016

35. KS2 Attainment & progress report3 4
Show the 3 pupils from activity
Reveal pupil 1 first
Then reveal other 2 +4
Pupil result is higher than estimated (top 20-25%) -4
Pupil result is lower than estimated (bottom 20-25%)
© FFT: Life Beyond Levels 2016

36. Improving your performance in 2017

37. Set a target for each pupil at the end of KS1 and KS2

38. Monitor and track progress for each year group

39. Thank you www.fftaspire.org www.fft.org.uk www.educationdatalab.org.uk
Telephone:
@EduDatalab