Introduction to CEM Secondary Pre-16 Information Systems Neil Defty Secondary Systems Programme Manager

Ensuring Fairness

Principles of Fair Analysis : 1.Use an Appropriate Baseline 2.Compare ‘Like’ with ‘Like’ 3.Reflect Statistical Uncertainty

CEM Systems Principle of Fair Analysis No1 : Use an Appropriate Baseline

The Assessments MidYIS - Year 7, 8 or 9 Developed ability assessments: Vocabulary Maths Non-verbal (Cross-sections, Block Counting and Pictures) Skills (Proof Reading and Perceptual Speed & Accuracy) SOSCA (“INSIGHT Core”) – Year 9 Curriculum-based assessments: Reading (Passage Comprehension, Text Comprehension and Speed Reading) Maths (Number & Algebra, Handling Data and Space, Shapes & Measures) Science (Biology, Chemistry and Physics) INSIGHT – Year 8* or 9 ( * depending on numbers) Developed ability assessments (‘MidYIS’) plus Curriculum-based assessments (‘SOSCA’) Yellis - Year 10 or 11 Developed ability assessments: Vocabulary Maths Patterns (Matching and Reflections & Rotations) 3 sessions - Computer adaptive 4 sessions - Computer adaptive 1 session – Computer adaptive or paper-based 1 session - Computer adaptive or paper-based

Computer AdaptivePaper-based Number of Students per Test Session Limited by number of computers available – multiple testing sessions Can test all students in a single session (in hall or in form groups) or in more than the one session Cost Roughly 30% cheaper than paper-based test Standard cost Processing of Baseline Feedback Baseline feedback available within a couple of hours of testing Takes around 2-4 weeks for papers to be marked Preparation Must be able to install the software or access the internet version of the test No pre-test set up Student Experience “Tailored” assessmentAll students see all questions, irrespective of suitability Computer-adaptive vs Paper-based testing

The Analysis

ve VA +ve VA Regression Line (…Trend Line, Line of Best Fit) Outcome = gradient x baseline + intercept Correlation Coefficient (~ 0.7) Residuals Subject X Linear Least Squares Regression

Some Subjects are More Equal than Others…. Principle of Fair Analysis No2 : Compare ‘Like’ with ‘Like’

The Assessments

Maths

Vocabulary

Non-verbal

Skills

Maths

Science

Reading

Baseline Assessment and Predictive Feedback

Individual Pupil Recordsheets (IPRs)

Band Profile Graphs

Predictions

English Language - band D UGFEDCBAA* Grade Percent English Language - band C UGFEDCBAA* Grade Percent English Language - band B UGFEDCBAA* Grade Percent English Language - band A UGFEDCBAA* Grade Percent Chances Graphs

Value Added Feedback

Burning Question : What is my Value-Added Score ? Better Question : Is it Important ? Principle of Fair Analysis No3 : Reflect Statistical Uncertainty

The Scatter Plot Baseline Score Grade Points Equivalent Look for Patterns… General under- or over-achievement ? Do any groups of students stand out ? – high ability vs low ability ? – male vs female ?

Value Added Feedback Year 7 Pupil Level Residuals to GCSE

Standardised Residuals Graph

Statistical Process Control (SPC) Chart

Attitudinal Surveys

Attitudinal Feedback Your data is above the Yellis average Your data is below the Yellis average Your data is about the same as the Yellis average

Attitudinal Feedback

Secondary Pre-16 Contact Details Tel: Web: