Introduction to Value-Added Data Robert Clark Neil Defty Nicola Forster.

Slides:



Advertisements
Similar presentations
Year 9 Information Evening. How is the curriculum organised? Core subjects that teach the skills needed for a changing world An average of 11 GCSEs A.
Advertisements

Predicting Future Attainment: Is GCSE Always the Answer ? Dr Robert Clark ALIS Project Manager.
Assistant PrincipalMr.R.Kelsall Options. What is Key Stage 4?  Begin studying material for Y11 exams  Each subject has a qualification  Less subjects.
NEW USERS OF ALIS WORKSHOP JUNE 2011 London Conference Geoff Davies.
The Thomas Hardye Sixth Form. 6th FORM COURSES Advanced Courses AS/A2 CACHE Diploma International Baccalaureate BTEC First Courses and GCSEs.
Thursday 25th April 2013 ‘A’ Levels or IB? The arguments.
OPTION CHOICES CORE SUBJECTSLESSONS English (including English Literature)7 Mathematics7 Science (Biology, Chemistry and Physics)12 ICT (GCSE ICT)2.
Welcome 1. Timeline Jan Feb March April Subject Assemblies Future Studies Lessons Talking to Staff and Parents Options Booklet Available Options Evening.
Experienced Users of MidYIS and Yellis Ian Sanderson
Winchmore Sixth Form Y11-12 Information Evening, 1 November 2011.
Neil Defty, Secondary Systems Programme Manager New Developments from CEM Bristol, April 2011.
LAT Comparing overall 2011 performance with 2010 A2 subjects 2011 followed by 2010: separated into outstanding, good and satisfactory.
CCHS Year 11 into 12 IB and A Level Options
Introduction to Value-Added Data Dr Robert Clark.
Raising Standards Curriculum Change Mentoring Teaching Quality.
Key Stage 4 Accountability Measures from 2016 Heads’ Huddle Bishop Fox 19 November 2013.
Year 10 Parents Curriculum Information Evening Welcome.
Options after Year 11. Birchwood 6 th Form If you would like to do 5 A Levels Average Point Score of 49 (A/B grade average) and meet entry requirement.
Secondary Information Systems
INTRODUCTION Inspection requirements Secondary School Information and Data Disc (SSID) Other school information.
The International School of Penang (Uplands) Respect for Self. Respect for Others. Established 1955.
Secondary Information Systems
Year 9 Pathways and Options for KS4 Red Pathway Mr Darren Luckhurst Deputy Headteacher – KS4.
Introduction to Alis Dr Robert Clark ALIS Project Manager.
Northern Ireland Provisional GCE Results 2012 Record numbers of Northern Ireland students achieving A level grades Thursday 16 August 2012.
Using Alis Predictive Data Dr Robert Clark Alis Project Manager.
Introduction to Value-Added Data Dr Robert Clark.
Interpreting Feedback from Baseline Tests – Predictive Data Course: CEM Information Systems for Beginners and New Users Day 1 Session 3 Wednesday 17 th.
CEM Data and Self-Evaluation Dr Robert Clark ALIS Project Manager.
Madeley High School OPTION CHOICES 2007 A Specialist Technology College.
Differential Effectiveness Report Estimates All Years Multi-Subject Estimate Table Multi-Subject Estimate Graph All Schools, Similar Intake, Same District.
Dulwich College Beijing (I)GCSE Options Process. What are (I)GCSEs? The (International) General Certificate of Secondary Education Two year courses in.
Shenfield High School Sixth Form. What can Shenfield High School Sixth Form offer you? A Levels BTEC courses Football/ Cricket Academy Enrichment.
The use of CEM data for teachers of pupils with Specific Learning Difficulties.
Introduction to CEM Secondary Pre-16 Information Systems Neil Defty Secondary Systems Programme Manager.
Working with Colleagues, Parents and Students Course: Using CEM Data in Practice Day 2 Session 3 Thursday 28 th February 2013 Rob Smith: CEM Inset Provider.
Introduction to CEM Secondary Pre-16 Information Systems Nicola Forster & Neil Defty Secondary Systems Programme Managers London, June 2011.
CEM (NZ) Centre for Evaluation & Monitoring College of Education Dr John Boereboom Director Centre for Evaluation & Monitoring (CEM) University of Canterbury.
YEAR 9 OPTIONS INFORMATION EVENING 2nd December 2015
 Igcse is the most important stage in the knowledge you learn in school  it develops successful students  Students that are excellent to prepare the.
The Key Stage 4 Curriculum Paul Miller, Deputy Headteacher
Using CEM Data for Self-Evaluation and Improvement Running Your School on Data 7 th June 2011
The AP Program at ACS Amanda Briggs 2013.
Monitoring Achievement and Progress in Independent Schools Running Your School on Data January 2011 Peter Hendry: CEM Consultant
Ysgol Gyfun Gwynllyw Year Curriculum,
Dulwich College Beijing (I)GCSE Options Process. What are (I)GCSEs? The (International) General Certificate of Secondary Education Two year courses in.
CEM (NZ) Centre for Evaluation & Monitoring College of Education Dr John Boereboom Director Centre for Evaluation & Monitoring (CEM) University of Canterbury.
KEY STAGE 4 OPTIONS EVENING. KEY STAGE 4 Well-qualified, successful individuals, who enjoy learning, make progress and achieve Independent, confident.
Making the most of Assessment Data in the Secondary Years Dr Robert Clark.
GCSE Reform for Examinations in 2017 and Beyond. GCSE Reform Reformed GCSEs will be introduced gradually over the next three years. more demanding controlled.
HWS PSA Meeting Thursday 29th September 2016.
Types of School Value-Added Reports
14-19 Progression May 2011 Progression.
GCSE reform in England Parent Partnership Tuesday 8 November 2016
Attainment 8 & Progress 8 Mr Avoth – PVT.
Year 9 Information Evening
Cottenham Village College GCSE Results
Post 16 courses – what is changing?
2016 Examinations Staff Inset: August 2016.
Gateway College Hamilton, Leicester, UK
OPTIONS FOR S5/S6 SESSION
Year 9 Information Evening
Why and how are GCSEs changing?
After school.
Glossopdale School KS4 Options
Year 9 Information Evening
KEY STAGE 4 OPTIONS EVENING.
OPTIONS FOR S5/S6 SESSION
Introduction to CEM Secondary Pre-16 Information Systems
Understanding Progress 8
Presentation transcript:

Introduction to Value-Added Data Robert Clark Neil Defty Nicola Forster

Theory and Stats bits…

. -ve VA +ve VA Trend Line/Regression Line Raw Residual Measuring Value-Added – Terminology Exam grade BASELINE SCORE

Measuring Value-Added – An Example Low AbilityAverage AbilityHigh Ability Baseline Score A* U B C D E F G Result Aldwulf Beowulf Cuthbert +ve (+ 2 grades) -ve (- 2 grades) National Trend ‘Average’ Student The position of the national trend line is of critical importance Subject A Subject B

Some Subjects are More Equal than Others…. A-Level >1 grade A*ABC A B C D E

Some Subjects are More Equal than Others…. BTec National Diploma BCE DDM DDD DMM MMM MMP MPP D PPP Average GCSE Score Grade

Some Subjects are More Equal than Others…. International Baccalaureate CBAA* Average (I)GCSE Score Grade Biology Business and Management Chemistry Design Technology Economics English_A1 Film French_B Geography History Mathematics Music Philosophy Physics Psychology Spanish_B Theatre Arts Visual Arts

F E D C B A A* Test Score GCSE Grades Art & Design Biology Chemistry Economics English French Geography German History Ict Mathematics Media Studies Music Physical Education Physics Religious Studies Science (Double) Spanish Some Subjects are More Equal than Others…. GCSE

Definitions: Residual – difference between the points the student attains and points attained on average by students from the CEM cohort with a similar ability Standardised Residual – the residual adjusted to remove differences between qualification points scales and for statistical purposes Average Standardised Residual – this is the ‘Value Added Score’ for any group of results Subject VA – average of standardised residuals for all students’ results in the particular subject School VA – average of standardised residuals for all students’ results in all subjects for a school / college Confidence Limit – area of statistical uncertainity within which any variation from 0 is deemed ‘acceptable’ and outside of which could be deemed ‘important’

Burning Question : What is my Value-Added Score ? Better Question : Is it Important ?

SPC Chart Year Performance inline with expectation VA Score Performance below expectation Problem with Teaching & Learning ? Performance above expectation Good Practice to Share ?

Subject Summary Standardised Residual Graph

The Scatter Plot Baseline Score Grade Points Equivalent Look for Patterns… General Underachievement / over achievement ? Do any groups of students stand out ? – high ability vs low ability ? – male vs female ?

Other things to look for… Why did these students do so badly ? Why did this student do so well ? How did they do in their other subjects ?

Worked Example

Which Subjects Cause Most Concern ? Danger of Relying on Raw Residuals Without Confidence Limits

Which subjects now cause most concern ?

Business Studies

Religious Studies

Summary of Process Examine Subject Summary Determine ‘interesting’ (i.e. statistically significant) subjects Look at 3 year average as well as single year if available Look at trends in ‘Interesting Subjects’ Examine student data –Scatter graphs Identify students over / under achieving (student list or Paris) Any known issues ? Don’t forget to look at over achieving subjects as well as under achieving Phone / CEM when you need help understanding / interpreting the data / statistics !

Baseline Choice

Same School - Spot the Difference ? GCSE as Baseline Test as Baseline

GCSE as Baseline Test as Baseline

A2 Biology GCSE as Baseline Test as Baseline

A2 Biology GCSE as Baseline Test as Baseline Student A Student B

A2 Biology Student A BaselineBaseline Score GradePoints‘Predicted’ Points VA (Residual) GCSE7.8A Test1.7A Student B BaselineBaseline Score GradePoints‘Predicted’ Points VA (Residual) GCSE8.0A* Test2.3A* How well did these students perform ?

National or School Type Specific ?

Comparison to all schools Comparison to Independent Schools Only

Comparison to all schools Comparison to FE Colleges Only

Questions: → How does the unit of comparison used affect the Value-Added data and what implications does this have on your understanding of performance ? → Does this have implications for Self Evaluation ?

Thank You Robert Clark – Neil Defty – Nicola Forster –