Beyond test scores: the role of primary schools in improving multiple child outcomes Claire Crawford and Anna Vignoles Institute of Education, University.

Slides:



Advertisements
Similar presentations
The Great Divide: fixed vs. random effects in an education context Claire Crawford with Paul Clarke, Fiona Steele & Anna Vignoles and funding from ESRC.
Advertisements

What you don’t see can’t matter? The effects of unobserved differences on causal attributions Robert Coe CEM, Durham University Randomised Controlled Trials.
The choice between fixed and random effects models: some considerations for educational research Claire Crawford with Paul Clarke, Fiona Steele & Anna.
Children’s subjective well-being Findings from national surveys in England International Society for Child Indicators Conference, 27 th July 2011.
MEASURING COLLEGE VALUE-ADDED: A DELICATE INSTRUMENT Richard J. Shavelson SK Partners & Stanford University AERA Ben Domingue University of Colorado Boulder.
Deborah Cobb-Clark (U Melbourne) Mathias Sinning (ANU) Steven Stillman (U Otago)
© Institute for Fiscal Studies Children’s outcomes and family background Claire Crawford.
The Relationship Between Health and Cognitive as well as Noncognitive Skills in Children Daniel Schunk University of Zurich, Switzerland.
Explaining intergenerational income persistence Jo Blanden Paul Gregg Lindsey Macmillan Family Background and Child Development: The Emerging Story CMPO/CASE.
Group Comparison Research
The Influence of Parent Education on Child Outcomes: The Mediating Role of Parents Beliefs and Behaviors Pamela E. Davis-Kean University of Michigan This.
Assessment and Curriculum Headlines! Assessment levels as we know them have gone (with exception of this year’s years 2 & 6)! Early Years.
SPSS Session 4: Association and Prediction Using Correlation and Regression.
Exploring the Learning Success Factors of Resilient Students: The Engagement Perspective Dian-Fu Chang Tamkang University Hsiao-Chi Chang UC Davis, Sung-Po.
Analysis of Clustered and Longitudinal Data
What influences English and Mathematics attainment at age 11? Evidence from the EPPSE project.
-- Preliminary, Do Not Quote Without Permission -- VALUE-ADDED MODELS AND THE MEASUREMENT OF TEACHER QUALITY Douglas HarrisTim R. Sass Dept. of Ed. LeadershipDept.
FFT Data Analysis Project – Supporting Self Evaluation  Fischer Family Trust / Fischer Education Project Extracts may be reproduced for non commercial.
Information for parents on the effectiveness of English secondary schools for different types of pupil Lorraine Dearden, John Micklewright and Anna Vignoles.
Neil Harrison, David James and Kathryn Last The impact of a skills-led qualification on GCSE attainment: the case of ASDAN's Certificate of Personal Effectiveness.
LEARNING PROGRAMME Hypothesis testing Intermediate Training in Quantitative Analysis Bangkok November 2007.
Assessing Without Levels. NC 2014 Curriculum The Highlights.
Intelligence Give a definition of intelligence that you could defend, explaining why you believe you could defend it. Give examples of ways your definition.
Evaluating Teacher Performance Daniel Muijs, University of Southampton.
Early Selection in Hungary A Possible Cause of High Educational Inequality Daniel Horn research fellow Institute of Economics, Hungarian Academy of Sciences.
Does Formative Feedback Help or Hinder Students? An Empirical Investigation 2015 DEE Conference Carlos Cortinhas, University of Exeter.
Widening Participation in Higher Education: A Quantitative Analysis Institute of Education Institute for Fiscal Studies Centre for Economic Performance.
Parents’ basic skills and children’s test scores Augustin De Coulon, Elena Meschi and Anna Vignoles.
Key issues from yesterday and for panel Lorraine Dearden.
1 ‘Intergenerational Mobility in UK, life chances and the Role of Inequality and Education Paul Gregg Presentation to IFS Poverty Review Workshop 7 th.
1 New Performance Tables: 2011 and Beyond… Cathy Christieson Head of School Performance Data Unit 13 th May 2011.
Widening Participation in Higher Education: A Quantitative Analysis Institute of Education Institute for Fiscal Studies Centre for Economic Performance.
Mike Treadaway Director of Research Fischer Family Trust Using FFT Live Secondary Schools.
Baseline testing in Reporting and Assessment Patrick Moore – Head of Assessment and Reporting.
IFS When you are born matters: the impact of date of birth on child cognitive outcomes in England Claire Crawford, Lorraine Dearden & Costas Meghir Institute.
Parents meeting: New Curriculum – Assessing Without Levels 5 th October 2015.
Application 3: Estimating the Effect of Education on Earnings Methods of Economic Investigation Lecture 9 1.
The Choice Between Fixed and Random Effects Models: Some Considerations For Educational Research Clarke, Crawford, Steele and Vignoles and funding from.
© Institute for Fiscal Studies, 2008 When you are born matters: the impact of date of birth on child cognitive outcomes in England Claire Crawford, Lorraine.
Mike Treadaway Director of Research Fischer Family Trust.
Public Finance Seminar Spring 2015, Professor Yinger Public Production Functions.
Content and School Effectiveness: Role and Impact December 12, 2006 William H. Schmidt Michigan State University.
The socio-economic gradient in teenagers’ reading skills: how does England compare to other countries? John Jerrim, Institute of Education 1.
Department of Education Gillian Hampden-Thompson, Education, University of York Gill Main, Social Policy, University of York EDUCATIONAL OUTCOME INDICATORS.
Key Stage 2 SATs Parents’ meeting Information and Guidance on the Changes and Expectations for 2015/16 -Preparing for the year 6 SATs SATs week: 9 th -
Broomfields Junior School Y6 ASSESSMENT INFORMATION EVENING THURSDAY 28 TH JANUARY 2016.
SEF Describing good or better achievement and standards What is laid down, ordered, factual is never enough to embrace the whole truth: life spills over.
Key Stage 2 SATs Information and Guidance on the Changes and Expectations for 2015/16 Streatley C of E Primary School Thursday 25th February 2016.
Key Stage 2 SATs Information and Guidance on the Changes and Expectations for 2015/16 Copmanthorpe Information to Parents.
Dr Rebecca McGuire-Snieckus and Dr Janet Rose Brighter Futures and Bath Primary Partnership: an early intervention project to improve outcomes for vulnerable.
Children’s Emotional and Behavioral Problems and Their Parents’ Labor Supply Patrick Richard, Ph.D., M.A. Nicholas C. Petris Center on Health Markets and.
Year 2 and Year 6 SATs Parents Evening Thursday 5 th May 2016.
When you are born matters Steven Donohue EMAS June 2013.
Changes to assessment and reporting of children’s attainment Monday 12 th October A guide for Parents.
KS2 SATs Presentation to parents 20 th April 2016.
Assessment Background September 2014 – New National Curriculum introduced into schools Years 1 and 2 (KS1), Years 3 and 4 (Lower KS2), Years 5 and 6 (Upper.
Birth Spacing and Sibling Outcomes Kasey S. Buckles, University of Notre Dame Elizabeth L. Munnich, University of Notre Dame.
Comparing Year 9 and Year 10 May, Background Assessment and Action Record Interviews (AAR’s) are completed annually with all children and youth.
Information for Parents 3 rd May Key Stage 2 SATs Changes In 2014/15 a new national curriculum framework was introduced by the government for Years.
Key Stage 2 Tests Parent Information Tuesday 23 rd February 2016.
To bold text: Use Futura Std Medium, and click B in formatting toolbar Health, social expenditure and inequality Findings from a cross-national empirical.
Reviewing Educational Transitions: Moving from the Foundation Stage into Key Stage 1 Katherine M Cartmell (Uni. Huddersfield) Pascal.
Hertfordshire County Council The Role of the Secondary Assessment Co-ordinator Day One 5 th July 2005.
BY SANDRA BLACK PAUL DEVEREUX KJELL SALVANES QUARTERLY JOURNAL OF ECONOMICS, 2005 The More the Merrier? The Effect of Family Size and Birth Order on Children’s.
BY SANDRA BLACK PAUL DEVEREUX KJELL SALVANES QUARTERLY JOURNAL OF ECONOMICS, 2005 The More the Merrier? The Effect of Family Size and Birth Order on Children’s.
The Longview Conference: Escape from Disadvantage
What do the data and research really tell us?
School Quality and the Black-White Achievement Gap
Sabine Wollscheid, Senior Researcher, Dr. phil.
Presentation transcript:

Beyond test scores: the role of primary schools in improving multiple child outcomes Claire Crawford and Anna Vignoles Institute of Education, University of London

Motivation League tables measure school performance in terms of academic achievement e.g. test scores But Every Child Matters agenda suggests schools should have a wider remit than just increasing educational attainment –e.g. improving health, socio-emotional skills, etc

Research Questions Are schools at the top of the league tables also the best at improving child welfare? Or is there a trade-off? What methodological approaches are most appropriate when measuring multiple outcomes from education?

Previous research Small (but positive) impact of schools on educational attainment once variation in pupil characteristics is taken into account –e.g. Goldstein and Sammons 1997; Reynolds et al. 1996; Leckie, 2008; Hanushek 1997 Limited work on role of schools in promoting wider outcomes, such as well being –e.g Gibbons and Silva, 2009; Feinstein & Gutman 2008 But different disciplines have used different methods and comparisons of results is difficult –e.g. educationalists relied on multi level models/ economists tend to use fixed effect models

Outline of today’s talk Use simple value-added model of educational attainment to compare RE and FE models –Are assumptions underlying RE/multi level model satisfied? –Use results to inform later model development

Outline of today’s talk Document development of cognitive and non-cognitive skills in primary school –Can we think of these relationships as causal? What are our next steps? –How to consider joint determination of cognitive and non-cognitive skills

RE vs. FE Start with a model of the following form: Y ist = α + βY ist-1 + γX ist-1 + δ s + ε ist-1 Where: –Y: Key Stage maths points –X: vector of pupil characteristics (including family composition, parents’ education, parents’ socio-economic status, etc) RE model assumes: E[X ist-1 |δ s ] = 0 –i.e. pupil characteristics are unrelated to the school effects If E[X ist-1 |δ s ] ≠ 0, RE model produces biased estimates –Rely on FE model instead –Use Hausman test to judge whether condition has been met Future work will explore other tests as well

Determinants of KS2 maths score OLSFERE KS1 maths score0.113** [0.003] 0.114** [0.003] 0.113** [0.003] 2 nd SES quintile [0.027] [0.028] [0.027] 3 rd SES quintile [0.028] [0.029] [0.028] 4 th SES quintile [0.029] [0.030] [0.029] Most deprived SES quintile-0.127** [0.032] ** [0.033] ** [0.032] Number of schools414 Hausman test rejects RE model

Modelling cognitive and non- cognitive skills Focus on value-added models between ages 7 and 11: KS ist = α + β 1 KS ist-1 + β 2 SDQ ist-1 + γX ist-1 + δ s + ε ist-1 SDQ ist = α + β 1 KS ist-1 + β 2 SDQ ist-1 + γX ist-1 + δ s + ε ist-1 KS: Key Stage test results –Standardised average of reading, writing, maths at age 7 –Standardised average of English, maths, science at age 11 SDQ: Strengths & Difficulties score –Teacher reports –5 questions on 5 topics: pro-social, hyperactivity, emotional symptoms, conduct problems, peer problems –Invert pro-social and combine to create total “difficulties” score –Standardise total “difficulties” score and invert so SDQ measures “strengths” rather than “difficulties”

Model controls X is a vector of pupil characteristics, including: –Month of birth –Ethnicity –Family composition (including twin status, number of older and younger siblings, whether parents are married or cohabiting) –Parents’ education –Parents’ socio-economic status –Birthweight and whether child was breastfed –Whether parents often read to the child at age 3 δ represent school fixed effects

Model estimation Estimate using seemingly unrelated regression analysis –Takes account of the fact that the error terms across the two equations may be correlated –Can extend to consider more outcomes e.g. may additionally want to consider health?

Development of cognitive and non- cognitive skills No school effectsSchool fixed effects Std KS2 APS Std KS1 APS0.546** [0.010] 0.542** [0.010] Std SDQ score (age 7)0.097** [0.009] 0.115** [0.009] Std SDQ score (age 11) Std KS1 APS0.221** [0.013] 0.219** [0.014] Std SDQ score (age 7)0.267** [0.011] 0.304** [0.013]

Causal effects? Instrument KS1 attainment using month of birth to identify causal effects of KS1 on KS2 and SDQ scores Std KS2 APSStd SDQ score Using std KS1 APS Std KS1 APS0.542** [0.010] 0.219** [0.014] Std SDQ score (age 7)0.115** [0.009] 0.304** [0.013] Using MOB as instrument for std KS1 APS Std KS1 APS (instrument using MOB) 0.559** [0.011] [0.083] Std SDQ score (age 7)0.109** [0.010] 0.328** [0.018]

Summary Tested RE model with rich set of controls –Rejected RE model, so focus on FE models instead Investigated development of cognitive and non- cognitive skills between ages 7 and 11 –Found strong statistical relationships Inclusion of school fixed effects marginally increases the relationship between SDQ scores at 7 and 11 –Impact of attainment at age 7 on KS2 APS appears causal; but impact of attainment at age 7 on SDQ score at age 11 is not

Next steps Further robustness checks surrounding rejection of RE model, using other models and data Use other statistical software to run seemingly unrelated IV regressions Consider first difference models of KS and SDQ scores –Instrument change in SDQ score with death of a parent/close family member