PERSPECTIVES ON QUALITY AND EQUITY FROM LARGE-SCALE ASSESSMENT STUDIES John Ainley and Eveline Gebhardt.

Slides:

Advertisements

Similar presentations

Absence from Australian Schools John Ainley. School attendance critically important not only for the individual who suffers educational disadvantage and.

Advertisements

The Reasons behind the Results Markku Linna

Equity - Research Reveals the What, the Where and the How November 21, 2011.

PISA OECD Programme for International Student Assessment Learning trends Maciej Jakubowski 10 February 2011 Learning Trends Changes in student performance.

The Smarter Schools National Partnership Evan Arthur Group Manager National Schools and Youth Partnerships Group.

Advancing equity through public accountability Mary Ann O’Loughlin Executive Councillor & Head of Secretariat Australian College of Educators National.

School autonomy and student achievement. An international study with a focus on Italy Angelo Paletta Maria Magdalena Isac Daniele Vidoni.

Graphic Organiser NSW naplan NSW Department of Education and Traininghttps:// ACT

Language and Literacy support strategies for migrant children in Australia National Experts Meeting on Education of Migrants, October 2008.

SONNIE Senior Officers National Network of Indigenous Education.

Measuring socio-economic background and its influence on school education outcomes South Australian Institute for Education Research Spring Seminar Series.

Deborah Cobb-Clark (U Melbourne) Mathias Sinning (ANU) Steven Stillman (U Otago)

Improving Australia’s systems of school education* 29 October 2010 CEET 14 th Annual National Conference Ascot House, 50 Fenton st, Ascot Vale, Melbourne.

1. Canadian Results PISA PISA 2012 by the numbers 3.

Pressing national issues and how principals should respond? Barry McGaw Melbourne Graduate School of Education, University of Melbourne Chair, Australian.

Grade 3-8 English. 2 The Bottom Line This is the first year in which students took State tests in Grades 3,4,5,6,7, and 8. With the new individual.

Assessing and Improving Numeracy Skills in Undergraduate Psychology Students Paul Bishop, Leili Soo & David Sutherland School of Psychology, University.

PIAAC results tell a story about the systemic nature of the skills deficit among U.S. adults. Overview of U.S. Results: Focus on Numeracy.

Educational Outcomes across Space and Demographic Groups 1.Facts and Hypotheses about variation in outcomes by space 2.The Surprising Progress in UK 3.Implications.

Art teachers in a comparative perspective Preliminary results from the Talis 2013 Database Dr. Henk Vinken Dr. Teunis IJdens

Education Lindsay Paterson Edinburgh University

Pursuing quality and equity through a national curriculum Barry McGaw Melbourne Graduate School of Education, University of Melbourne Chair, Australian.

International Outcomes of Learning in Mathematics and Problem Solving: PISA 2003 Results from the U.S. Perspective Commissioner Robert Lerner National.

Agnieszka Chłoń-Domińczak Michał Federowicz How did educational reforms in Poland lead to significant progress in PISA ?

Measuring Learning and Improving Education Quality: International Experiences in Assessment John Ainley South Asia Regional Conference on Quality Education.

Performance Insights: School Attendance. Every day counts research confirms a strong link between attendance and student outcomes. Every day counts aims.

Qatar Comprehensive Educational Assessment (QCEA) 2007: Summary of Results.

Overview of U.S. Results: Focus on Literacy PIAAC results tell a story about the systemic nature of the skills deficit among U.S. adults.

NEW SCHOOLS FUNDING PLAN AS ANNOUNCED SUNDAY APRIL

Source: OECD (2001) Knowledge and skills for life, Appendix B1, Table 2.3a, p.253, Table 2.4, p.257. Finland Canada New Zealand Australia Ireland Korea.

A focus on student outcomes Key influences on enhancing student outcomes System wide lasting and deep change Knowledge and understanding Capacity and.

PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education.

Mcgaw group pty ltd ABN Building Educational Capacity: Enhancing Leadership Potential Barry McGaw International messages for Australia’s.

Assessing assessment: the role of student effort in comparative studies Ray Adams Jayne Butler.

Proposed US Graduate Study Program in New Zealand Introduction The focus of New Zealand education development is to ensure school students achieve as.

Building strong cultural relationships to improve student outcomes.

Approaches to educational research Research topics Research problems Research purpose Research questions.

The background of the improvement of PISA results in Hungary Trends in Performance Since 2000 International Launch of PISA 2009 Report February 10 th,

13-1 Copyright  2010 McGraw-Hill Australia Pty Ltd PowerPoint slides to accompany Croucher, Introductory Mathematics and Statistics, 5e Chapter 13 Measures.

Professor Masters Presentation The Case for an ACE.

Victorian Government School Performance Summaries.

Andreas Schleicher, OECD Directorate for Education, 2003 Organisation for Economic Co-Operation and Development Literacy Skills for the World of Tomorrow.

1 Sweden Education at a Glance 2015 Thomas Weko Release date: 24 November 2015.

1 Literacy & Numeracy Do They Really Matter? W. Craig Riddell University of British Columbia Ministry of Training, Colleges and Universities Toronto, Ontario.

Andreas Schleicher, Quality of Education – Teachers’ Professional Training and Development, Athens, 2003 Organisation for Economic Co-Operation and Development.

National Developments Linda Higgie A/Manager – Strategic Policy and Programs Disability Services Commission 17 November Positive Behaviour Framework.

Food Waste. Cost of household food waste in Australia and New Zealand Cost of food waste per HH Cost of food waste per person Average HH size NSW $

Melbourne Education Research Institute 1 Education: an international perspective Barry McGaw Director University of Melbourne Education Research Institute.

Aboriginal and Torres Strait Islander Higher Education Advisory Council Indigenous Leaders Forum Growing an Indigenous professional workforce: the national.

Results from the 2009 Programme for International Student Assessment (PISA): How does the United States compare to other nations? December 2010.

Evaluation Institute Qatar Comprehensive Educational Assessment (QCEA) 2008 Summary of Results.

UAE National Agenda – A World Class Education

Assessment to assure quality Barry McGaw Professorial Fellow, University of Melbourne Former Chair, Australian Curriculum, Assessment and Reporting Authority.

Students’ Access to and Use of ICT The Study To examine equity issues related to the use of ICT in education. Used PISA 2000 study Goals of education.

What Matters Most: Common Elements of Successful Systems.

STRONG FAMILY AND COMMUNITY ENGAGEMENT IS CENTRAL TO EFFECTIVE SCHOOL REFORM Jan Patterson and Ann Bliss Smarter Schools National Partnerships Key Reform.

Squash Australia Sporting Schools Initiative (SSI) Identifying, informing, developing and implementing to achieve the ASC’s and Squash Australia’s participation.

1 Perspectives on the Achievements of Irish 15-Year-Olds in the OECD PISA Assessment

1 Main achievement outcomes continued.... Performance on mathematics and reading (minor domains) in PISA 2006, including performance by gender Performance.

By Jocelyn Cook Principal Research Fellow Perth Office ACER.

Educational Measurement and School Accountability Directorate National Assessment Program – Literacy and Numeracy (NAPLAN) Understanding your child’s report.

NDIS CHAMPIONS: The National Disability Insurance Scheme (NDIS)

Session 6: Education- International databases and comparisons

Off to a Good Start? Primary School Experiences and the Transition to Second-Level Education Emer Smyth.

Introductory Mathematics & Statistics

Seminar on the importance of Education Research and Innovation

Can we determine the area and perimeter of a range of rectangles?

Between-school Variance in Achievement

Organisation for Economic Co-Operation and Development Indicators on the Quality of Educational Performance Quality of Education Teachers’ Professional.

Five things you probably don’t know from PISA….

Presentation transcript:

PERSPECTIVES ON QUALITY AND EQUITY FROM LARGE-SCALE ASSESSMENT STUDIES John Ainley and Eveline Gebhardt

Outline Properties of large-scale assessments Perspectives from NAPLAN: 2008 to 2013 – National changes in reading achievement – Improvements in reading for Indigenous students – Differences in changes across jurisdictions Messages from PISA – Changes in reading and mathematics achievement – Student background – Jurisdictional changes in reading and mathematics – Variation between and within schools Summary

Perspectives from NAPLAN

National mean reading scores:

National mean numeracy scores:

The story so far: Improvement in reading in years 3 and 5 No change in reading in years 7 and 9 No significant national change in numeracy at Years 3, 5 (note exception of Queensland), 7 or 9

Changes in mean reading scores: Indigenous and non-Indigenous students

Jurisdictional mean Year 3 reading scores:

Jurisdictional mean Year 5 reading scores:

The story extended: Improvement in reading in years 3 and 5 No change in reading in years 7 and 9 No significant national change in numeracy at Years 3, 5, 7 or 9 Larger improvement in reading for Indigenous than non-Indigenous students (Years 3 & 5) Differences among jurisdictions with large increases in: – Queensland – Northern Territory

Interpretation Emphasis on the early years (school and pre-school) – Programs and resources – Focus on reading in the early school and pre-school years Programs intended to improve outcomes for Indigenous students Structural change in Queensland – Introduction of a foundation/preparatory year – Accompanied by a strong school improvement strategy

Messages from PISA

Change in reading literacy:

Change in mathematical literacy:

Changes in achievement and student background Reading Mathematics

Changes in achievement & socioeconomic background (ESCS): overall gradient Reading Mathematics Australia42 Canada3431 USA4535 UKna41 Finland33 Germany Australia4746 Canada3832 USA5242 UKna44 Finland2531 Germany5244

The story so far Modest declines in reading and mathematics among 15 year-olds Extent of decline is similar for reading and mathematics Does not appear to be associated with differences in student background.

Jurisdictional change in reading literacy:

Jurisdictional change in mathematical literacy:

Summary of jurisdictional changes in PISA reading and mathematics Reading change (00-12) JurisdictionChange VIC1 QLD-13 WA-19 NT-23 NSW-26 ACT-27 TAS-30 SA-37 Mathematics change (03-12) JurisdictionChange VIC-10 QLD-16 NSW-17 TAS-30 ACT-30 WA-32 NT-45 SA-46

The story extended Modest declines in reading and mathematics among 15 year-olds Extent of decline is similar for reading and mathematics Does not appear to be associated with differences in student background Differences among jurisdictions in the extent of decline Changes in reading and mathematics achievement appear to run parallel

Variation between and within schools Variance – dispersion calculated as the mean of the squared deviations of observed values from a mean – total variance made up of: variance within schools and variance between schools’ mean scores Percentages of total variance Within / total Between / total % variance between schools is an indicator of the extent to which schools differ

Between-school variance in reading and mathematics in selected countries

Change in mean mathematics score ( ) and change in % between-school variance

The story extended a little further Modest declines in reading and mathematics among 15 year- olds Extent of decline is similar for reading and mathematics Does not appear to be associated with differences in student background Differences among jurisdictions in the extent of decline Changes in reading and mathematics achievement appear to run parallel Declines in Australia associated with larger differences among schools In general for mathematics larger changes in between school variance are associated with larger declines

Speculation Differentiation appears to be associated with lower overall achievement (Willms, 2010) Differentiation among schools may be associated with differentiation in teaching expertise among schools Possibly a reciprocal relationship arising from attractiveness of schools to teachers Caution about policies that exacerbate differences.

Thank you Questions Discussion