John Jerrim UCL Institute of Education

Slides:



Advertisements
Similar presentations
Programme: 145 sessions & social events
Advertisements

Eastern Europe: Poland, Lithuania, Latvia, Estonia, Russia, Ukraine, Romania, Bulgaria, Macedonia, Albania, Belarus, Bosnia and Herzegovina, Croatia, Slovenia,
Political Map of Europe. 1. British Isles 2. Nordic Nations 3. Central Western Europe 4. Mediterranean Europe 5. Eastern Europe.
International Outcomes of Learning in Mathematics and Problem Solving: PISA 2003 Results from the U.S. Perspective Commissioner Robert Lerner National.
Media Freedom The Catch Up Index Findings. What is the Catch Up Index? Are the ten “new”, post-communist member states of the EU – the EU10 – catching.
Capitalist. Main Points In a capitalist or free-market country, people can own their own businesses and property. People can also buy services for private.
Chapter 15 Development of the profession of O&M around the world.
Map - Region 3 Europe.
< Return to Largest Religious CommunitiesLargest Religious Communities The Largest Atheist / Agnostic Populations Top 50 Countries With Highest Proportion.
The United States The Economy. What is GDP ? Gross Domestic Product (GDP): The total market (or dollar) value of all final goods and services produced.
Computer Class – Summer 20092/21/2016 3:45 AM European Countries Albania Andorra Austria Belarus Belgium Bosnia and Herzegovina Bulgaria Croatia Czech.
Geography Review On Map 1, please identify: -Spain -France -England -Russia -Ottoman empire -Persia -China -Mughal India -Songhai Empire.
Figure 1. PARTICIPATING STEM CELL DONOR REGISTRIES Number of registries Year ©BMDW.
1 Main achievement outcomes continued.... Performance on mathematics and reading (minor domains) in PISA 2006, including performance by gender Performance.
European Innovation Scoreboard European Commission Enterprise and Industry DG EPG DGs meeting, May 2008.
France Ireland Norway Sweden Finland Estonia Latvia Spain Portugal Belgium Netherlands Germany Switzerland Italy Czech Rep Slovakia Austria Poland Ukraine.
Best Sustainable Development Practices for Food Security UV-B radiation: A Specific Regulator of Plant Growth and Food Quality in a Changing Climate The.
Tax Policy Challenges in a Changing World. Unintended Consequences of Tax Rob Marston, “Window Tax”, 1 September 2010 uploaded via Flickr, creative commons.
Gavin Boyd Chief Executive (Designate) Education & Skills Authority (ESA) 4 March 2010 National Association of Head Teachers Gavin Boyd Chief Executive.
NSO data collections of subjective well-being
PISA 2015 results in England
TIMSS 2015 Toby Greany, Iain Barnes, Tarek Mostafa, Nicola Pensiero, Christina Swensson Test administration and national data analysis and reporting in.
Valuing Higher Education
Global overview partner work permits* Sept ‘16
Programme for International Student Assessment
Certification CS-100/ CSE-200 /CSC-1
Table 1. Reported confirmed hepatitis A cases: number and rate per population, EU/EEA, 2010–2014 Source: Country reports. Legend: Y = yes, N =
Global Housing Markets : A Supply Side View
How Canada Compares Internationally
DISTRIBUTION AUTOMATIC - GENERATION
Why.
Jenny Bradshaw NCETM National CPD Conference 23rd March 2011
The 1680 Family’s Reach.
Developing Maths Improvement Practitioner Team.
Figure 1. Number of reported hantavirus infection cases, EU/EEA, 2014
Locations where Black Panther was released in the theaters in 2018.
Citi Virtual Card Accounts – Continued Global Expansion
Status of EQ-5D-5L Valuation Using Standardized Valuation Methodology
Sourcing. Costs. HARDWARE + SERVICE
Table 1. Reported, confirmed campylobacteriosis cases: number and rate per population, EU/EEA, 2010–2014 Source: Country reports. Legend: Y = yes,
Table 1. Reported confirmed brucellosis cases: number and rate per population, EU/EEA, 2010–2014 Source: Country reports. Legend: Y = yes, N =
The European Parliament – voice of the people
The European Parliament – voice of the people
“GHG Data – 2006” Greenhouse Gas (GHG) Emissions Data for 1990–2004
Намалување на загадувањето на воздухот со електромобилност
European survey respondents by region.
EU: First- & Second-Generation Immigrants
Supporting learners with special needs or disabilities through inclusive education RIGA 2 June 2015.
Table 1. Table 1. Reported confirmed salmonellosis cases: number and rate per population, EU/EEA, 2010–2014 Source: Country reports. Legend: Y.
Niek Klazinga, Trnava, Thursday
Table 1. Reported confirmed cholera cases, EU/EEA, 2010–2014
Adriatic Persian Gulf Map Test #1 Answers.
Observed differences for net lending / net borrowing between annual non-financial and financial accounts (ESA tables 6 and 8 compared) Item 7 Eurostat.
European Union Membership
Adoption, adaptation and applicability of the Global Curriculum in Medical Oncology. Adoption, adaptation and applicability of the Global Curriculum in.
Average Freshman Graduation Rates,
Five things you probably don’t know from PISA….
“Integrating Microbial Knowledge into Human Life”
Adriatic Persian Gulf Map Test #1 Answers.
European representation of respiratory critical care HERMES participants. European representation of respiratory critical care HERMES participants. Countries.
Infographics on Electromobility (November 2018)
IBM's Geographical Structure and where IBM Global Financing has clients IBM Global Financing, the world's largest IT captive financier, has a total asset.
Infographics on Electromobility. APRIL 2019.
List the most powerful women in the world…
Digital transformation of tax administration
2006 Rank Adjusted for Purchasing Power
LAMAS Working Group June 2018
European Agency Statistics on Inclusive Education (EASIE) www
Prodcom Statistics in Focus
Electrification business
Presentation transcript:

John Jerrim UCL Institute of Education PISA 2015 results in England… ….and some things you may not know about PISA John Jerrim UCL Institute of Education

Background 72 countries participated (75 if you separate out the UK)………….. Conducted every three years since 2000 Reading, mathematics, science, collaborative problem solving Computer-based assessment for the first time in 2015…….. Focus in 2015 = science. 30 points = 1 year of schooling. 100 points = One international standard deviation.

1. What are we good at?

1a. Science (average scores) > 20 points above Between 10 and 20 points below Country Mean Singapore 556* Estonia 534* Japan 538* Taiwan 532* Country Mean Belgium 502* United States 496* Denmark Austria 495* Poland 501* France Portugal Sweden 493* Northern Ireland 500* Czech Republic Norway 498* Spain Scotland 497* > 10 points above Country Mean Finland 531* Vietnam 525* Macao 529* Hong Kong 523* Canada 528*   Between 20 and 30 points below Within 10 points Country Mean Latvia 490* Wales 485* Russia 487* Luxembourg 483* Country Mean China 518 Australia 510 South Korea 516 Germany 509 New Zealand 513 Netherlands Slovenia Switzerland 506 England 512 Ireland 503* ….+35 other countries > 30 points below

1a. Science (average scores) Significantly above the OECD average…..

1b. High-achieving pupils in science > 20 points above Between 10 and 20 points below Country 90th percentile Singapore 683* Country 90th percentile Macao 630* Vietnam 624* Belgium 629* France 623* United States 626* Hong Kong 622* Sweden 625* Norway > 10 points above Country 90th percentile Taiwan 655* Japan Between 20 and 30 points below Within 10 points Country 90th percentile Austria 621* Czech Republic 618* Portugal 620* Malta Scotland 619* Ireland Poland Denmark 617* Northern Ireland Luxembourg 615* Country P90 Finland 651* Australia 639 China 649 Netherlands 638 Estonia 648 Slovenia 636 New Zealand 647 Germany Canada 644 South Korea England 642 Switzerland 632 ….+38 other countries > 30 points below

1c. Example question…. ‘Bird migration is a seasonal large-scale movement of birds to and from their breeding grounds. Every year volunteers count migrating birds at specific locations. Scientists capture some of the birds and tag their legs with a combination of coloured rings and flags. The scientists use sightings of tagged birds together with volunteers' counts to determine the migratory routes of birds.’ Identify a factor that might make volunteers’ counts of migrating birds inaccurate, and explain how that factor will affect the count.

1c. Example question

2. What are we not so good at?

2a. Maths (average scores) > 20 points above Between 10 and 20 points below Country Mean score Singapore 564* China 531* Hong Kong 548* South Korea 524* Macao 544* Switzerland 521* Taiwan 542* Estonia 520* Japan 532* Canada 516* Country Mean score Latvia 482* Wales 478* Malta 479* Hungary 477* Lithuania Slovakia 475* > 10 points above Between 20 and 30 points below Country Mean score Netherlands 512* Belgium 507* Denmark 511* Germany 506* Finland Poland 504* Slovenia 510* Ireland Country Mean score Israel 470* Croatia 464* United States Within 10 points Country Mean score Norway 502* Northern Ireland 493 Austria 497 Czech Republic 492 New Zealand 495 Portugal Vietnam Scotland 491 Russia 494 Italy 490 Sweden Iceland 488 Australia Spain 486* England Luxembourg France   ….+27 other countries > 30 points below

2a. ….. Though we are not THAT bad Same as the OECD average…..

2b. Particular issue with the bottom tail in maths…… > 20 points above Within 10 points Country 10th percentile Macao 439* Ireland 400* Singapore 436* Switzerland 394* Hong Kong 426* Slovenia Japan 416* Poland 391* Estonia 415* South Korea Denmark 405* Norway Finland 404* Netherlands 390* Taiwan Germany 389* Canada Country 10th percentile Wales 377 England 369 Sweden 376 Italy 368 New Zealand 375 Iceland 367 Belgium 374 Lithuania 365 Spain Portugal Czech Republic 373 France 364 Australia 371 Luxembourg 363 Austria 370   > 10 points above Between 10 and 20 points below Country 10th percentile Vietnam 388* Russia 387* China Scotland 382* Northern Ireland Latvia Country 10th percentile United States 355* Croatia 351* Hungary Slovakia 349* ….+29 other countries > 30 points below

3. Changes over time

3b. Stable in England, but things have changed in other parts of the UK….. Mean science scores Scotland big decline in 2015…. Wales a consistent downwards trend…

3c. Decline in performance of top 10% in science in NI/ Scotland/ Wales…..

Six things you probably don’t know from PISA….

1. Shanghai did 50 points worse on the computer test in 2012 than in the paper test…..

2. Why does Viet Nam do so well? Country Mean Singapore 556* Estonia 534* Japan 538* Taiwan 532* Country Mean Finland 531* Vietnam 525* Macao 529* Hong Kong 523* Canada 528*   Country Mean China 518 Australia 510 South Korea 516 Germany 509 New Zealand 513 Netherlands Slovenia Switzerland 506 England 512 Ireland 503*

2. Why does Viet Nam do so well 2. Why does Viet Nam do so well? Only 50% of its 15-year-olds are eligible to take part! Figures refer to the 75th percentile in science. ‘Before’ = reported results ‘After’ = including 15-year-olds who are not in school, assuming they would all perform below the national median. http://www.oecd-ilibrary.org/education/pisa-2015-results-volume-i_9789264266490-en Table

3. Around 1 in 3 American schools declines to participate….. See page 71 of http://www.oecd.org/pisa/pisaproducts/PISA%202012%20Technical%20Report_Chapter%204.pdf

4. You can only really compare PISA reading results back to 2009 (not 2000)….. “Changes in design and construct coverage were particularly important in earlier PISA assessments. The change in performance observed between PISA 2000 and later assessments may thus not always reflect genuine changes in what students know and can do……… …..the associated uncertainty associated with comparisons involving PISA 2000, 2003 and 2006 reading results with later results is only imperfectly captured by linking errors. ….some caution is needed when interpreting reading trends before PISA 2009. Footnote 3 page 172 http://www.keepeek.com/Digital-Asset-Management/oecd/education/pisa-2015-results-volume-i/reading-performance-among-15-year-olds_9789264266490-8-en#.WIiw0fmLTIU#page28 Very few link items 3 questions all from 1 unit – which was not technically the best unit……

5. A lot of things changed in PISA 2015 from previous cycles. … 5. A lot of things changed in PISA 2015 from previous cycles...... ….and this had a non-trivial impact upon some of the results “The negative changes between PISA 2012 and PISA 2015 reported for Chinese Taipei (-18 score points) and Viet Nam (-17 score points) are, to a large extent, due to the use of a different scaling approach. Had the PISA 2012 results for mathematics been scaled with the PISA 2015 calibration sample and the PISA 2015 approach to scaling, the differences in results for Chinese Taipei and Viet Nam would have been only -3 points and -4 points, respectively” http://www.oecd-ilibrary.org/education/pisa-2015-results-volume-i/changes-in-science-performance-between-2006-and-2015-based-on-originally-scaled-and-on-rescaled-results_9789264266490-graph117-en

6. Have things really changed that much internationally over the long term? (1981 vs 2011) Has that much changed over the last 25-30 years? East Asian (e.g. Japan / Hong Kong) countries at top of the maths rankings England around the international average Sweden does surprisingly poorly Cross-country correlation All countries = 0.72 Thailand excluded (outlier) = 0.66 Note: TIMSS data from 2011 or closest available year (2007 or 2003)

FIMS (1964) vs TIMSS (2011) Has that much changed over the last 50 years? East Asian (e.g. Japan) countries at top of the maths rankings England around the international average Sweden does surprisingly poorly Cross-country correlation All countries = 0.40 Israel excluded (outlier) = 0.78 Note: TIMSS data from 2011 or closest available year (2007 or 2003)