1. www.britishcouncil.org1 Barry O’Sullivan | British Council Innovation in Assessment: Making Things Happen EMINENT November 13 th and 14 th 2014 Zurich, Switzerland

2. www.britishcouncil.org2 Overview Looking Back Changes Assessment & Change Ways forward

3. LOOKING BACK where did it all come from?

4. www.britishcouncil.org4 Looking Back 科舉

5. www.britishcouncil.org5 The First Half Century of Testing 1845 Testing becomes part of educational practice [USA] 1880 Testing established in educational practice [USA & UK] Objective tests [USA] 1864-70s English Maths & Science Reliability investigated [UK – HE] 1890 1911 Thorndike develops first standardised scale [USA] MCQ [USA] 1914 1913 First ‘Modern’ standardised test [UK] 1887 Psychometrics Laboratory [UK] Significant Progress in Statistics [UK] 1900s Pearson’s Chi-Square [1900] Student’s t-statistic [1908] 1869 Galton’s first paper on psychometrics [UK]

6. www.britishcouncil.org6 The Atlantic Divide 1913 Maryland Decision [USA] Psychometric-Structuralism [reliability-focused] 1913 Cambridge CPE [UK] Education-Learning [validity-focused]

7. www.britishcouncil.org7 Test Validation Theory 1950s Construct Validity Content Validity Criterion Validity 1990s Construct Validity [range of evidence] Test Focused 1980s ‘Real World’ Testing 2000s Socio-Cognitive Approach Test Use Focused

8. CHANGES the world is turning

9. www.britishcouncil.org9 Changing Learning

10. www.britishcouncil.org10 Changing Society

11. www.britishcouncil.org11 And What About Assessment?

12. www.britishcouncil.org12 Why is this Relevant? Curriculum DeliveryAssessment The Learning System

13. Prinsloo and Rogers (2013) HSRC South Africa What we know… www.britishcouncil.org13 Learning – Assessment Disjunct c. 25%

14. INNOVATION IN ACTION case study – the british council

15. www.britishcouncil.org15 The British Council & Assessment 1980 1989 2012

16. www.britishcouncil.org16 What we do in Assessment Assessment Strategy Fit with Learning System Assessment Literacy Accessibility Stakeholder Needs Communication Research & Development Dissemination Activities Research Support

17. www.britishcouncil.org17 Overview of Aptis

18. www.britishcouncil.org18 Technology Behind Aptis

19. www.britishcouncil.org19 Innovation Within Aptis Task Types Content Scoring Reporting Localisation Theoretical ‘Fit’ Accuracy Transparency Specifications Item-Writer Training Examiner Training Rating Scales Research Matrix Validation Localisation

20. CONCLUDING COMMENTS what’s the point?

21. www.britishcouncil.org21 Innovation in Assessment BUT Innovation must mean far more than technology Technology led Innovation is potentially great for learners and teachers

22. www.britishcouncil.org22 The Key to Successful Innovation

23. www.britishcouncil.org23 Thank You