1. Predictive validities: SAT and PSU (faculty: Arquitectura) SOURCE: Pearson, Final Report Evaluation of the Chile PSU, January 2013

2. Predictive validities: SAT and PSU (faculty: Educacion) SOURCE: Pearson, Final Report Evaluation of the Chile PSU, January 2013

3. Predictive validities of the PSU (CTA v Pearson estimates) SOURCE: Pearson, Final Report Evaluation of the Chile PSU, January 2013; CTA

4. Incremental Predictive validities (engineering): (controlling for NEM) SOURCE: S.A. Prado, Estudio de Validez Predictiva de la PSU y Comparacion con el Sistema PAA, Universidad de Chile

5. Content coverage (values from 0% to 100%) It is not fair to expect students to master content to which they have not been exposed. …or, to compare students who have been exposed to students who have not. …how much of the content domain of a test has been taught in the schools.

6. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of school: 2012 Mathematics, Level 1

7. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of school: 2012 Language & Communication, Level 2

8. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of school: 2012 Mathematics, Level 3

9. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of school: 2012 Language & Communication, Level 4

10. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of curriculum: 2012 Mathematics, Level 4

11. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage curricular coverage in Chilean high schools, by type of curriculum: 2012 Language & Communication, Level 4

12. SOURCE: Centro de Estudios Mineduc, Cobertura Curricular en Ensenanza Media Lenguaje y Comunicacion – Matematica, Septiembre 2012 Percentage of Chilean high schools with full curricular coverage, by subject area: 2012 Levels 1--4

13. Subgroup differences Differences in test scores among subgroups (e.g., gender, ethnic, school type) should be due only to differences in the attribute measured by the test and not to systematic biases in the test.

17. SOURCE: Koljatic, Silva, & Phelps, Consequential Tests and Conflicts of Interest: The Case of Chiles PSU, forthcoming, 2014 Growing gaps in PSU Mathematics raw & adjusted scores, by type of curriculum: 20022010

18. SOURCE: Koljatic, Silva, & Phelps, Consequential Tests and Conflicts of Interest: The Case of Chiles PSU, forthcoming, 2014 Growing gaps in PSU Language & Communication raw & adjusted scores, by type of curriculum: 20022010

19. 3. A chronology of mistakes 2000, initial proposal, SIES/PSU project This proposal attempts a redesign of the tests currently used to select students for higher education in Chile. It is expected that [this new test will] have a positive impact in the efficiency of the selection process, improving the psychometric properties of the measuring instruments, and establishing a better articulation between the selection system and the secondary education curriculum. SOURCE: Proyecto FONDEF, Reformulacion de las Pruebas de Seleccion a la Educacion Superior

20. …the Academic Aptitude Test for entry to the university system is under revision, together with the universities belonging to the Council of Rectors. This instrument of entry selection, needs also to be aligned with the new curriculum and may become an exit exam from the secondary education system. 2001 (World Bank & MINEDUC) SOURCE: World Bank, Implementation Completion Report on a Loan in the Amount of $35 million to the Republic of Chile for Secondary Education, 2001 A chronology of mistakes (cont.)