PISA FOR DEVELOPMENT Technical Workshops Components and input for ToR of the International Contractor(s) 9 th April 2014 OECD Secretariat 1

Questions How will you facilitate the countries to situate the framework in relation to their curriculum and priorities? What approach will you take to facilitate decision making by the countries with regard to item selection? What would your approach and methodology be to ensure that development of any national items does not impact on the assessment as a whole? How would you manage the trade-off between targeting and framework coverage? What are the kinds of adaptations that are permissible and desirable to ensure cross- cultural validity? How would you ensure that the countries are clear on the items and framework coverage? Constraints Must use the PISA frameworks No developing of new items Requirements Have to ensure sufficient framework coverage and coverage of full range of proficiency levels Assessment frameworks and items…….

Questions How would the scaling model you employ ensure comparability to international PISA results and will they propose alternative, exploratory studies to look at better options for the P4D countries? What would your approach be to test targeting? How would you ensure that items are selected from all the proficiency levels even if there are more easier items? How would you propose a test design that allows for subscale and reporting from one domain? How would you ensure adequate linkages between P4D and previous cycles of PISA to facilitate comparability? What would be the best test design to allow paper and pencil and elements from PISA 2015 (computer delivery)? What would be the most fit for purpose test design with regard to assessment material time, units, clusters and booklet design? How would you ensure PISA standards are met? Constraints All items must be drawn from the secure pool Test must be two hours Three clusters to ensure comparability with PISA Requirements Compliance with each of the PISA standards, including sampling, adaptation, security of items, etc. Test designs

Questions What kinds of analysis will you include in the country reports to respond to policy issues and priorities identified by the countries? How would you address country specific and analytical priorities that have implications for several of the procedures, starting with the sampling? How would you support the capacity building that relates specifically to computation of indices and score generation? Constraints Results for the countries are confidential to the countries. Requirements Analytical outputs address the policies and priorities that have been identified by the countries. Analysis and reporting has to allow students to demonstrate the full range of proficiency levels in all three domains. Must provide additional information in cases where large numbers of students perform below the lowest proficiency levels? Proficiency levels, analysis and reporting

Questions How would you address the capacity building priorities of the countries, including sustainability beyond the project? What is your experience of building capacity for student assessment in developing countries? How would you ensure that capacity building priorities that are not immediate requirements of the project are met within the time-scale and budget of the project? What innovative approaches to data collection that still adhere to PISA standards can be considered? How would you support the peer-to-peer learning activities that are part of the project? Constraints Delivering capacity building within the project time-scale and budget Requirements Demonstrated capacity to deliver capacity building for student assessment in developing countries. 5 Capacity building

Questions How are you going to ensure effective and fluid communication and engagement with countries? How would you assist the countries to interpret the findings and results of the assessments and consider the use of the country report? What would you propose for a common framework analysis for the countries and how would this allow country specific priorities? How would you support the countries with their communication and dissemination efforts in relation to the results of the assessment? How to support communication and mutual support between P4D countries? Constraints Requirements Bidders must provide budget breakdowns for different project implementation scenarios Bidders must demonstrate sufficient depth and breadth of knowledge of the context of developing countries 6 Implementation with countries