Introduction and welcome

Slides:



Advertisements
Similar presentations
The Microinsurance Innovation Facility A collaboration between the ILO and the Bill and Melinda Gates Foundation.
Advertisements

Literacy Assessment and Monitoring Programme (LAMP) UNESCO Institute for Statistics.
Update on progress of training activities of MUSE Network Dr Domenico Gallipoli Durham University.
A big picture of the curriculum Adapted with thanks to colleagues at the Council for Curriculum, Examinations and Assessment (CCEA) Working draft: With.
PIAAC: ORIGINS, INTERNATIONAL DIMENSION, CONCEPTS AND AIMS William Thorn, OECD
Approaches for Reporting Vendor Performance in Vocational Rehabilitation: A Benchmarking Study by Florida VR Webinar November 21, :30-3:30 Eastern.
Mark Keese Head of Employment Analysis and Policy Division Directorate for Employment, Labour and Social Affairs Better skills for more inclusive and sustainable.
UNPACKING THE VALIDATION PROCESS
1 U.S. PIAAC National Supplement: Prison Study Overview Association of State Correctional Administrators Research and Best Practices Committee Gaylord.
Park Life Learning outside the classroom. Our Plan Our plan is to take a group of Key Stage 1 children to Abington Park and create a range of cross- curricular.
How to Write a Critical Review of Research Articles
PIAAC: SOME THINGS IT TELLS US ABOUT HIGHER EDUCATION New England Association of Colleges Conference 2014 William Thorn Senior Analyst, OECD.
Essential SNA Project being developed from 2011 to 2013.
UNICEF’s work and planned activities for the production of data on children with disabilities Claudia Cappa, Data and Analytics Section, UNICEF, NY.
Transparency in Searching and Choosing Peer Reviewers Doris DEKLEVA SMREKAR, M.Sc.Arch. Central Technological Library at the University of Ljubljana, Trg.
RIA: Communication – building credibility Aleš Pecka Department of Regulatory Reform and Public Administration Quality Ministry of Interior, Czech Republic.
SESSION 2.1 PROGRAMME OF ASSESSMENT TASKS IN GET GRADES R-9.
Israel Accession Seminar PIAAC: Programme for International assessment of Adult Competencies Skills strategy in OECD Programme for the International Assessment.
Measuring benefits of European Territorial Cooperation Programmes – Piloting of Typology 22 February 2011.
Working Group on Ageing Third Meeting 22 to 23 November 2010 Geneva, Switzerland Tuesday, 23 November Item 4 Discussion on the second review and appraisal.
Technology Needs Assessments under GEF Enabling Activities “Top Ups” UNFCCC/UNDP Expert Meeting on Methodologies for Technology Needs Assessments
© AKANANICONFIDENTIAL IMPLEMENTATION OF HR AND IDP UNITS SUPPORT PLANS: HR STRATEGY DEVELOPMENT TRAINING Session Two Facilitator: Mcezi Mnisi.
The Pathway to Success Enhance the Development of Staff Goal 6 – Initiative 3.
Self - organised learning groups 4 th June 2015 Susan Easton Head of Digital Learning.
Development Team Day 5a October Aim To explore approaches to evaluating the impact of the curriculum on pupil learning.
Tools for Mainstreaming Disaster Risk Reduction: Guidance Notes for Development Organisations Charlotte Benson and John Twigg Presented by Margaret Arnold.
Lean Manufacturing Practices In Malaysian SMEs. 1.0Introduction Research Background Why Lean Manufacturing needs to be practiced in SMEs? Problem Statement.
1 Researchers : 10 altogether; 3 from Denmark, 2 from Finland, 2 from Norway, and 3 from Sweden. Scientific board: professor Antero Malin, Finland (project.
Welcome to Year 3. Staff in Year 3  Mrs Carrier  Mr Keight  Miss Smith  Mrs Wilson.
Citizenship and Human Rights Education Assessing progress with the help of the Council of Europe Charter.
Introduction Social ecological approach to behavior change
European Women Interactive Learning GRUNDTVIG Learning Partnership PROJECT ACTIVITIES REVISION With the support of the Lifelong Learning Programme of the.
Emerging Themes Dr Yasmin K. Sekhon Level Verifier – Post Graduate Diploma Assignment brief June and September 2014.
Evaluation What is evaluation?
Ellinogermaniki Agogi Research and Development Department DigiSkills Network DigiSkills: Network for the enhancement of Digital competence skills.
Introduction Social ecological approach to behavior change
Methods and approaches of collecting education data
What is PIAAC?.
Introduction to Systems Analysis and Design
The future of PISA: perspectives for innovation
INTERNATIONAL ASSESSMENTS IN QATAR TIMSS
Policies and Planning of Literacy and CLCs in Afghanistan
CAPABILITIES WHAT IS A “CAPABILITY?”
Italy in the G7.
50 Minutes Session 23 Curriculum Vitae Preparation and Maintenance.
Session 23 Curriculum Vitae Preparation and Maintenance 50 Minutes
Webinar November 21, :30-3:30 Eastern Standard Time
RIA: Communication – building credibility
國立臺灣師範大學英語系陳秋蘭 PISA 與英語閱讀素養 國立臺灣師範大學英語系陳秋蘭
Implementing the Guideline for individual learning
Computer Science Education for elementary school students.
LISA, Anticipating the Next Generation of Longitudinal Data
Exploring the dimensions of quality in education - OECD perspective -
LISA, Anticipating the Next Generation of Longitudinal Data
Welcome to Geometry / Algebra II
Data Literacy Survey results and Data Protocols
Data harmonization in International Surveys on Education
Programme for the International Assessment of Adult Competencies
PRESENTATION OF SHORT-TERM ECONOMIC STATISTICS
Results of the 2nd year of the program Title
Business and Management Research
5th PIAAC International Conference, November 27-29, 2018, Bratislava
PISA for Development Technical Workshops Contextual questionnaires
“We Go Together”: Discipline-Based Linked Course Learning Community Leads to Positive Developments for Students Dawn McKinney and Karen Peterson University.
Session 5.3. Team Presentations
Quality Reporting in CBS
The use of test scores in secondary analysis
How to Achieve High Quality Data?
Jill Lansing State University of New York
Presentation transcript:

Introduction and welcome Seminar on Translating and Adapting Instruments in Large Scale Assessment , 7-8 June, Paris William Thorn, OECD

Purpose Welcome participants Background to the seminar

The seminar has been jointly sponsored by the OECD and GESIS Welcome The seminar has been jointly sponsored by the OECD and GESIS Co-organisers Dorothée Behr, Anouk Zabal Wide range of international experts as presenters and moderators Unfortunately Beth-Ellen Pennell was not able to attend for family reasons

Background 2nd in a series of seminars on methodological issues relevant to large scale cross-national assessments and surveys 1st seminar covered the question of the management of quality in large scale assessments Papers have been published as a special issue of the journal Quality Assurance in Education Volume 26, Issue 2: Managing the quality of data collection in large-scale assessments: Editor(s): Irwin S. Kirsch, William Thorn and Matthias von Davier

Background Objective is to stimulate a discussion on important methodological issues relevant to the conduct of large scale assessments Particularly on theoretical and practical developments (e.g. technology, ICT-based applications) that may affect the conduct of such studies Translation and adaptation has been chosen as the theme for this year’s seminar as is of central importance in achieving the comparable measurement Several dimensions: theoretical and practical What does comparability mean? How to best realise translations that meet the objectives for comparability?

1st cycle of the study has involved three rounds of data collection Background: PIAAC PIAAC – Programme for the International Assessment of Adult competencies Household-based study that assesses literacy, numeracy and problem solving skills of adults 1st cycle of the study has involved three rounds of data collection 2011-12 (24 countries) 2014-15 (9 countries) 2017-18 (5 countries)

2nd cycle of the study has started Background: PIAAC 2nd cycle of the study has started Main study data collection 2021-22 Release of data, reporting in 2023

Session topics Overall measurement approach: universal vs. culture-specific instruments This session touches upon the heart of comparable measurement and addresses fundamental issues of cross- cultural validity and relevance – what is feasible? Language/culture sensitive development of measurement instruments (quality assurance) This session discusses the need to consider cross-cultural issues already during the instrument development phase – and not only during translation.

Session topics International guidelines vs. implementation in countries and by translators This session focuses on translation and adaptation guidelines for cross-national surveys – their necessities and limitations. Tools and technological developments This session presents best practice and state-of-the art developments in translation tools and computer-assisted processes – and how these could and should be implemented in large-scale surveys.

Session topics Keynote presentation Quality control of translations: This session discusses: How can the quality of translations be assessed and how comparable is cross-cultural data? Keynote presentation Translating and Adapting Achievement Tests: PISA Guidelines, ITC Guidelines, or a Mixture?

Organisation of the sessions Sessions will last 90 minutes Two speakers Presentations will be approximately 25-30 minutes in length Around 30 minutes for discussion. Microphones are available for questions Keynote address will be followed by an opportunity for general discussion

Housekeeping Lunch – café outside the auditorium, cafeteria and restaurant on ground floor Contact Sabrina Leonarduzzi if you have any questions

Find Out More About PIAAC at: http://www.oecd.org/skills/piaac/ All national and international publications The complete micro-level database Email william.thorn@OECD.org Thank you