Translation and Verification of ICCS instruments Summary of the Field Trial & Plans for the Main Study National Research Coordinators Meeting Windsor, June 2008

NRC Meeting Windsor 9-12 June 2008 Content of presentation Field Trial - Scope of verification - Quality of translation/adaptations - Major problems and feedback from the NRCs Main Study - Process of preparation of the national instruments - Translation/adaptation procedures - External verification of the national instruments - Timeline

NRC Meeting Windsor 9-12 June 2008 FT: Scope of verification 34 educational systems participants: international and regional instruments - 12 participants: international instruments 22 languages - Most popular: Spanish (7) and English (4) 2 participants used two languages September- October 2007Time: September- October 2007

NRC Meeting Windsor 9-12 June 2008 FT: Quality of translation and/or adaptations  Overall very good quality! Primus Inter Pares: CHILE, ENGLAND, FINLAND

NRC Meeting Windsor 9-12 June 2008 FT: Typical errors Translation: mistranslations, “free translation” vs. “word for word” translation, inconsistencies, lack of harmonization between translators Cultural Adaptations: not always documented properly, use of English terminology Omissions/Additions Grammar: English syntax Punctuation Typos

NRC Meeting Windsor 9-12 June 2008 FT: Feedback from countries (TV Summary and SAQ) 16 participants completed TV Summary Form - 4 accepted all severity code “1” suggestions - 12 accepted some/partially of severity code “1” suggestions  6 participants reported in SAQ problems with translation and/or translation verification and/or documentation  Reported problems: - Translation/adaptation of some concepts and words (e.g. local community, school, council, school board, ombudsman, immigrants) - Problems with the Zedland, etc. - Updating NAFs - Verification and NAFs for instruments developed in English - Coordination between NAF – language – layout verification Other issues: - Using other country translation (7 countries)

NRC Meeting Windsor 9-12 June 2008 MS: Process of preparation of the national instruments The same process as in Field Trial: Step 1: National Center translates and/or adapts instruments Step 2: National Center reviews instruments and completes NAF Step 3: International Center reviews NAF Step 4: The IEA Secretariat conducts external verification of translation/adaptation Step 5: National Center corrects and assembles instruments Step 6: International Center conducts layout verification Step 7: National Center conducts final review and prints instruments The same team as in Field Trial: Translator  reviewer  NRC

NRC Meeting Windsor 9-12 June 2008 MS: Procedure of preparation of the national instruments Select items/questions which were changed after Field Trial. Retranslate them. Select and review carefully items/questions which remain unchanged after Field Trial. Correct/ improve them if necessary. Follow the same translation/adaptation formula as in Field Trial. Use Field Trial experiences. If your country participated in CIVED and you want to have overtime comparisons: do not change the trend items! Update NAFs on each stage of your work.

NRC Meeting Windsor 9-12 June 2008 MS: International verification of translation/adaptations Materials submitted to external verification: - translated\adapted instruments (international and regional)* - NAFs ( to be reviewed twice: by the International Center and by the international reviewer) Feedback in electronic form: - suggestions inserted in NAFs - proposed corrections, changes and comments (including severity codes) inserted in instruments Please use DPC FTP Server for uploading and downloading instruments! * Note: Please send test in blocks of items; do not send booklets!

NRC Meeting Windsor 9-12 June 2008 MS: International layout verification The same procedure as in Field Trial: - One copy of each instrument (translation verified and corrected) as PDF file - Updated NAFs - The ISC will review instruments and will send its comments to NRC

NRC Meeting Windsor 9-12 June 2008 MS: Finalization of the national instruments Final corrections to the instruments have to be introduced National Adaptation Forms have to be revised Final version of the instruments and National Adaptation Forms should be sent to ISC INSTRUMENTS CAN BE PRINTED!

NRC Meeting Windsor 9-12 June 2008 Timeline Translation verification opens: - For Southern Hemisphere: SEPTEMBER 1, For Northern Hemisphere: JANUARY 1, 2009 Verification of full set of instruments takes approximately two – four weeks, dependently on: - Quality of translation - “Appointment” for translation verification

NRC Meeting Windsor 9-12 June 2008 Questions and comments ?!!