National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008

ICCS DMS Hamburg July 2008 Adapting FT instruments All instruments have to be adapted –including those for English-speaking countries Adaptations should be kept to a minimum Adaptations have to be documented in National Adaptation Forms (NAF) There should be consultation with the International Study Centre (ISC)

ICCS DMS Hamburg July 2008 Types of adaptations There are parts of instruments that have to be adapted –Provision in translation notes and NAF –Usually in carets ( ) There may be the need for adapting other items –This should only be done when absolutely necessary! In some cases, national centres may want to add items or categories –Should be discussed and agreed with ISC

ICCS DMS Hamburg July 2008 Purpose of National adaptation forms Necessary information for translation verification Reference for layout verification Facilitates data processing –Documenting any deviation from international format

ICCS DMS Hamburg July 2008 Process of adapting instruments Completing NAF in cooperation with translator and reviewer (> Version I) Consultation about NAF with ISC (> Version II) Documenting any changes from translation verification (> Version III) Documenting any changes from layout verification (> Version IV)

ICCS DMS Hamburg July 2008 National adaptation forms (NAF) EXCEL format One general information spreadsheet Nine adaptation forms –Cognitive test –Student questionnaire –Teacher questionnaire –School questionnaire –European regional test –European regional questionnaire –Latin American regional test –Latin American regional questionnaire

ICCS DMS Hamburg July 2008 General information spreadsheet Includes –Name of country –Language of instrument –ISC consultant name Record of dates for each NAF version Information on participation in international options Space for comments

ICCS DMS Hamburg July 2008 Columns in NAF - 1 Columns 1 to 3 should not be modified: –1: International question numbers –2: International question/category wording –3: International variable or code Column 4 to 5 may have to be completed –Only when adding items or categories! –No changes for test items!

ICCS DMS Hamburg July 2008 Columns in NAF - 2 Columns 6 to 7 have to be completed when marked in yellow: –6: National wording of adaptation –7: English translation of this adaptation Column 8 is reserved for any comments NRC would like to make –Useful for consultation when implementing adaptations that are additional Column 9 is reserved for comments by the ISC during the consultation

ICCS DMS Hamburg July 2008 Adding items or categories Not acceptable for cognitive test(s)! Requires discussion and agreement with ISC Only acceptable in exceptional circumstances MUST be documented in NAF!

ICCS DMS Hamburg July 2008 International and national options International options will be included in NAF –National centres should indicate whether they want to include the optional question(s) National options should be documented in the NAF –At the end of each questionnaire spreadsheet space is provided for documenting national questions

ICCS DMS Hamburg July 2008 Regional instruments Spreadsheet for regional instruments should be deleted from NAF for non- participating countries NAF for Asian regional module will be provided once the instrument is finalised

ICCS DMS Hamburg July 2008 Adapting test items No additional items or categories are allowed Less room for adaptations than with questionnaire items Typically only some expressions in carets ( ) have to adapted, for example: –

ICCS DMS Hamburg July 2008 Student questionnaire - 1 Notes provided to guide adaptation Many required adaptations, in particular for background questions Examples of compulsory category adaptations are –ISCED levels for expected qualification and parental education –Language spoken at home –Country of birth

ICCS DMS Hamburg July 2008 Student questionnaire - 2 Educational levels should be adapted following the international ISCED classification – D=3813&URL_DO=DO_TOPIC&URL_SE CTION=201http:// D=3813&URL_DO=DO_TOPIC&URL_SE CTION=201 –Manuals in English, French, Spanish, Russian, Arabic and Chinese Where ISCED mapping is difficult, the ISC will help during consultation!

ICCS DMS Hamburg July 2008 Student questionnaire - 3 Expressions – International options in StQ –Q2b Ethnic background of student –Q11b Household composition –Q34 – Q36 Questions on religion

ICCS DMS Hamburg July 2008 Teacher questionnaire - 1 Notes provided to guide adaptation Need to adapt terms that depend on national educational system Categories that need to be adapted, for example: –School subject categories Expressions that need to be adapted to national context as for example: –

ICCS DMS Hamburg July 2008 Teacher questionnaire - 2 International option with questions for teacher teaching subjects related to civic and citizenship education –to be adapted as subjects that at the national level can be labelled as “civic and citizenship education”

ICCS DMS Hamburg July 2008 School questionnaire Notes provided to guide adaptation Need to adapt terms that depend on national educational system Expressions that need to be adapted to national context as for example: –

ICCS DMS Hamburg July 2008 After completion of NAF Send NAF to immediately after International Study Centre will respond within shortly and send NAF back with –indications whether adaptation is appropriate from the ISC’s point of view (ok) –suggestions for changes (!) –possible questions for further clarification Modified NAF will become version II

ICCS DMS Hamburg July 2008 Questions or comments?

ICCS DMS Hamburg July 2008 Practical example - 1 Cognitive test: –Provide adaptations for item codes 103 and 105 Student background questionnaire –Provide adaptations for expected ISCED qualifications A04a and A04b –Provide adaptations for country of birth (B02)

ICCS DMS Hamburg July 2008 Practical example - 2 Student perceptions questionnaire: –Provide adaptations for question H02 (trust in institutions) Teacher questionnaire –Provide adaptations for Q1 to Q3 School questionnaire –Provide adaptations for Q5