Study Group 3 Standardization

What we found… Who? All testers regardless of experience Teachers/invigilators especially need standardizing All test administrators with respect to other skills and protocols

How often? Depends on situation: Before formal testing sessions, especially when there are long breaks between testing sessions Testing sections that have prolonged testing sessions must make time for standardizing Whenever there are new members on team

What? For Speaking and Writing: Listen to BAT samples Listen to previous interviews to ensure inter/intra reliability Look BAT writing samples Look at “difficult” pieces of writing – those that did not get a unanimous rating Standard rating grids Structure of interviews Should also standardize protocols for reading and listening

Problems Main problem: We standardize among our team members, but we do not know if we are standardized with other countries

Recommendations E-platform: With this, we can then listen to others’ interviews and see their ratings Add our comments to interviews Standardize writing practices, i.e. length of response, number of prompts, etc Standardize the number of items in reading and listening components

Cannot forget the need to standardize in other languages tested Can listen to interviews from people with different first languages in order to be exposed to different accents