Pretesting and Test Analysis How We Do Them in Hungary Gabriella Szebenyi

Presentation Outline basic information on STANAG examinations in Hungary item writing and our pretesting practices pretesting objectively marked items the procedure for subjectively marked items our future plans

Accredited Examination Open exam Exam fee Single level exam No time limit on the validity of the certificate Nationwide recognition of the certificate Operation under Accreditation Board supervision

Main Means of Professional Control Accreditation Book Consultation Sessions Biennial Review

2 new trial tests at three levels per academic year Our Output 2 new trial tests at three levels per academic year

Pretest Procedure for Objective Items Stage 1: in-house review of an item Stage 2: in-house review of the revised item Stage 3: review of the item by a native speaker Stage 4: main trial Stage 5: quantitative and qualitative analysis

Procedure for Subjective Items Stage 1: informal review of an item Stage 2: informal review of the revised item Stage 3: review of the item by a native speaker Stage 4: trial on small number of candidates

Future Plans increasing the number of item writers involving several native speakers establishing a pretest unit

Thank you for your attention