1. Pretesting and Test Analysis
How We Do Them in Hungary
Gabriella Szebenyi

2. Presentation Outline
basic information on STANAG examinations in Hungary
item writing and our pretesting practices
pretesting objectively marked items
the procedure for subjectively marked items
our future plans

3. Accredited Examination
Open exam
Exam fee
Single level exam
No time limit on the validity of the certificate
Nationwide recognition of the certificate
Operation under Accreditation Board supervision

4. Main Means of Professional Control
Accreditation Book
Consultation Sessions
Biennial Review

5. 2 new trial tests at three levels per academic year
Our Output
2 new trial tests at three levels per academic year

6. Pretest Procedure for Objective Items
Stage 1: in-house review of an item
Stage 2: in-house review of the revised item
Stage 3: review of the item by a native speaker
Stage 4: main trial
Stage 5: quantitative and qualitative analysis

7. Procedure for Subjective Items
Stage 1: informal review of an item
Stage 2: informal review of the revised item
Stage 3: review of the item by a native speaker
Stage 4: trial on small number of candidates

8. Future Plans increasing the number of item writers
involving several native speakers
establishing a pretest unit

9. Thank you for your attention