UK MOD Language Assessment MODLEB UK MOD Language Assessment Lt Col JD Lewis RE SO1 DOLSU Maj CED Burrows AGC (ETS) SO2 Requirements & Evaluation, DOLSU
Definitions MODLEB – Ministry of Defence Languages Examinations Board EBP – English Base Paper MCQ – Multiple Choice Question MLA – Multi-Level Assessment Operational languages: Pashto, Dari Arabic, Farsi, Somali Short Answer – length defined in rubric Usually fewer than 10 words
MODLEB 2011 Expiry of current MODLEB contract Evolved language requirement Comprehensive re-evaluation Job Analysis Training Process Financial climate General proficiency vs operational requirements
MODLEB 2011 Operational Requirement Language Training Assessment
Applied Skills Military use of language must have practical application Conducting business Rapport building and general conversation Task and linguist management Gisting Situational or liaison interpreting
Operational/Intelligence Contexts Operational/Intelligence Generalist Planned operations Work with indigenous forces Instructing Dealing with the public Incident control Information gathering Life support Social engagement Office workplace Public speaking Special-to-role business Common: Telephone conversations Dealing with media Announcements Word processing Atmospherics (Media)
MODLEB 2011 SLP 1 (Short course output) Threshold assessment retained Focused proficiency based on operational experience SLP 2 – 4 (SLP 0 – 4 output possible) Multi-level assessment (MLA) General proficiency with wide-ranging military focus Concentration on accurate measurement of SLP 2 and SLP 3 English base paper model retained
SLP 1 – Threshold Assessment Listening Military Comprehension 1 Multiple Choice Questions Military Comprehension 2 Reading Military Comprehension Short Answer Questions Operational Signs Short Answer Questions Speaking General Conversation Military Business 1 Transaction Back Brief Military Business 2 Transaction
Broadcast – Military News & Comment (SLP 3/3+) MLA – Listening Section 1 Section 2 Task 1 Briefing (SLP 2+/3) Excerpts (SLP 2) Task 2 Task 3 Section 4 Section 3 Broadcast – Military News & Comment (SLP 3/3+) Staff Report (SLP 4)
MLA - Reading Section 1 Section 2 Task 1 Briefing (SLP 2+/3) Excerpts (SLP 2) Task 2 Task 3 Section 4 Article – Advanced Topic (SLP 4) Section 3 Military Report (SLP 3/3+)
MLA – Productive Skills Speaking Section 1 – Guided Conversation Section 2 – Information Retrieval Section 3 – Present & Justify Writing Single piece of written work 90 minutes Six stimuli (two visual, four textual – in English)
The Balance Threshold Assessment Rigorous assessment at a level Narrow range of lexis testable Requires staging, or profile may be unuseable Multi-Level Assessment Cumulative ‘snapshot’ assessments Number/breadth of tasks Useable profile For candidate For employer
Other experience and contributions welcome! MODLEB 2011 Currently in first phase of Pilot Second phase Jun/Jul 11 Roll-out for Oct 11 Positive indications on current Pilot format Poor candidate perception of MCQ Listening problematic Other experience and contributions welcome!
Contact details: JtCap-DOLSUSO2ReqtEval@mod.uk +44 (0)1980 618112 Questions? Contact details: JtCap-DOLSUSO2ReqtEval@mod.uk +44 (0)1980 618112