Training & Testing for Specific Purposes Military Interpretation Bidirectional English-Pashtu Julie J. Dubeau & Jana Vasilj-Begovic Athens BILC 25 June 2008

Julie J. Dubeau & Jana Vasilj-Begovic FROM PLATO TO NATO: The Philosophical Implications of BILC

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes New course for Military Interpreters Process: Requirement Needs Analysis Standards Curriculum Testing Process still in progress

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes GeneralSpecific Train and test in broad language tasks based on C-T-A Train and test in job-specific language tasks based on L-N-A Diverse topical knowledgeShared knowledge Test un-rehearsed, unforeseen topics Test un-rehearsed, expected topics Provides info that is generaliseable to any other context or domain Provides info to a specific, well-defined, narrow context only

Julie J. Dubeau & Jana Vasilj-Begovic Language Needs Assessments (LNA) The aim of the LNA is to help clients/end users and stakeholders define the language components of that specialty. Team approach: Military experts with extensive experience in the targeted military specialty Language experts with detailed knowledge of the C/T/A components of the proficiency scale.

Julie J. Dubeau & Jana Vasilj-Begovic Language Needs Assessments (LNA) Outcome: A list of job tasks requiring the target language based on a known standard. A list where each job task is coded by four criteria.

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Metrics to assist team members: 1.Skill modalities (L, S, R) 2.Matching proficiency levels (Scale) 3.Frequency of occurrence (S, R, F)  Seldom: once in a while  Regularly: weekly, daily  Frequently: daily, every interaction 4.Criticality of task (L, M, H)  Low: Little impact on the safety of personnel  Medium: Failure to communicate could endanger personnel  High: Tasks must be accomplished for survival of personnel

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Application: Decision makers use this information to: Establish language requirements for specific jobs, Set criteria for progression to the next skill level within the specialty, Adjust job expectations, and Define instructional needs.

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Military Interpretation Contexts: Tactical Questioning Site Control Wrap-up Surveillance and Patrolling Sensitive Site Exploitation

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Tasks to be Trained: Skill modality: Speaking Issue orders, military commands. Ask concrete and factual questions Give instructions Level of tasks: 2 Frequency: F Criticality: H

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Skill modality: Listening Understand responses from people under duress Level of task: 2 Frequency: R Criticality: H

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Skill modality: Reading Understand the gist and some details in propaganda, leaflets, threat letters, etc. Level of task: 1+ Frequency: S Criticality: M

Julie J. Dubeau & Jana Vasilj-Begovic Steps in the empirical design and development of materials (adapted from Sawyer, Butler, Turner & Stone 2002) Interpreting tasksInterpreter needs Empirical data: Real needs and real- world tasks Test & materials development Systematic & consistent use Comparison of performance on tests & real-world tasks Test & materials update User needs and Expectations

Julie J. Dubeau & Jana Vasilj-Begovic PROFILE OF “ACADEMIC” VS OUR LEARNERS High proficiency in A and B languages Proficiency in language A Active listening skillsTo be trained Analytical skillsTo be trained Strong working memory and basic note-taking (split attention) To be trained Self-confidence and socio- cultural awareness May have Domain knowledgeTo be trained Extra-linguistic knowledgeMay have

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Curriculum Designing a modular approach Training language and interpretation skills simultaneously Developing materials to reflect defined topical domains, tasks and accuracy

Julie J. Dubeau & Jana Vasilj-Begovic INTERPRETATION PROCESS INPUT / LISTENING / RECEIVING PROCESSING / ANALYZING / VISUALIZING MEMORIZING AND / OR NOTE-TAKING OUTPUT / RESTATING / ARTICULATING

Julie J. Dubeau & Jana Vasilj-Begovic SAMPLE INTERPRETATION EXERCISES Expanding working memory (storytelling) Listening analytically (distinguishing main idea from ancillary facts, visualizing content) Anticipating/guessing meaning from context (written and oral close exercises) Note-taking (developing a system of symbols) Oralizing (paraphrasing text while reading it) Managing the interpretation situation

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes UNDERLYING ASSUMPTION The term “interpreted text” as is used in the descriptions below refers to the interpretation of spoken texts into one’s native and foreign language. These spoken texts are factual, concrete, and predictable in terms of topical content, chronology, vocabulary and grammatical structures used. In accordance with how spoken text types are generally characterized, these texts typically occur within the Level 2 range of the NATO STANAG 6001 scale. The interpretation skill described hereunder is measured and rated against a set of narrowly defined domains and performance criteria (language for specific purposes). One must not generalize that the skill described could meet professional interpretation requirements and/or standards in other contexts.

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Standards - Summary – Pass 1.Message is not seriously distorted at any point. 2.No major omissions or errors, but minor interpretation and language errors are present. 3.Choice of structure and vocabulary make text easy to follow. 4.The intent of the speaker is preserved. 5.The interpreter’s voice and accent are clear and understandable. 6.The correct grammatical person (ex.1st sg. or pl. was used most of the times.

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Standards - Summary – Fail 1.Some of the errors obstruct completely the intended message. 2.The interpreter’s voice and pronunciation are not always clear. 3.Message is incomplete, inaccurate and unfaithful most of the times. 4.Critical parts of the message, such as names and numbers, and their referents, may be misinterpreted. 5.Language errors lead to misunderstanding of the source text. 6.There is much strain on the listener to reconstruct meaning and to make sense of the spoken text.

Julie J. Dubeau & Jana Vasilj-Begovic Training & Testing for Specific Purposes Training Challenges Time on Task: Extremely limited Training may cease at any time Teacher training: Lack of qualified teachers

THANK YOU! QUESTIONS?