1. 1 Combining Language Proficiency Testing in Accordance with STANAG 6001 with Specialist Language Skills Testing Dr. Dugald Sturges, Federal Office of Languages Hürth, Germany STANAG 6001 Testing Conference SHAPE, Mons, Belgium 4 September 2013

2. E P T S T I N G Combining Language Proficiency Testing with Specialist Language Skills Testing S L P S L P

3. Goal of testing i.a.w. STANAG 6001: To determine language proficiency …defined as “An individual’s unrehearsed, general language communication ability.”

4. Goal of testing i.a.w. STANAG 6001: The table of language proficiency levels on which the SLP is based is intended to: a. Communicate language requirements for international staff appointments. b. Record and report, in international correspondence, measures of language proficiency. c. Compare national standards through a standardized table while preserving each nation’s right to maintain its own internal proficiency standards.

5. The implication: doAn SLP does not qualify you to do anything.

6. Content Language Acquisition vs General Language Acquisition ESP aims at conveying: a) abilities required for successful communication in occupational settings; b) content language acquisition dominates s. Dudley Evans and St. John: Developments in ESP: A multi-disciplinary approach. Cambridge: CUP, 1998. ESP may be restricted as to the language skills to be learned (e.g. reading only - mechanics) It also may be restricted in terms of standardized lexis (e.g. air traffic controllers) General language competency is often incongruous to occupational experience.

7. Special language requirements International requirements: International requirements: e.g. Aviation (ICAO certification) Certain professional tasks require specialist language certification National requirements:National requirements: e.g. Technical-logistic English Pre-Deployment courses (mentors, observers) Medical personnel Etc.

8. 8 Result: Specialists are often not sent for (mandatory) SLP testing before specialist training and testing.Result: Specialists are often not sent for (mandatory) SLP testing before specialist training and testing. The reaction of some stakeholders: do“If an SLP does not qualify you to do anything, but specialist language certification is required, why bother with an SLP?”

9. Does testing according to STANAG proficiency levels make sense as a means of maintaining and improving quality of specialist performance?Does testing according to STANAG proficiency levels make sense as a means of maintaining and improving quality of specialist performance? Is testing according to STANAG proficiency levels always necessary?Is testing according to STANAG proficiency levels always necessary? Can SLP testing replace all professional language skills certification? Can SLP testing replace all professional language skills certification?

10. Proficiency Testing vs Qualification Testing

11. SLP is an EVALUATION – You cannot “FAIL” an SLP: “You are what you is.” Qualification oriented testing verifies the mastery of certain skills needed to perform a particular task If you do not have these skills you FAIL to be qualified for the task Proficiency vs. Qualification

12. Analogy: Driving Licence vs. Vehicle Certification Example of general driving proficiency (source: USAREUR driver‘s license exam) “What does this sign indicate?” In order to be certified to operate a particular military vehicle, you first need a valid driver’s license: This is a basic certification. It qualifies you to operate most cars.

13. Analogy: Driving Licence vs. Vehicle Certification e.g. Have your vision evaluated: SLPSLPSLP However, prior to this certification, you need to have your aptitude for driving evaluated: This is a basic aptitude. Without it you cannot be certified.

14. Specialist tasks require specialized certification – and testing “But if you gotta Ford, why you wanna Humvee?” 19. When you ford the HMMWV, the vehicle speed should be - a. 20 MPH or less. b. 15 MPH or less. c. 10 MPH or less. d. 5 MPH or less. (Circle choice.)

15. Military Driver – or Military Vehicle Operator? Both require basic prerequisite aptitudes and basic driving proficiency, but one also requires additional specialized skills certification.

16. Standardized Language Profile Standardized Language ProfileSLP Specialized Language Profile Specialized Language Profile ESP does not work without SLP. ESP does not work without SLP. The same holds true for language learning and testing: But why not?

17. 17 Specialist language aims at functional tasks, but may require the conveyance of abstract concepts, specialist terminology or use of more advanced structural devices as appropriate to the user’s professional field.Specialist language aims at functional tasks, but may require the conveyance of abstract concepts, specialist terminology or use of more advanced structural devices as appropriate to the user’s professional field. The task may be within the SLP Level 2 range, but the language required to perform that task may be more sophisticated.The task may be within the SLP Level 2 range, but the language required to perform that task may be more sophisticated. Language proficiency is not a value unto itself, but is inextricably embedded in the performance of a particular professional task. Language proficiency is not a value unto itself, but is inextricably embedded in the performance of a particular professional task. What makes specialist language “special?”

18. In case of failure of either or both parts of the language examination, all ratings are to be suspended and the examination is to be repeated after 3 months at the latest. During this period the AT officer is to refresh his or her language skills in self study. (…) “In the case of a repeat failure it is necessary to obtain a new valid 3332 SLP” before the suspension of the rating can be lifted. ESP testing anchored in a STANAG 6001 framework Example: ICAO certification of Bundeswehr ATC and FIS:

19. 19 Examinees with solid language proficiency plus knowledge of specialist terminology and usage are usually prepared for specialist language certification (e.g. ICAO Level 4)Examinees with solid language proficiency plus knowledge of specialist terminology and usage are usually prepared for specialist language certification (e.g. ICAO Level 4) SLP Level 2… PLUS specialist knowledge? Consequence : a combination of SLP testing PLUS specialist language qualification is essential. The less specialist knowledge the examinees have, the higher level of language proficiency they need to make up for the deficit. The less specialist knowledge the examinees have, the higher level of language proficiency they need to make up for the deficit. However, even a Level 4 SLP candidate can not make up for a total lack of specialist knowledge: Language cannot entirely replace practical skills. However, even a Level 4 SLP candidate can not make up for a total lack of specialist knowledge: Language cannot entirely replace practical skills.

20. Despite considerable agreement between the Despite considerable agreement between the results of the two types of examination, SLP testing alone cannot entirely replace specialist language certification. results of the two types of examination, SLP testing alone cannot entirely replace specialist language certification. Summary SLP testing i.a.w. STANAG 6001 is a prerequisite for specialist language training and testing. SLP testing i.a.w. STANAG 6001 is a prerequisite for specialist language training and testing. On the same token, specialist language certification alone cannot replace SLP evaluation, as it only tests proficiency in a very specific context. On the same token, specialist language certification alone cannot replace SLP evaluation, as it only tests proficiency in a very specific context.

21. Summary (continued) SLP testing i.a.w. STANAG 6001 and specialist SLP testing i.a.w. STANAG 6001 and specialist language testing need to be closely coordinated. language testing need to be closely coordinated. Any combination of SLP and specialist language testing needs to be carefully approached due to the differing testing goals. Any combination of SLP and specialist language testing needs to be carefully approached due to the differing testing goals.

22. 22 ‘Nuff said?‘Nuff said? The reaction of another stakeholder: “If my commander had sent me to an SLP refresher course beforehand, I would have felt more comfortable taking this qualification exam.”

23. Thank you for your attention.