1. Study group #3: NATO STANAG 6001 Ed 3 Level 4 Testing Mission statement: The aim of this study group is to formulate recommendations which could alleviate the national testing burden, by proposing different courses of action to the Secretariat to report to higher authorities.

2. Level 4 - expert Understands ALL forms and styles of speech on ANY subject matter and demonstrates understanding of highly abstract concepts in complex discussions in representation of official policies or points of view in lectures, negotiations, briefings and debates on matters of disagreement. Uses the language with GREAT precision, accuracy and fluency. Can perform highly sophisticated language tasks such as persuasion, representation and counseling. Communicates very effectively with NS

3. expert Uses stylistically appropriate discourse features Understands all cultural references and demonstrates a firm grasp of stylistic nuances, irony and humor. Demonstrates strong competence in formulating the final draft of a variety of official papers.

4. Testing to level 4 requires expertise, manpower resources, time and money… Should nations be responsible for their own level 4 testing under these circumstances??? So……

5. ??? Who needs a level 4 and in which skills? Do countries need to develop level 4 tests to distinguish people not only for international positions but also for their national job requirements? How many countries develop and administer level 4 tests? How many people sit for these tests per year? If they are 5-6 people is it worth developing such high proficiency test in each country?

6. How many countries have native speakers, who are experts in language testing, involved in their teams for STANAG testing? Would countries accept an established BILC body of expert testers to perform the level 4 tests? Will the countries provide voluntary national contributions to the process of identifying the need for level 4 tests and in all phases of test development? Should only native speakers rate level 4 writing and speaking skills? Is there research available in testing level 4?

7. How many people in your country apply for lev 4 tests each year? None – 7 countries; Less than 5 – 1 country; About 5-6 – 1 country; Between 5-10 – 4 countries; Indefinite number – 4 countries (progressive ML tests) Approximately 100 – 2 countries (incl other languages) Approximately 150 – 1 country.

8. Would your country be interested in using level 4 tests if developed by an external body appointed by BILC?

10. Would your country like to contribute to such level 4 tests even if you have your own national tests for level 4?

12. CONCLUSIONS Recommend that BILC Chairman send a letter to NATO authorities expressing BILC’s concern about the proliferation of SLPs requiring level 4 and the waste of national resources to train or test to that level if not needed.?????. Endorse the IMS tasking that BILC conduct a language needs analysis of SLPs in NATO job descriptions Recommend that BILC form a committee to conduct research on testing level 4 (feasible study).