1. Testing Level 3 Speaking in Slovenia: Successes & Challenges School of Foreign Languages Ministry of Defense, Republic of Slovenia Tamara Derman Zadravec Mary Jo Villalobos BILC Seminar Riga, 04 – 07 October 2004

2. Overview of School of Foreign Languages Successes –Level 3 Speaking Tasks –Testing Environment –Rating Challenges

3. Legend: ŠPČ; NCO School ŠČ; Officer Candidate School PŠŠ; Command and Staff School DOCTRINE,RESEARCH,DEVELOPMENT Legend: CDR; Doctrine and Development Center Legend: ŠTJ; School of Foreign Languages ŠE; Sports Unit CU; Training Center, by end of 2004 GORŠ; Mountain School, currently part of CU, will be subordinated to PDRIU in 2005 CBUPE; Center for Combat Training of SAF HQ and units, starting in 2005 LETŠ; Aviation School, to be integrated in 2005 EDUCATION AND TRAINING ŠE: Sports unit KIC; Library and Information Center VM; Military Museum ŠČŠČ ŠČŠČ Š PČ P ŠŠ CDR Š TJ CU CBPUE LET Š ŠEŠE ŠEŠE KIC COMMAND VM COMMAND; Management and HQ of Training, Doctrine and Development Command PDRIU (TRADDOC)

4. School of Foreign Languages (SFL) Commandant Director of Studies Adviser for testing issues PfP Language Training Department Ajševica Teaching and Testing Department Šentvid Translating and Interpreting Department Support unit

5. Areas of Work I.Language Training II.Translation, interpreting and military terminology III.Testing

6. Level 3 Tasks Contexts –Social –Professional & Military –Particular interests Autobiographical Information –Greeting –Spelling –Post/Position –Present, Past, Future Narration

7. Level 3 Tasks (cont) Hypothetical Telephone RP Supported Opinion Briefing

8. Testing Environment Organization Briefing as an example Instructions Preparation and Delivery Q & A Testing team & roles

9. Briefing Topics CARD 1 –My Professional Training –Non-military Roles of the Military –Changes During my Lifetime –National Holidays in my Country CARD 2 –The History of my Unit / Department –The Role of Training in the Military –A Great Leader –My Home Town CARD 3 –The Role of Humans in a Modern Military –A Completed Project I am Familiar with –Traditions in my Country –The Transport System of my Country CARD 4 –Financial Implications in the Modern Military –A Significant Battle in my Country’s History –The Sights of my Capital City –My Mother Tongue

10. Rating Independently Standardized Form Feedback to Candidates

11. EXAMINERS1.2.DATE CANDIDATE Met / Did not meetlevel 1 / level 2 / level 3 criteria TASKCOMMENTS, EVIDENCE OF COMPETENCE, IMPROVEMENTS+ / - Greetings Spelling Post / Position Present Past Future ………………………………………………………………………………….. Hypothetical Telephone RP ………… Briefing ………… Supp Opinion ………… Slovenia STANAG 6001 – Level 3

12. 1. CRITERIA2. DETAILS3. RangeBasic structures Complex structures (including avoidance) Lexis AccuracyGrammatical Inhibits fluency Pronunciation - Word level Pronunciation - Sentence level FluencyDelivery – hesitation/groping Extended discourse (paragraphing) Clarifying / Resolving misunderstandings AppropriacySocially acceptable Lack of initiation Task AchievementDirections Discussion of picture Role Play Role play – functions / appropriacy Briefing Structuring Dealing with questions Expression of opinions Reacting to opinions, agreeing/disagreeing OtherSpecify Additional Comments EXAMINERS – please note,  The purpose of this form is to indicate areas where candidates did not meet target criteria. This should be indicated by an X in column 3.  Add numbers to indicate any priorities, from 1 = highest priority. e.g. X1, X2, …..  Criteria should relate to linguistic performance on the STANAG test overleaf.  Make sure criteria are those at the appropriate level.

13. Criteria Functions & Accuracy –Balance of everyday & abstract subjects –Complex structures, adequate vocabulary, & low frequency structures with some errors –Language socially acceptable, contextually appropriate in most situations –Basic grammar structures, simple sentences used without error –Pronunciation that doesn’t interfere with intelligibility –Occasional hesitation but flow of speech maintained

14. Challenges/Working Issues “Fairness” of exam for all candidates Assigning Levels Appeal System Feedback to Examiners Training for Examiners Bank