1. Designing course evaluation
Wolfgang Zecha
Designing course evaluation
The AAF Approach

2. LINGUA: AAF Language Policy AAF LNGINST Quality Policy
Agenda
LINGUA: AAF Language Policy
AAF LNGINST Quality Policy
Evaluation design

3. AAF Language Institute – Mission
Facilitating the language-related interoperability
of the Austrian Armed Forces

4. LINGUA
L Language and Cultural Awareness
I Interoperability and Cooperation
N Novelties and Innovation
G Governance of Defense Language
U Unified Civil and Military Security Language Services
A Adaptability and Transformation

5. L I N G U A Language and Cultural Awareness
Focus on probable operational tasks, including regional expertise
Basis: Substrategy Defense Policy
Not the military language as such, but rather the operationally relevant and demand-oriented security terminology derived from the probable operational tasks, as well as imparting
intercultural competence are our focus.

6. Institute Imperative
Unique characteristic: language training relevant to armed forces
Ambition: language training relevant to security affairs
Guideline: imparting intercultural competence

7. (Romance & other languages) (Testing, QM, Controlling)
Department I
(Central services)
3 Sections
Department II
(Germanic languages)
4 Sections
Department III
(Romance & other languages)
Department IV
(Slavonic languages)
Head
Section 3
(Testing, QM, Controlling)
4 Persons
Co-ordination
Monitoring
Testing/Rating
Administration
Test production
Evaluation
Germanic
Languages
Slavonic & Balkan
Romance & other
Teaching/Testing
Teaching/Testing
Teaching/Testing

8. AAF Language Institute central decentralized
Language training
central decentralized
Teaching staff Language Inst / NDA: 30 (50)
Teaching staff / external: 220

9. Military-related language training
Language proficiency
levels and training
Semi-
nars
etc.
Military-related language training 3B 3A 2B
Language Courses 2A 1B 1A

10. L I N G U A Novelties and Innovation
Increased focus on “networked learners” through innovative technology-aided language training
Basis: Structural Adaptation AAF 2018, Planning Guideline
Language training must focus even more on the individual learner by using modern training technologies, also taking into consideration economic aspects (return on investment).
Focus on “Blended Learning”.

13. Paperless classroom (centralized/mobile)
Connected via WIFI
Direct connected

15. Distance learning/distance teaching
virtual classroom
teachers
participants

16. Testing computer-assisted testing work in progress 200 persons tested
distance testing
first 450 tested
Testing Assessment
necessary

17. Digital Language Service
Digital Language Management
Digital Language Training
Digital Translation
Digital Language Testing
Digital Quality Assurance

18. by Assessment Sheets – online only (future) by Self Assessment Sheets
360 Degree-Evaluation of Language Trainings
Participants
by Assessment Sheets – online only (future)
Superiors
by Interview
Organisation
by Checkliste
Trainers
by Self Assessment Sheets
(online only – future)
Analysis and Interpretation by the QM

19. networkbased learning user plattform: SITOS six

22. by Assessment Sheets – online only (future) by Self Assessment Sheets
Results influence
course design
360 degree evaluation
360 Degree-Evaluation
Participants
by Assessment Sheets – online only (future)
Superiors
by Interview
Organisation
by Checkliste
Course
amendments
Trainers
by Self Assessment Sheets
(online only – future)

23. Thank you!