1. Successful trialling: from trial and error to best practices
BILC
STANAG 6001 Testing Workshop
Kranjska Gora, 2018
Successful trialling: from trial and error to best practices

2. Roadmap to a validity argument
Test purpose:
To assess and communicate an individual’s unrehearsed, general language communication ability and proficiency level for the purpose of interoperability within NATO.

3. Trialling / piloting / pre-testing

4. Trialling from test validation point of view
The role of the language tester is to collect evidence to support test use and interpretation that a larger community – the stakeholders (students, testers, teachers and society) – accept.
(Fulcher, Davidson, 18, 2007)

5. What is evidence?
The language tester cannot point to facts and claim a test valid. There are many possible interpretations of facts. What he or she has to do is create an argument that best explains the facts available. (Fulcher, Davidson, 18, 2007)

6. How do we create a validity argument?
Which facts can trialling help collect and which arguments can trialling help build?

7. Challenges… Appropriate population Administration Test format
Statistical (quantitative) analyses
Qualitative analysis

8. If you don‘t know where you are going, any bus will do. 