Introducing Assessment Tools

What is an assessment tool? The instrument/s and procedures used to gather and interpret evidence of competence: –Instrument – the specific questions or activity used to assess competence by the assessment method selected. An assessment instrument may be supported by a profile of acceptable performance and the decision making rules or guidelines to be used by assessors. –Procedures – the information or instructions given to the candidate and the assessor about how the assessment is to be conducted and recorded. (AQTF)

What principles/rules apply to assessment tools? Assessment processes Assessment methods and tools Assessment evidence Assessment judgements. PRINCIPLES OF ASSESSMENT RULES OF EVIDENCE

Principles of Assessment VALIDITY RELIABILITY FLEXIBILITY FAIRNESS Unit of Competency Industry Standards AQF Level Dimensions of Competency LLN Instructions (Learner & Assessor) Sample answers/responses Advice to assist judgement of competence Trials of tools during development Review of tools after use Negotiate with learner / workplace Consider Reasonable Adjustment (to the structure of the assessment not the outcome) Maintain integrity of unit and industry standards (Validity/ Reliability) Ensuring the tool reflects all the requirements of competency Ensuring the tool achieves consistent results Ensuring the tool does not disadvantage learners and allows the best opportunity to provide evidence of competency

Assessment Tools Well designed Assessment Tools will help to ensure that the evidence collected meets the requirements of the Rules of Evidence SUFFICIENT??? VALID? CURRENT? AUTHENTIC?

Designing assessment tools PLAN –Clarify evidence requirements - Unpack the Unit of Competency to identify the evidence requirements –Select the most appropriate assessment methods –Identify the assessment tools that align with each of the assessment methods DEVELOP –Develop the tools identified –Check instructions and formatting –Review / trial

Good assessment instructions Written in plain English using standard industry terminology Clearly understood by learners and assessors (what, where, who, when, how) Written at the correct AQF level FAIRNESS FLEXIBILIT Y RELIABILITY VALIDITY

Verbs and AQF levels Certificate I Certificate II Certificate III Tell List Find Use Explain Discuss Describe Analyse Investigate Design Certificate IV Justify Recommend Evaluate

Reviewing and Trialing Tools Part of the tool development process –Confirms validity and reliability –Provides advice on fairness and flexibility –Encourages involvement of stakeholders –Provides evidence for continuous improvement Tracked through version control to ensure all assessors use the most current tool