1 Assessment Professional Learning Module 5: Making Consistent Judgements.

Slides:



Advertisements
Similar presentations
School Based Assessment and Reporting Unit Curriculum Directorate
Advertisements

K-6 Science and Technology Consistent teaching – Assessing K-6 Science and Technology © 2006 Curriculum K-12 Directorate, NSW Department of Education and.
[Insert faculty Banner] Consistency of Assessment
Big Ideas, Learning Goals & Success Criteria
Victorian Curriculum and Assessment Authority
You can use this presentation to: Gain an overall understanding of the purpose of the revised tool Learn about the changes that have been made Find advice.
Assessment Assessment should be an integral part of a unit of work and should support student learning. Assessment is the process of identifying, gathering.
PDHPE K-6 Using the syllabus for consistency of moderation © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
1 © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training English K-6 Syllabus Using the syllabus for consistency of assessment.
[Insert faculty Banner] Consistency of Assessment
Assessment Professional Learning Module 4: Assessment AS Learning.
Developing consistency of teacher judgment Module 2.
[Insert faculty Banner] Consistency of Teacher Judgement
Consistency of Teacher Judgement Human Society and Its Environment 7-10 © 2007 Curriculum K-12 Directorate, NSW Department of Education and Training.
BACKWARD MAPPING: Beginning with the end in mind
Consistency of Assessment
NCATE Institutional Orientation Session on PROGRAM REVIEW Moving Away from Input- based Programs Toward Performance-based Programs Emerson J. Elliott,
Practical approaches to module learning outcomes at postgraduate level March 5 th 2009 CAPSL and the Bologna Desk.
Consistent Teacher judgement
Grade 12 Subject Specific Ministry Training Sessions
Consistency of assessment Technology subjects (7-12)
Technology subjects (7-12) Consistency of moderation.
Principles of Assessment
Diploma in Teaching in the Lifelong Learning Sector
Overall Teacher Judgements
PDHPE K-6 Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
Enabling learning and assessment Unit 3 – Week 1.
PLAN AND ORGANISE ASSESSMENT. By the end of this session, you will have an understanding of what is assessment, competency based assessment, assessment.
© New Zealand Ministry of Education copying restricted to use by New Zealand education sector. Page 1 Consider the Evidence Evidence-driven.
Verification: Quality Assurance in Assessment Verification is the main quality assurance process associated with assessment systems and practice - whether.
October ISIS – Cluster Moderation Assessment and moderation in CfE is a process, not an event! Aims of the morning: To further inform participants in the.
Integrating Differentiated Instruction & Understanding by Design: Connecting Content and Kids by Carol Ann Tomlinson and Jay McTighe.
Assessment Professional Learning Module 5: Making Consistent Judgements.
Week 5 Lecture 4. Lecture’s objectives  Understand the principles of language assessment.  Use language assessment principles to evaluate existing tests.
Programme Objectives Analyze the main components of a competency-based qualification system (e.g., Singapore Workforce Skills) Analyze the process and.
Workshops to support the implementation of the new languages syllabuses in Years 7-10.
PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio.
Welcome Module 25. Aim To provide the knowledge, skills and attitudes to effectively support adults through the Scout Association’s Adult Training Scheme.
Assessment Design. Four Professional Learning Modules 1.Unpacking the AC achievement standards 2.Validity and reliability of assessments 3. Confirming.
PLC Team Leader Meeting
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
Human Society and its Environment K-6 (HSIE) Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education.
Consistency of Moderation
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Development of the Egyptian Code of Practice for Student Assessment Lamis Ragab, MD, MHPE Hala Salah, MD.
Session 1 Introduction: Assessment & Evaluation Assessment & Evaluation.
Assessing Student Learning Workshop 2: Making on-balance judgements and building consistency.
Michigan Assessment Consortium Common Assessment Development Series Module 16 – Validity.
COMMON CORE CONTENT STANDARDS Module 1: Read and Know the Standard.
National PE Cycle of Analysis. Fitness Assessment + Gathering Data Why do we need to asses our fitness levels?? * Strengths + Weeknesses -> Develop Performance.
Lecturer - Dr Justin Rami Assessment & Feedback Lecturer – Dr Justin Rami.
1 Assessment Professional Learning Module 4: Assessment AS Learning.
Quality Assurance processes
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
What is moderation and why should we moderate?
CHAPTER 3: Practical Measurement Concepts
Assessment and Feedback – Module 1
Alternative Assessment (Portfolio)
CEA Case Study Marianne Farrugia.
Validity.
Consistency of Teacher Judgement
Designing Assessment Things to be considered:
Assessment of student achievement of outcomes from the 7-10 Science syllabus Use this as a screen saver.
Matthew McCullagh Linking the Principles of Assessment to the QA Criteria.
Critically Evaluating an Assessment Task
Unit 7: Instructional Communication and Technology
Assessment Methods.
Assessment The purpose of this workshop / discussion is to extend further teachers’ understanding of the Department's Assessment Advice. This workshop.
Good assessment design The overarching principles of good assessment
Presentation transcript:

1 Assessment Professional Learning Module 5: Making Consistent Judgements

Module 5 - Making Consistent Judgements 2 Assessment OF learning: occurs when teachers use evidence of student learning to make judgements on student achievement against goals and standards. Assessment FOR learning: occurs when teachers use inferences about student progress to inform their teaching. Assessment AS learning: occurs when students reflect on and monitor their progress to inform their future learning goals.

Module 5 - Making Consistent Judgements 3 The Victorian Essential Learning Standards place an imperative on us to make high quality judgements about student learning. What does that mean we should do?

Module 5 - Making Consistent Judgements 4 Quality and trustworthiness in evidence of learning requires both: valid (fair, accurate, appropriate) and consistent (reliable) assessment judgements.

Module 5 - Making Consistent Judgements 5 Valid Everyday synonyms: - truthful - appropriate - justified - convincing - accurate - legally acceptable - fair For valid assessment fairness, accuracy and appropriateness matter.

Module 5 - Making Consistent Judgements 6 Validity is a matter of fairness, appropriateness and accuracy Are the tasks constructed, presented and conducted so that all students have an equal chance of demonstrating their learning against the Standards? Do the tasks represent all the valued learning you want the students to have undertaken? Do they assess a sample of all the important concepts or all the important Standards? Are the assessment tasks probing the students thinking to the depth you want - or are they able to “get away with” a superficial understanding?

Module 5 - Making Consistent Judgements 7 Validity is a matter of fairness, appropriateness and accuracy Are the assessment tasks monitoring what you think they are (and not some intervening prerequisite skill, or conceptual understanding)? In particular, do the assessment tasks require specific knowledge or skills which some students may not have, and which have not been explicitly taught? (e.g. how to: read, draw a graph or ‘google’?)

Module 5 - Making Consistent Judgements 8 Assessment is valid if it … assesses appropriate content and Standards assesses the important Standards provides information which is useful for some valuable purpose (for/as/of) is assessed with sufficient accuracy is fair to all students.

Module 5 - Making Consistent Judgements 9 Consistency is a matter of reliability How confident can you be that judgements that you have made are not significantly affected by chance factors such as: how the student was feeling on the day? how the assessor was feeling on the day? who the assessor was? luck in being assessed on some things and not others? luck in that the mode of assessment suited the student particularly well (or didn’t)?

Module 5 - Making Consistent Judgements 10 Examples of everyday use of the term “reliability”  A set of kitchen scales is reliable if...  A clock is reliable if …  A train is reliable if …  A friend is reliable if …  A ‘full-back’ is reliable if …  An assessment task is reliable if … (what?)

Module 5 - Making Consistent Judgements 11 Definition of consistency The consistency of an assessment is the reliability with which it assesses whatever it assesses. It is the reproducibility that is the focus.

Module 5 - Making Consistent Judgements 12 The assessor matters in making consistent judgements. We are human and our judgements may be influenced by many factors besides the actual standard of work. INTER-rater reliability: if another assessor judged the work, would the student be awarded the same result? INTRA-rater reliability: if the same assessor judged the work on another day would the result be the same?

Module 5 - Making Consistent Judgements 13 Consistent assessment An assessment is consistent if the scores that students get are reliable: from one occasion to the next from one form of assessment to another from one assessor to another.

Module 5 - Making Consistent Judgements 14 The difference between consistency and validity Consistency (or reliability) is a technical question. Will work be judged in the same way every time, regardless of who assesses it, or how, or when? Validity has both a technical element (does the assessment accurately judge what it says it judges?) and a philosophical one (is the assessment appropriate and fair?). Validity is an indication of the value and correctness of what we do.

Module 5 - Making Consistent Judgements 15 Consistency, alone, is not sufficient. Assessment must also be valid (fair, appropriate and accurate).

Module 5 - Making Consistent Judgements 16 Each step in the assessment process involves: the possibility of error value-driven decisions assessment processes that may disadvantage some types of students. Use collaborative planning processes, transparency of assessment tasks, criteria, rubrics and variety to maximise valid and consistent judgements.

Module 5 - Making Consistent Judgements 17 Strategies and Protocols For valid and consistent judgements of student learning progression, we need to put in place strategies such as: common assessment tasks planned collaboratively shared design processes for assessment tasks and for rubrics comparing work with exemplars (e.g. assessment maps) cross-marking of sample assessment tasks moderation and consistency protocols.

Module 5 - Making Consistent Judgements 18 Critical stages of the Moderation Process 1.Developing a common understanding of the Standards to be assessed and the purpose of assessment 2.Drafting the assessment task requirements 3.Drafting the criteria- or marking scheme 4.Sample assessing 5.Final assessing. Activity 5-4A further defines this process.

Module 5 - Making Consistent Judgements 19 The final assessing stage of moderation may involve: assessors meeting together sharing of assessed work samples discussion of queries cross-marking each other’s work samples discussion of borderline or special circumstance cases.

Module 5 - Making Consistent Judgements 20 When deciding HOW to make more valid and consistent judgements “efficiency” issues must also be considered: time efficient(yours and your students!) learning efficient(maximises learning) teaching efficient(reduces wastage) cost efficient ??? other factors

Module 5 - Making Consistent Judgements 21 Making consistent judgements is important. But consistency is not enough - we have to make valid judgements as well. Assessment FOR learning Assessment OF learning Assessment AS Learning