Consequential validity of formative assessment

Slides:



Advertisements
Similar presentations
Analyzing Student Work
Advertisements

Assessment Adapted from text Effective Teaching Methods Research-Based Practices by Gary D. Borich and How to Differentiate Instruction in Mixed Ability.
Understanding Motivation What is Motivation?. Student Motivation in the College Classroom What factors influence it? Sociocultural Context Classroom.
Learning Outcomes, Authentic Assessments and Rubrics Erin Hagar
Marshal Hurst LDC/MDC Coordinator Professional Development (501)
Briefing: NYU Education Policy Breakfast on Teacher Quality November 4, 2011 Dennis M. Walcott Chancellor NYC Department of Education.
FACULTY DEVELOPMENT AND PERFORMANCE REVIEWS CHM Chair Collaboration Meeting January 7, 2004 Presented by: Terry Curry, Professor and Director.
C R E S S T / U C L A Improving the Validity of Measures by Focusing on Learning Eva L. Baker CRESST National Conference: Research Goes to School Los Angeles,
Grade 12 Subject Specific Ministry Training Sessions
Principles of Language Assessment Ratnawati Graduate Program University State of Semarang.
Develop your Leadership skills
ASSESSMENT IN EDUCATION ASSESSMENT IN EDUCATION. Copyright Keith Morrison, 2004 PERFORMANCE ASSESSMENT... Concerns direct reality rather than disconnected.
Four Basic Principles to Follow: Test what was taught. Test what was taught. Test in a way that reflects way in which it was taught. Test in a way that.
Let’s Talk Assessment Rhonda Haus University of Regina 2013.
Lecture 7. The Questions: What is the role of alternative assessment in language learning? What are the Reasons.
David Steer Department of Geosciences The University of Akron Learning objectives and assessments May 2013.
USEFULNESS IN ASSESSMENT Prepared by Vera Novikova and Tatyana Shkuratova.
EDU 385 CLASSROOM ASSESSMENT Week 1 Introduction and Syllabus.
Performance-Based Assessment HPHE 3150 Dr. Ayers.
Department of Secondary Education Program Assessment Report What We Assessed: Student Learning Outcomes (SLOs) and CA State Teaching Performance.
What is grading? What is its purpose? What does it represent? How should it be done?
Introducción al Diseño Curricular de Inglés para 6to año de la Secundaria PORTFOLIO Bárbara Olavarría.
Teaching and Learning Cycle and Differentiated Instruction A Perfect Fit Rigor Relevance Quality Learning Environment Differentiation.
EXPERIENCE OF AL-FARABI KAZAKH NATIONAL UNIVERSITY IN THE IMPLEMENTATION OF THE EUROPEAN CREDIT TRANSFER SYSTEM: WORKLOAD OF STUDENT AND TEACHER IN THE.
Class Observer & Feedback Training Cass Breen & Marco Macchitella.
Candidate Support Guidelines and Planning. Five Core Propositions Proposition 1: Teachers are Committed to Students and Learning Proposition 1: Teachers.
EVALUATING EPP-CREATED ASSESSMENTS
Developing Rubrics to Measure Learning at MICA
Classroom Assessments Checklists, Rating Scales, and Rubrics
Getting Prepared for the Webinar
This project has been funded with support the European Commission
Evaluation Of and For Learning
OTLA Report Writing Training
Installation Art: Packaging Tape Sculptures
SECTION 3 Grading Criteria
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Program Review For School Counseling Programs
Performance Management -Uttam Acharya
Department of Political Science & Sociology North South University
Formative and Summative Assessment
Introduction to Program Learning Assessment
Adaptive Leadership in Changing Curricular Times
ASSESSMENT OF STUDENT LEARNING
Assertive Family Engagement
Developmentally appropriate practices and specialized instruction are fundamentally dependent upon each other in early childhood special education. Record.
Purposeful Literacy Leadership for Administrators: Start a Movement
Fostering a Community of Learners and Leaders
Diagnostic Essay Feedback Analysis
Human Resources Management: Module 2
Evaluating the Quality of Student Achievement Objectives
Advanced Program Learning Assessment
Target Setting for Student Progress
February 24, 2009 Joint Session of Congress
Understanding by Design
VISIBLE LEARNING John Hattie.
Student learning at Geelong High School
TESTS AND EXAMS TCOP 2014 FACULTY OF ECONOMICS & FINANCE
Assessments TAP 1- Strand 5.
14 The Role of Assessment. 14 The Role of Assessment.
Assignment Design Workshop
OTLA Report Writing Training
McNeese State University
February 21-22, 2018.
Learning Intentions and Success Criteria
IDEA Student Ratings of Instruction
Developing Instructional rubrics
Skills for Learning, Life and Work
Why do we assess?.
Mastery Based Learning and Grading 101
OTLA Report Writing Training
Presentation transcript:

Consequential validity of formative assessment

Formative assessment = improved student learning? We don’t know what we are doing, we haven’t had it modeled, we are often siloed, we have a tradition of high-stakes finals, stressed students, tests can be triggers for maladaptive responses, high reading workload tradition BUT we have adult learners.

what it is intended to accomplish. An assessment is VALID when it accomplishes what it is intended to accomplish. CONSEQUENTIAL VALIDITY is the measure of an assessment’s broader impact on student learning. Difficult to measure—often just asserted on the basis of the logic and purpose behind the assessment. BUT An assessment has HIGH CONSEQUENTIAL VALIDITY when it broadly improves student learning.

Lund University Faculty of Engineering 2008 Study of Assessment System Highly competitive and demanding program Coordinated system of assessments intended to help students pass by spreading their study efforts evenly throughout semester and across classes Study found that assessment system had become separated from student learning: Struggling students focused on assessment task just ahead, and strategically avoided some Faculty believed poor scores evidence that school needed to tighten admission standards. Some evidence that what we thought is helping may not always help.

Best Practices for Designing Formative Assessments with High Consequential Validity Essentially—how to we align our assessments with learning goals and clearly communicate with students? That means explaining and listening to them and the data—what does it mean?

1. Make an assessment’s alignment with course’s learning objectives transparent to students. Make the assessment system’s alignment with learning goals transparent—so students understand how this furthers their learning but avoid “teaching to the test”—keep learning goals foundational enough to allow for creativity, flexibility, the unexpected good. (Property example of misunderstanding—MC questions). Scaffolding rather than limiting or making mechanistic learning.

2. Use rubrics to create a shared language of instruction. Explain what rubrics are--A rubric may weaken an assessment’s consequential validity when it has imprecise criteria or descriptions not adapted to the intended audience because when students do not understand the how they will be evaluated, they are less likely to use the assessment to improve on learning goals. Example?

3. Ensure the assessment system encourages students’ autonomy. This goes to the level of control we exercise over student behaviors. Larry Krieger and Kennon Sheldon study of autonomy support—led to higher GPA (so better learning across the curriculum), higher bar passage numbers, and students with a higher self-determination in career planning. Also higher subjective well being. Autonomy support=students belief they are autonomous, or acting out of their own interests and values; and competent, or working on something they are good at or can become good at; and working relatedly, or connected meaningfully to others in a supportive process. three defining features: 1) assignments provide students with as much choice within the constraints of the assignment as possible; 2) they provide students with a meaningful rational of why the choice may be limited and the tasks that are required; and 3) they communicate to students that the students’ perspectives and concerns are important and considered in the decisionmaking.

4. Set high expectations and display confidence students can meet those expectations. Rick Byrd—men’s basketball coach at Belmont, built highly successful program. For 17 consecutive years, the Bruins have compiled a team G.P.A. of 3.0 or higher with a perfect graduation rate. Early feedback can be a trigger for maladaptive responses, like fixed mindset and stereotype threat. More assessment does not help these students. The assessment has low CV because it decreases a student’s ability to learn and progress. In addition to all of above, need to explain this danger to students and set high expectations for student achievement, provide robust feedback, and communicate confidence that students can meet those expectations

5. Regularly revisit assessment system and pay particular attention to students’ ownership of their own learning. Also, Create logical consequences for choices students make about learning. If students are expected to be prepared for class to maximize learning, create an assessment to ensure they suffer a consequence if they are not. Be consistent and clear and fair. Students should be encouraged to provide the same level of personal investment and introspection into the learning that we do