Teacher Accountability as Formative Assessment: Findings from the National Center on Scaling Up Effective Schools J. Edward Guthrie (Vanderbilt), Christopher.

Slides:



Advertisements
Similar presentations
Performance Assessment
Advertisements

Professional Learning Communities Connecting the Initiatives
Through Instructional Rounds
Why has data become so important in education? n Accountability requires school districts to measure effectiveness. n Standards that identify what all.
Co-Teaching as Best Practice in Student Teaching Conclusion 1.
Gathering Evidence Educator Evaluation. Intended Outcomes At the end of this session, participants will be able to: Explain the three types of evidence.
PEER REVIEW OF TEACHING WORKSHOP SUSAN S. WILLIAMS VICE DEAN ALAN KALISH DIRECTOR, UNIVERSITY CENTER FOR ADVANCEMENT OF TEACHING ASC CHAIRS — JAN. 30,
Alternative Assesment There is no single definition of ‘alternative assessment’ in the relevant literature. For some educators, alternative assessment.
Why this Research? 1.High School graduates are facing increased need for high degree of literacy, including the capacity to comprehend texts, but comprehension.
Implementing the CCSS Through Coaching Atomic Conference December 2, 2014.
MEASURING TEACHING PRACTICE Tony Milanowski & Allan Odden SMHC District Reform Network March 2009.
RtI Day 2 EXCEED Trainer of Trainers SDUSD October 2011 Linda Trousdale Michelle Crisci Several slides were adapted from: Washoe County School District,
Consistency of Assessment
PRIDE Professional Rubrics Investing & Developing Educator Excellence
Professional Development and Appraisal System
Formative and Summative Evaluations
Evaluating and Revising the Physical Education Instructional Program.
Developing and Supporting Highly Effective Teachers in Every Classroom Leaders of Learning Implementation Norman Public Schools Date.
Minnesota Manual of Accommodations for Students with Disabilities Training Guide
How do we document evidence of student growth in Healthful Living?
MPR Associates 1 Albert Einstein said… “Not everything that counts can be counted and not everything that can be counted counts.” Using data well depends.
1 SESSION 1 using The New Performance Standards and New VDOE Requirements
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 5 Informal Assessments.
Ensuring Quality and Effective Staff Professional Development to Increase Learning for ALL Students.
Milwaukee Math Partnership Year 1 External Evaluation Lizanne DeStefano, Director Dean Grosshandler, Project Coordinator University of Illinois at Urbana-Champaign.
Professional Growth= Teacher Growth
6. Penilaian Kurikulum The Meaning of Evaluation 1.Evaluation is a process or group of processes by which evaluators gather data in order to make decisions.
POSTER TEMPLATE BY: Increasing the Accountability of Teachers to Reach all Students and their Needs Raymon J. Smith References.
© 2013 ESD 112. All rights reserved. Putting Evidence Into Context, Trainer.
Business and Management Research
Welcome What’s a pilot?. What’s the purpose of the pilot? Support teachers and administrators with the new evaluation system as we learn together about.
5 Criteria of Performance Measures
Bank of Performance Assessment Tasks in English
Portfolios: A Useful Resource For All Cynthia Cuellar Astrid Fossum Beth Schefelker The Milwaukee Mathematics Partnership (MMP), an initiative of the Milwaukee.
Martha Thurlow and Laurene Christensen National Center on Educational Outcomes CEC Preconvention Workshop #4 April 21, 2010.
Leadership: Connecting Vision With Action Presented by: Jan Stanley Spring 2010 Title I Directors’ Meeting.
Alabama Professional Education Personnel Evaluation Program Field Test of Library/Media Specialist Evaluation System July 2000.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
2 The combination of three concepts constitutes the foundation for results: 1) meaningful teamwork; 2) clear, measurable goals; and 3) regular collection.
Planning and Integrating Curriculum: Unit 4, Key Topic 1http://facultyinitiative.wested.org/1.
Teacher and Principal Evaluation A new frontier….
{ Principal Leadership Evaluation. The VAL-ED Vision… The construction of valid, reliable, unbiased, accurate, and useful reporting of results Summative.
Christina M. Cloidt, NBCT Special Education School Improvement Specialist (SESIS) Special Education Technical Assistance Support Center (SETASC) Coordinator.
Teresa K. Todd EDAD 684 School Finance/Ethics March 23, 2011.
Using Teacher Evaluation as a Tool for Professional Growth and School Improvement Redmond School District
CERI/OECD “Improving Learning through Formative Assessment” 3 February, 2005.
Using qualitative data Look for patterns Example 1. How do new teachers feel about their preparation for entering the classroom? I felt prepared as far.
Strategy for Human Resource Management Lecture 16 HRM 765.
NC FALCON Training in the use and design of Formative Assessment.
Julie Maxwell-Jolly UC Davis Center for Applied Policy in Education (CAP-Ed)
Agenda Introductions Objectives and Agenda Review Research Review Taking Stock Collect evidence Principal Practices & the Rubric End-of-the-Year Looking.
Using Classroom Data to Drive Classroom Instruction Peggy Dersch and Jana Reiter Assessment FOR Learning.
Primary Purposes of the Evaluation System
Guidelines for Uniform Performance Standards and Evaluation Criteria for Teachers Virginia Department of Education Approved April 2011.
ESEA, TAP, and Charter handouts-- 3 per page with notes and cover of one page.
Copyright © 2014 by Educational Testing Service. All rights reserved. Influencing Education: Implementing Online Reporting Systems to Support Assessment.
Minnesota Manual of Accommodations for Students with Disabilities Training January 2010.
Project Evaluation for MSP Targeted Partnerships Eric R. Banilower Horizon Research, Inc.
Chapter 6 Assessing Science Learning Updated Spring 2012 – D. Fulton.
Implementing the Professional Growth Process Session 3 Observing Teaching and Professional Conversations American International School-Riyadh Saturday,
Superintendents’ Network Welcome! Apprentice Facilitators And Coaches.
Michele Winship, Ph.D.  Compliance with HB 153/SB 316 requirements?  Seek out and get rid of “bad” teachers? OR  Improve teaching.
Approaches to Measuring Teaching Practice: Review of Seven Systems Tony Milanowski University of Wisconsin-Madison (With Contributions from Herb Heneman.
Mason County Schools Policy 5310 August 11, 2016.
GOAL To offer evidence of the importance of developmentally appropriate prevention programming, propose basic competencies for prevention programming,
Teacher Teams: Powerful Engines of Change
Business and Management Research
Mason County Schools Policy 5310 August 11, 2016.
Meet the Teacher September 2016
Presentation transcript:

Teacher Accountability as Formative Assessment: Findings from the National Center on Scaling Up Effective Schools J. Edward Guthrie (Vanderbilt), Christopher Harrison (UNC-Chapel Hill), Marisa Cannata (Vanderbilt) Summary Based on teacher interviews, high value-added (HVA) high schools exhibit dialogic relationships between teachers and administrators. By contrast, teachers in low value-added (LVA) schools feel the weight of outcome-based performance accountability without support or feedback from administrators. This pattern is explored in terms of how accountability practices described as present in the HVA schools and absent in the LVA schools fit a profile of formative assessment. Background The hallmark of “new accountability” is a focus on student learning outcomes, yet evidence suggests that teachers—much like their students—improve in response to feedback and incentives based on assessment of processes and practices (formative), but not to incentives based on assessments of end results (summative). In light of this, we might expect to find that schools that are more effective in increasing student achievement exercise internal accountability practices patterned after a model of formative assessment. We focus in this study on school-level accountability practices and on assessment conceptualized as the full suite of administrator-teacher performance interactions (of which evaluation would comprise a subset). The effectiveness of building-based accountability structures and practices is the most relevant discussion for school personnel who cannot control district- or state-level policy and for whom staff development is a more politically and economically viable option than staff reconstitution. Research Question How do policies and practices related to teacher performance accountability differ between high and low value-added high schools? Method & Sample Data sample consists of semi-structured interviews with administrators, teachers, and staff at a total of eight high schools (two districts, each with two HVA and two LVA schools selected). Schools were chosen for a combination of contrast in value-added performance and similarity in student demographic composition. Data were collected during multiple week-long visits to each school during the and school years. These data were analyzed through an iterative coding process incorporating directed and summative content analysis. Low Value-AddedHigh Value-Added District A Formative observations and feedback are infrequent, leading teachers to either question or dismiss later summative assessments as irrelevant or invalid. Two-way communication between administrators and teachers creates an environment of trust in which teachers are willing to accept performance feedback as well as consequences for poor performance. District B Teachers do not receive regular feedback, even when observations were frequent, leading to frustration and anxiety. Teachers report receiving feedback when observations occur, though these are less frequent than in LVA schools. Examples: “I have no idea what (classroom observers) thought, whatsoever. Zero. Nothing. I am not expecting to get anything, because I was told there will be nothing in writing. They will have a general debriefing, in general, about the school, and I will somehow get that information passed down to me …But, how I am doing, in their eyes? I have no idea.” “He’s given good feedback but then he gives me one question, like maybe you should do this better or how come you did this instead of this, and so I get positive feedback, and then I get a little bit of negative feedback. The negative feedback is very useful.” Discussion Accountability for teacher performance in high value-added schools shows characteristics of formative assessment. In the schools with the highest value-added and strongest culture of performance accountability, there exist relationships of trust and support fostered by dialogic communication between administrators and teachers. In the low value-added schools, accountability regimes have the characteristics of summative assessment, with all emphasis placed on once- a-year performance reviews. Observation and feedback is less consistent and teachers consider it irrelevant or invalid. Questions over the significance and validity of assessments was most common at schools that relied on formal PDAs to offer feedback to teachers. Teachers describe accountability practices in their schools