Teacher Quality/Effectiveness: Defining, Developing, and Assessing Policies and Practices Part III: Setting Policies around Teacher Quality/Effectiveness.

Slides:



Advertisements
Similar presentations
RESEARCH CLINIC SESSION 1 Committed Officials Pursuing Excellence in Research 27 June 2013.
Advertisements

Teacher Training, Teacher Quality and Student Achievement Douglas Harris Tim R. Sass Dept. of Educational Dept. of Economics Policy Studies Florida State.
Cory Koedel, Eric Parsons, Michael Podgursky and Mark Ehlert
Trends in Teacher Evaluation Systems in Public Education CEC’S POSITION ON SPECIAL EDUCATION TEACHER EVALUATION.
1 Oregon Reading First: Three-Year Report Preliminary Impact Evidence Oregon Reading First Center LLSSC Meeting, November 29, 2006.
David Fairris Tarek Azzam
Teacher Evaluation Model
October 15, 2009 Solving the Dropout Crisis in California Russell W. Rumberger California Dropout Research Project UC Santa Barbara California Symposium.
March 12, 2010 Building District Capacity to Address the Dropout Crisis Russell W. Rumberger California Dropout Research Project UC Santa Barbara CALSA.
VALUE – ADDED 101 Ken Bernacki and Denise Brewster.
Are Teacher-Level Value- Added Estimates Biased? An Experimental Validation of Non-Experimental Estimates Thomas J. KaneDouglas O. Staiger HGSEDartmouth.
Douglas N. Harris University of Wisconsin at Madison Evaluating and Improving Value-Added Modeling.
American Lessons on Designing Reliable Impact Evaluations, from Studies of WIA and Its Predecessor Programs Larry L. Orr, Independent Consultant Stephen.
Pennsylvania Value-Added Assessment System Overview: PVAAS
Transforming the cost-effectiveness threshold into a ‘value threshold’ Initial findings from a simulation model Mike Paulden and Christopher McCabe.
MEASURING TEACHING PRACTICE Tony Milanowski & Allan Odden SMHC District Reform Network March 2009.
Chapter 5: Personnel Decisions
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC)
Districts and States Working with VARC Minneapolis Milwaukee Racine Chicago Madison Tulsa Atlanta New York City Los Angeles Hillsborough County NORTH DAKOTA.
Critiquing Research Articles For important and highly relevant articles: 1. Introduce the study, say how it exemplifies the point you are discussing 2.
CRESST Conference--September 16, Student Mobility and the Assessment of Students and Schools Russell W. Rumberger University of California, Santa.
1 National Reading First Impact Study: Critique in the Context of Oregon Reading First Oregon Reading First Center May 13, 2008 Scott K. Baker, Ph.D. Hank.
Evaluating Professional Development Debbie Junk, Coordinator for Mathematics Initiatives Mathematics Project Directors’ Meeting Tuesday, October 9th Austin,
MINNEAPOLIS PUBLIC SCHOOLS. Instructional Core Adapted from Harvard University PELP Framework.
Research Using State Longitudinal Data Systems: Accomplishments and Challenges – The Case of Florida Tim R. Sass.
Understanding How Cuomo’s Proposal Impacts Your Children An Overview.
-- Preliminary, Do Not Quote Without Permission -- VALUE-ADDED MODELS AND THE MEASUREMENT OF TEACHER QUALITY Douglas HarrisTim R. Sass Dept. of Ed. LeadershipDept.
School Readiness Initiatives: Assessing Their Yield Craig T. Ramey, Ph.D. & Sharon L. Ramey, Ph.D. Georgetown University Center on Health and Education.
Writing Assignments On the small sheet of paper write down the most fun or funniest summer memory. On the lined sheet of paper write your name and date.
John Cronin, Ph.D. Director The Kingsbury NWEA Measuring and Modeling Growth in a High Stakes Environment.
Educator Evaluations: Growth Models Presentation to Sand Creek Schools June 13, 2011.
Recognizing Effective Teaching Thomas J. Kane Professor of Education and Economics Harvard Graduate School of Education.
1 Studying Teacher Professional Development: Challenges and Possible Solutions Nicole Kersting Research Scientist LessonLab Research Institute, Santa Monica,
Evaluating Outcomes Across the Partnerships Tom Loveless Director, Brown Center on Education Policy The Brookings Institution Saturday,
Examining Value-Added Models to Measure Teacher Effectiveness Laura Goe, Ph.D. Research Scientist, ETS, and Principal Investigator for the National Comprehensive.
Special Education Teacher Quality and Student Achievement Li Feng Tim R. Sass Dept. of Finance & Econ.Dept. of Economics Texas State UniversityFlorida.
NHSA Update NHSA September 2006 Leadership Institute Arlington, Virginia Research And Assessment Update 2007 Ben Allen, Ph.D. NHSA Leadership Institute.
RESEARCH ON MEASURING TEACHING EFFECTIVENESS Roxanne Stansbury EDU 250.
Scientific Method for a controlled experiment. Observation Previous data Previous results Previous conclusions.
Clemson University School of Ed Faculty Meeting Cindy Van Buren, Ph.D. Division of School Effectiveness August 29, 2014.
Final Reports from the Measures of Effective Teaching Project Tom Kane Harvard University Steve Cantrell, Bill & Melinda Gates Foundation.
PROGRESS & & ACHIEVEMENT Pennsylvania Value-Added Assessment System (PVAAS) The Power of Derry Township School District School Board Presentation Sept.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
1 STAT 500 – Statistics for Managers STAT 500 Statistics for Managers.
Mathematics and Science Partnerships: Summary of the FY2006 Annual Reports U.S. Department of Education.
Teachers for a New Era: Evidence Study at California State University, Northridge Beverly Cabello Evidence Co-Leader, Teachers for a New Era James David.
Impediments to the estimation of teacher value added Steven Rivkin Jun Ishii April 2008.
Social Problems: A Down-to-Earth Guide, 11e James M. Henslin Chapter 1 How Sociologists View Social Problems: The Abortion Dilemma.
Myths and Realities about Technology in K-12 Education.
Using School Choice Lotteries to Test Measures of School Effectiveness David Deming Harvard University and NBER.
Teacher effectiveness. Kane, Rockoff and Staiger (2007)
Weighting components of teacher evaluation models Laura Goe, Ph.D. Research Scientist, ETS Principal Investigator for Research and Dissemination, The National.
Speed Dating Civil War Style. Speed Dating- Civil War Style Standard: IB HOA Topic 8- The US Civil War: Union vs. Confederate: strengths and weaknesses;
VAM Training. Florida’s value-added model developed by Florida educators  The Department convened a committee of stakeholders (Student Growth Implementation.
Using Prior Scores to Evaluate Bias in Value-Added Models Raj Chetty, Stanford University and NBER John N. Friedman, Brown University and NBER Jonah Rockoff,
Project VIABLE - Direct Behavior Rating: Evaluating Behaviors with Positive and Negative Definitions Rose Jaffery 1, Albee T. Ongusco 3, Amy M. Briesch.
BY MADELINE GELMETTI INCLUDING STUDENTS WITH DISABILITIES AND ENGLISH LEARNERS IN MEASURES OF EDUCATOR EFFECTIVENESS.
Gathering Feedback for Teaching Combining High-Quality Observations with Student Surveys and Achievement Gains.
Florida Algebra I EOC Value-Added Model June 2013.
 Mark D. Reckase.  Student achievement is a result of the interaction of the student and the educational environment including each teacher.  Teachers.
Research and Evaluation
Growing Leader Practice: Observing Data Discussions
Assessment to Support Competency-Based Pathways
What is Value Added?.
Regression in Practice: Observational studies with controls for pretests work better than you think Shadish, W. R., Clark, M. H., & Steiner, P. M. (2008).
Stephen W. Raudenbush University of Chicago December 11, 2006
Dr. Robert H. Meyer Research Professor and Director
Teacher Effectiveness and Their Carbon TIME Practices and Knowledge
Non-Experimental designs: Correlational & Quasi-experimental designs
Managerial Decision Making and Evaluating Research
Presentation transcript:

Teacher Quality/Effectiveness: Defining, Developing, and Assessing Policies and Practices Part III: Setting Policies around Teacher Quality/Effectiveness – and the Consequences Friday, April 27, 2012 Kimmel Center for University Life Education Policy Breakfast Series

Evaluating Teachers: The Important Role of Value-Added Brown Center on Education Policy at Brookings, November 2010 Susanna Loeb, Stanford; Dan Goldhaber, University of Washington; et al. EXECUTIVE SUMMARY The evaluation of teachers based on the contribution they make to the learning of their students, value-added, is an increasingly popular but controversial education reform policy. We highlight and try to clarify four areas of confusion about value-added. The first is between value-added information and the uses to which it can be put. One can, for example, be in favor of an evaluation system that includes value-added information without endorsing the release to the public of value-added data on individual teachers. The second is between the consequences for teachers vs. those for students of classifying and misclassifying teachers as effective or ineffective — the interests of students are not always perfectly congruent with those of teachers. The third is between the reliability of value-added measures of teacher performance and the standards for evaluations in other fields — value-added scores for individual teachers turn out to be about as reliable as performance assessments used elsewhere for high stakes decisions. The fourth is between the reliability of teacher evaluation systems that include value-added vs. those that do not — ignoring value-added typically lowers the reliability of personnel decisions about teachers. Recommended Readings from David Steiner

Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique National Bureau of Economic Research, April 2009 Cory Koedel, University of Missouri; and Julian R. Betts, University of California, San Diego ABSTRACT Value-added modeling continues to gain traction as a tool for measuring teacher performance. However, recent research (Rothstein, 2009) questions the validity of the value-added approach by showing that it does not mitigate student-teacher sorting bias (its presumed primary benefit). Our study explores this critique in more detail. Although we find that estimated teacher effects from some value-added models are severely biased, we also show that a sufficiently complex value-added model that evaluates teachers over multiple years reduces the sorting-bias problem to statistical insignificance. Recommended Readings from David Steiner

Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation NBER Working Paper Series, December 2008 Thomas J. Kane, Harvard; and Douglas O. Staiger, Dartmouth ABSTRACT We used a random-assignment experiment in Los Angeles Unified School District to evaluate various non- experimental methods for estimating teacher effects on student test scores. Having estimated teacher effects during a pre-experimental period, we used these estimates to predict student achievement following random assignment of teachers to classrooms. While all of the teacher effect estimates we considered were significant predictors of student achievement under random assignment, those that controlled for prior student test scores yielded unbiased predictions and those that further controlled for mean classroom characteristics yielded the best prediction accuracy. In both the experimental and non-experimental data, we found that teacher effects faded out by roughly 50 percent per year in the two years following teacher assignment. Recommended Readings from David Steiner

Please visit where copies of these articles will be posted soon. You may also watch videos and review presentations from previous breakfasts in this year’s series. Education Policy Breakfast Series