Care Enough to Count: Measuring Teacher Performance Ronnie Detrich Wing Institute.

Slides:



Advertisements
Similar presentations
So I wrote a behavior plan… Now What????. Data Driven Collect baseline data Use data to drive decision Limit what you are collecting data on Keep it simple.
Advertisements

Instructional Decision Making
Response to Intervention (RtI) in Primary Grades
Using Student Data as a Basis for Feedback to Teachers Ronnie Detrich Wing Institute Cal-ABA, 2011.
Supporting Students with Challenging Behavior in the Classroom
1 Organizational, Time Management, and Planning Treatment for Children with ADHD (OTMP Study) NIMH-funded R01 New York University – Howard Abikoff, PI.
Targeted & Individual Systems of Support Lori Newcomer, Ph.D. Tim Lewis, Ph.D. University of Missouri – Columbia OSEP Center for Positive Behavior Interventions.
Treatment Integrity and Program Fidelity: Necessary but Not Sufficient to Sustain Programs Ronnie Detrich Randy Keyworth Jack States Wing Institute.
Embedding Interventions and Monitoring Progress Kristie Pretti-Frontczak Kent State University September 2007.
Modeling “The Cause”: Assessing Implementation Fidelity and Achieved Relative Strength in RCTs David S. Cordray Vanderbilt University IES/NCER Summer Research.
Response to Intervention
Multi-Tier System of Support (MTSS) Objective: By the end of this session, I will demonstrate my understanding of the MTSS system by describing.
C4K – Building an efficient and effective delivery system to impact critical outcomes for kids Our initial focus as we build this system is early literacy.
Information on BEP-RTI By: Ms. Amy Evans. Behavior Educational Program-Response to Intervention (BEP-RTI) Agreeing on and establishing school rules Teach.
CA Multi-Tiered System of Supports
Understanding Response to Intervention (RtI) : What it Is & How it Works in Midway ISD.
Treatment Integrity: A Fundamental Component of PBS Ronnie Detrich Wing Institute.
A Decision Matrix for Designing Staff Training Ronnie Detrich Wing Institute.
RESPONSE TO INTERVENTION Malissa Patrick and Kim Thorndycraft February 25, 2010.
Moving from Compliance to Quality Control Focus on nuances of teacher delivery and student response during instruction Integration of important and effective.
Using Targeted Interventions to Support School Improvement Presenter: Kathleen Smith Director Office of School Improvement.
Wednesday, 9:15-10:30, Salon C. Group-Based Interventions for Tier 2 An Overview of Research Supported Practices Barbara Mitchell, Ph.D. MO SWPBS Tier.
Assessing the Curriculum Gary L. Cates, Ph.D., N.C.S.P.
RELIABILITY AND VALIDITY OF DATA COLLECTION. RELIABILITY OF MEASUREMENT Measurement is reliable when it yields the same values across repeated measures.
Evaluation of a Laptop Program Deborah L. Lowther Steven M. Ross Gary R. Morrison.
Striving for Quality Using continuous improvement strategies to increase program quality, implementation fidelity and durability Steve Goodman Director.
Effective Teachers of literacy use:
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Growing the Green: Focusing on Universal Interventions Joan Ledvina Parr PBIS Team Leaders and Coaches Meeting November 13, 2008.
Specific Learning Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
Association for Behavior Analysis International 36 th Annual Convention Teacher Induction: Where the Rubber Meets the Road Randy Keyworth.
Training and Supporting Teachers to Implement Effective Classroom Management Practices Teri Lewis-Palmer Emma Martin University of Oregon.
Toward a Technology of Treatment Integrity Ronnie Detrich Wing Institute APBS, Denver, Colorado 2011.
A K-12 WORKSHOP INTRODUCING INFORMAL ASSESSMENTS TO TEACHERS AND ADMINISTRATORS KAREN AUTON, SHAR BECK, AND TYLER WEST Extreme Makeover: Assessment Edition.
Progress Monitoring for students in Strategic or Intensive intervention levels Based on the work of Roland Good and Ruth Kaminski.
D62 Response to Intervention
A Descriptive Approach to Measuring a School Culture Ronnie Detrich Wing Institute ABAI Seattle, Washington 2012.
Progress Monitoring for All Student Adapted from the Kentucky Systems of Interventions Guidance Document.
Response to Intervention (RtI) Brief Overview of the PA Model* ALL RtI provides ALL students with: Standards-aligned concepts and competencies Data-driven.
Educable Mental Retardation as a Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
Introduction The authors of this research would like to thank the University of Wisconsin-Eau Claire’s Office of Research and Sponsored Programs for financial.
Response to Intervention Activity: Selecting the ‘Best of the Best’ Tier I Intervention Ideas.
RTI & THE CONNECTION TO PLC’S Essentials for Administrators Sept. 27, 2012.
Treatment Integrity: Necessary but Not Sufficient for Improving Outcomes Ronnie Detrich Wing Institute.
Treatment Integrity Degree to which something is implemented as designed, intended, planned: –Delivery of instruction/intervention –Formative evaluation.
Interventions Identifying and Implementing. What is the purpose of providing interventions? To verify that the students difficulties are not due to a.
Professional Development
A Descriptive Approach to Measuring a School Culture Ronnie Detrich Wing Institute Cal-ABA, 2012.
Using Student Data as a Basis for Feedback to Teachers Ronnie Detrich Wing Institute ABAI, 2011.
Advantage of Teaching Students Self-Management
Training Modules  Participants will understand… Progress Monitoring Graphing Data Data-Based Decisions Linking Cases to PS/RtI.
Response to Intervention Presented by Valerie Mendez-Farinas.
Monitoring and Assessment Presented by: Wedad Al –Blwi Supervised by: Prof. Antar Abdellah.
National Center on Response to Intervention RTI Essential Component: Schoolwide, Multi-Level Prevention System Katie Klingler Tackett National Center on.
Implementation and Sustainability in the US National EBP Project Gary R. Bond Dartmouth Psychiatric Research Center Lebanon, NH, USA May 27, 2014 CORE.
Specific Learning Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
The IEP: Progress Monitoring Process. Session Agenda Definition Rationale Prerequisites The Steps of Progress Monitoring 1.Data Collection –Unpack Existing.
Response to Intervention – A Good IDEIA Assessment Driving Instruction David Lillenstein, Ed.D., NCSP Director of Psychological Services (717)
The Continuum of Interventions in a 3 Tier Model Oakland Schools 3 Tier Literacy Leadership Team Training November
Data-based Decision Making: More than the Data Ronnie Detrich Randy Keyworth Jack States Wing Institute Cal-ABA, March 2009.
The Continuum of Interventions in a 3 Tier Model
What to Do When Check-in, Check-out Doesn’t Work: Next Steps
RESEARCH IMPLEMENTATION PRACTICE
Extending RTI to School-wide Behavior Support
RESPONSE TO INTERVENTION
Identifying and Implementing
Writing Instructional Objectives
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
Presentation transcript:

Care Enough to Count: Measuring Teacher Performance Ronnie Detrich Wing Institute

“What Gets Measured Gets Done” Training is not sufficient  Most training focuses on knowing about.  Knowing what to do is not sufficient.  Performance drifts soon after training ends. Measurement is necessary to determine if important things are done. For measures to be meaningful must have performance standards. Example: Praise  Rate criterion: 2 per minute  Ratio of specific to general praise: 2:1  Ratio of praise to corrective feedback: 4:1

Functions of Counting Identifies the prevalence of behavior.  Describes the percent of population meeting standard.  Determines if and at what scale intervention is required. Sets occasion for feedback/reinforcement.  Positive or Corrective feedback.  Positive or Negative reinforcement. Distinguishes between Can’t Do and Won’t Do Problems.  Can’t do-does not have skills to perform.  Won’t do-usually problem of motivation.

Prevalence Measure Measure of prevalence define scale of problem. Assess before intervening.  Are there barriers to performance?  Do teachers know the performance standard?  Do teachers have the skill? Allows decisions about allocation of resources.  Answers drive solutions.  Solutions determine resource allocation.

Performance Feedback Measurement determines if performance standard is met.  Basis for feedback Feedback does not teach how to perform only that criteria met or not. Features of effective feedback  More frequent the feedback better effects (Jones, Wickstrom, & Friman, 1997; Mortensen & Witt, 1998).  Daily better than weekly.  Immediate better than delayed.  Immediate more preferred than delayed.

Can’t Do or Won’t Do Failing to meet performance standard is neither diagnostic or prescriptive-only descriptive.  Won’t do=has the skill but does not do enough to meet standard.  Can’t do=does not have the skill. Responsiveness to feedback is diagnostic.  If responsive=won’t do problem-no other intervention required.  Not responsive may be can’t do-more intensive intervention required.

Mortenson & Witt, 1998

Data-based Decision Making and Resource Allocation Not all teachers require the same level of support.  Some respond well to training.  Others require degrees of increasingly intensive intervention.  Data determines which teachers require more or less intervention and support.

Performance Measurement as Treatment Integrity To measure performance requires a protocol of what is to be done. Measurement reflects compliance with protocol- treatment integrity.

Dimensions of Treatment Integrity Exposure (Dosage): the extent to which participants are exposed to the intervention as prescribed.  Curricula usually prescribe frequency and duration of exposure that is necessary for benefit. Ex: 3/week for 30 minutes/session.  Failing to satisfy either can impact student benefit. Ex: 1/week for 30 minutes.

Dimensions of Treatment Integrity Adherence: the extent to which the components of an intervention are delivered as prescribed.  Most commonly measured dimension.  It is necessary but not sufficient to produce benefits. Adherence with low dosage not likely to produce positive outcomes.

Dimensions of Treatment Integrity Student responsiveness: degree to which student participates to program.  Engagement in instructional activities.  Accuracy of responding.

Practical Approach to Measurement at Scale Measure those practices likely to have the greatest impact.  Progress monitoring. Measure dimensions of treatment integrity.  Hierarchy of measures. Measure practices that cut across domains first.  Praise/corrective feedback necessary for both academic and social domains. Data determine frequency of measurement. Data basis for feedback to teachers and determine next steps.

Take Home What teachers do is important. If it is important measure it. We can’t know if important things are happening unless we count. Measuring performance is expensive.  Failing to measure performance is even more expensive. Measuring performance allows intervention only when necessary and at proper level of intensity.

Thank you for your attention Copies available at winginstitute.org