Using Student Data as a Basis for Feedback to Teachers Ronnie Detrich Wing Institute Cal-ABA, 2011.

Slides:



Advertisements
Similar presentations
Progress Monitoring: Data to Instructional Decision-Making Frank Worrell Marley Watkins Tracey Hall Ministry of Education Trinidad and Tobago January,
Advertisements

Responsiveness to Instruction North Carolina Problem Solving Model Problem Solving Model Session 1/4.
RESPONSE TO INTERVENTION Policy & Practice Institute June 25, 2008 Mike Stetter and Lori Duerr Delaware Department of Education.
RESPONSE TO INTERVENTION
Response to Intervention (RtI) in Primary Grades
Overview of Progress Monitoring Training Session Part of a training series developed to accompany the AIMSweb Improvement System. Purpose is to provide.
Teacher In-Service August, Abraham Lincoln.
Read the Quote Below: Why?
M & E for K to 12 BEP in Schools
Response to Intervention Presented by: Agnes B. Domingo EDSP 6345, HBU, Spring 2014.
RTI Implementer Webinar Series: Establishing a Screening Process
Academy 2: Using Data to Assess Student Progress and Inform Educational Decisions in Culturally Responsive RTI Models Academy 2: Culturally Responsive.
 Is extremely important  Need to use specific methods to identify and define target behavior  Also need to identify relevant factors that may inform.
Using the PBIS Tiered Fidelity Inventory (TFI) E-12
A Problem-Solving Approach to Student Success.  Review of RTI  Definitions  The Problem-Solving Approach  Role of the Three Tiered Intervention System.
Targeted & Individual Systems of Support Lori Newcomer, Ph.D. Tim Lewis, Ph.D. University of Missouri – Columbia OSEP Center for Positive Behavior Interventions.
Evidence, Ethics, and the Law Ronnie Detrich Wing Institute.
Progress Monitoring project DATA Assessment Module.
Treatment Integrity and Program Fidelity: Necessary but Not Sufficient to Sustain Programs Ronnie Detrich Randy Keyworth Jack States Wing Institute.
Plan Evaluation/Progress Monitoring Problem Identification What is the problem? Problem Analysis Why is it happening? Progress Monitoring Did it work?
Response to Intervention
General Universal Level Targeted Level Intensive Level Bonus
July 2007 IDEA Partnership 1 RTI Process What is it?
Treatment Integrity: A Fundamental Component of PBS Ronnie Detrich Wing Institute.
Using Technical Assistance Teams for Tertiary PBS Carol Davis, Ed. D., Ilene S. Schwartz, Ph. D. University of Washington
Curriculum Based Evaluations Informed Decision Making Leads to Greater Student Achievement Margy Bailey 2006.
A Decision Matrix for Designing Staff Training Ronnie Detrich Wing Institute.
2008 Student Progress Monitoring & Data-Based Instruction in Special Education Data-Based Instruction.
Response to Intervention (RTI) Presented by Ashley Adamo and Brian Mitchell January 6, 2012.
RTI Implementer Webinar Series: What is RTI?
RESPONSE TO INTERVENTION Georgia’s Pyramid. Pyramid Vocabulary  Formative Assessment  Universal Screening  Intervention  Progress Monitoring.
How to Use Data to Improve Student Learning Training Conducted at Campus-Based SLO Summit Spring 2014 How to Use Data to Improve Student Learning.
RELIABILITY AND VALIDITY OF DATA COLLECTION. RELIABILITY OF MEASUREMENT Measurement is reliable when it yields the same values across repeated measures.
Ten years of Evaluability at the IDB Yuri Soares, Alejandro Pardo, Veronica Gonzalez and Sixto Aquino Paris, 16 November, 2010.
Specific Learning Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
The Wisconsin RtI Center (CFDA #84.027) acknowledges the support of the Wisconsin Department of Public Instruction in the development of this presentation.
University of Rhode Island EDC 452. A process of:  Providing high-quality instruction and intervention matched to student needs and  Using learning.
Association for Behavior Analysis International 36 th Annual Convention Teacher Induction: Where the Rubber Meets the Road Randy Keyworth.
Response to Intervention (RTI) at Mary Lin Elementary Principal’s Coffee August 30, 2013.
Collaboration for Effective Educator Development, Accountability, and Reform Supplemental Behavioral Interventions H325A
Toward a Technology of Treatment Integrity Ronnie Detrich Wing Institute APBS, Denver, Colorado 2011.
Laying the Foundation for Scaling Up During Development.
Educable Mental Retardation as a Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
RTI Response To Intervention. What is RTI ? Response to intervention is a multi – tier approach to the early identification and support of students with.
PLCS & THE CONNECTION TO RESPONSE TO INTERVENTION Essentials for Administrators Sept. 27, 2012.
Treatment Integrity: Necessary but Not Sufficient for Improving Outcomes Ronnie Detrich Wing Institute.
An Expanded Model of Evidence-based Practice in Special Education Randy Keyworth Jack States Ronnie Detrich Wing Institute.
 Three Criteria: Inadequate classroom achievement (after intervention) Insufficient progress Consideration of exclusionary factors  Sources of Data.
RTI 101 Jon Potter Dean Richards Oregon RTI Project.
Chapter 6: High-Leverage Practice 1: Formative Evaluation.
Types of Assessment: Curriculum Based Measurement Characteristics : Simple Accurate Efficient Generalizable Reliable and valid Predictive Sensitive Flexible.
Part 2: Assisting Students Struggling with Reading: Multi-Tier System of Supports H325A
Using Student Data as a Basis for Feedback to Teachers Ronnie Detrich Wing Institute ABAI, 2011.
Response to Intervention SPED 461. Basic Principles of RTI Response to intervention integrates assessment and intervention within a multi-level prevention.
Care Enough to Count: Measuring Teacher Performance Ronnie Detrich Wing Institute.
Consultation with Teachers: VPF on Acknowledgement within PBIS Robin Frei, M.S.E. Faculty Mentor: Mary Beth Tusing, Ph.D. University of Wisconsin- Eau.
+ Response to Intervention Ann Morrison Ph.D.. + Two Parts of Response to Intervention To ensure that all students will meet state and district standards.
Response to Intervention (RtI) Aldine ISD District Staff Development August 18, 2009.
Specific Learning Disability: Accurate, Defensible, & Compliant Identification Mississippi Department of Education.
Progress Monitoring IEPs: Combining Well-Written Goals, Curriculum-Based Measurement and Technology Tools for Success Facilitated by Jennifer Gondek Instructional.
Response to Intervention for PST Dr. Kenneth P. Oliver Macon County Schools’ Fall Leadership Retreat November 15, 2013.
Data-based Decision Making: More than the Data Ronnie Detrich Randy Keyworth Jack States Wing Institute Cal-ABA, March 2009.
Assessments for Monitoring and Improving the Quality of Education
The Continuum of Interventions in a 3 Tier Model
RTI & SRBI What Are They and How Can We Use Them?
Overview: Understanding and Building a Schoolwide Assessment Plan
RESPONSE TO INTERVENTION
Intensive Intervention – Tier 3
Social Validity and Treatment Integrity
Presentation transcript:

Using Student Data as a Basis for Feedback to Teachers Ronnie Detrich Wing Institute Cal-ABA, 2011

Everybodys Talking Teacher accountability often offered as solution for education troubles. Numerous proposals to pay and evaluate teachers based on student performance. o Proposals usually linked to performance on high stakes tests. Very weak means of influencing teacher behavior.

Difficulties with High Stakes Tests as Basis for Feedback Low frequency o Once per year. Long delay between behavior and feedback. o Test in spring, feedback following fall. No direct link between teacher behavior and feedback. o Feedback is about student performance. o Does not specify what teachers do to influence student scores.

Alternatives to High Stakes Tests Formative assessment o Curriculum-based measurement o Direct measures of behavior. Characteristics o Frequent measurement o Easy and brief o Reliable and valid.

Why Feedback to Teachers is Important Hattie (2009)

Function of Feedback Systems Assure that all students are benefitting from educational services. Student performance primary source of feedback to educators. o There are constraints.

What Should be Targets for Feedback Logistically difficult to provide feedback on all aspects of teacher behavior. Student performance influenced by variables not under teacher control: o Curriculum-usually selected at another level. If curriculum is ineffective then inappropriate to hold teacher accountable. Effectiveness of curriculum can be measured by student performance but only implemented with integrity. How well educators implement an intervention is primary target for feedback.

Mortenson & Witt, 1998

Importance of Treatment of Integrity Students cannot benefit from interventions they do not experience. Unless educator knows what they are supposed to be doing they cannot do more of it.

Dimensions of Treatment Integrity (Dane & Schneider, 1998) Exposure (Dosage): the extent to which participants are exposed to the intervention as prescribed. o Curricula usually prescribe frequency and duration of exposure that is necessary for benefit. Ex: 3/week for 30 minutes/session. o Failing to satisfy either can impact student benefit. Ex: 1/week for 30 minutes.

Dimensions of Treatment Integrity (Dane & Schneider, 1998) Adherence: the extent to which the components of an intervention are delivered as prescribed. o Most common measured dimension. o It is necessary but not sufficient to produce benefits. Adherence with low dosage not likely to produce positive outcomes.

Dimensions of Treatment Integrity (Dane & Schneider, 1998) Quality of delivery: qualitative measure of how well the intervention is implemented. o Applied behavior analysts acknowledge importance. Have not developed good measures. o Possible measures through social validity methods: Enthusiasm Sincerity Variations in inflection and content of speech.

The Role of Student Data? Student data provides feedback about progress. If we know about adequacy of treatment integrity then can make decisions: o Adequacy of intervention o Adequacy of implementation If implementation is inadequate then focus should be on improving educator behavior. If implementation is adequate then focus should be on changing intervention so student can succeed. Decisions can be made about increasing or decreasing intensity of intervention.

Grade Level Standard Aim Line Trend Line Visual Aids Can Enhance Data Interpretation

Taking Treatment Integrity Measurement to Scale Insufficient resources to frequently observe all educators working with students to determine adequacy of implementation. One solution: Measure student behavior and analyze at different units of analysis: o School o Classroom o Individual student Any level there is gap between obtained and expected performance assess levels of treatment integrity.

Taking Treatment Integrity Measurement to Scale Requires that data are routinely collected across all levels. o RtI: CBM on all students 3/year. o PBS Continuous measurement of Office Discipline Referrals School-wide Evaluation Tool (SET) measures treatment integrity at the school level. Schools with scores higher than 80% greater impact on social behavior than schools that do not exceed 80%.

Implications of Providing Feedback to Educators Moves sole responsibility for student outcomes from teacher to broader system. If teachers are to effectively implement: o System selects effective interventions for teachers to implement. o Assure that implementers are actually trained. o System must monitor teachers implementation of intervention. o Assure that resources are to present to implement effectively.

Thank you Copies of all presentations may be downloaded at winginsitute.org