E VALUATION T OOLS AS I MPLEMENTATION D RIVERS Two Implementation Rubrics from the California SPDG 1.

Slides:



Advertisements
Similar presentations
SAS and RTII ED 517 Spring Edward G. Rendell, Governor Dr. Gerald L. Zahorchak, Secretary of Education Standards Aligned System Integration Trainer.
Advertisements

The Content Side of the ACPS Professional Learning Plan (PLP)
RtI Response to Intervention
RESPONSE TO INTERVENTION Policy & Practice Institute June 25, 2008 Mike Stetter and Lori Duerr Delaware Department of Education.
Instructional Decision Making
When Students Can’t Read…
Response to Instruction and Intervention Process Presentation.
PAYS FOR: Literacy Coach, Power Hour Aides, LTM's, Literacy Trainings, Kindergarten Teacher Training, Materials.
Comprehensive Literacy Program Louisiana Department of Education
CEP’s State and National Schools of Character Summary of 2011 Program Changes.
Building & Using an Effective Leadership Team Kathi Cooper Aida Molina Bette Harrison Sandy Lam.
Office of Accountability, Assessment and Intervention 1 Getting Ready for SIP: Developing the Action Sequences FALL 2006.
E VALUATION T OOLS A S I MPLEMENTATION D RIVERS An Example from the California SPDG’s ERIA: Effective Reading Interventions Academy 1.
Assessment: Purpose, Process, and Use HMR Kindergarten.
CHANGING ROLES OF THE DIAGNOSTICIAN Consultants to being part of an Early Intervention Team.
RtI Assessment CED 613. Universal Screening What is it and what does it Evaluate? What is the fundamental question it is asking? What is the ultimate.
1 Reading First Internal Evaluation Leadership Tuesday 2/3/03 Scott K. Baker Barbara Gunn Pacific Institutes for Research University of Oregon Portland,
The general structure of the facilitation notes will be:
Co-Teaching Solutions Systems
1 Supporting Striving Readers & Writers: A Systemic Approach United States Department of Education Public Input Meeting - November 19, 2010 Dorothy S.
Power Pack Click to begin. Click to advance Congratulations! The RtI process has just become much easier. This team member notebook contains all the information.
Case management – building student achievement and teacher capacity Robert Dunn November 1, 2012.
TIMELESS LEARNING POLICY & PRACTICE. JD HOYE President National Academy Foundation.
Southern Regional Education Board HSTW An Integrated and Embedded Approach to Professional Development and School Improvement Using the Six-Step Process.
Lewiston Porter PEC Standards- Based Report Card Grades K-3 Report Card Committee Members: Heidi Kazulak, Suzanne Hedemann, Lisa Winslow, Kelly Millville,
Welcome to Directors’ Program Measure Webinar - Presenter: Jennifer Coffey, Ph.D., OSEP Project Officer, SPDG Program Lead.
Iowa’s Teacher Quality Program. Intent of the General Assembly To create a student achievement and teacher quality program that acknowledges that outstanding.
5-Step Process Clarification The 5-Step Process is for a unit, topic, or “chunk” of information. One form should be used for the unit, topic, etc. The.
Assessment: Purpose, Process, and Use HMR Grade 1.
Read On, Indiana! Anna Shults, Reading Specialist John Wolf, Reading Specialist Indiana Reading Initiatives.
PCG Education Helping Florida Schools and Districts Successfully Transition to the Florida Standards Palm Beach Charter School Administrators.
PANAMA-BUENA VISTA UNION SCHOOL DISTRICT
Elementary & Middle School 2014 ELA MCAS Evaluation & Strategy.
Monica Ballay Data Triangulation: Measuring Implementation of SPDG Focus Areas.
The contents of this presentation were developed under a grant from the US Department of Education, #H323A However, these contents do not necessarily.
Response to Intervention: Improving Achievement for ALL Students Understanding the Response to Intervention Process: A Parent’s Guide Presented by: Dori.
Measuring Implementation: School-Wide Instructional Staff Perspective Amy Gaumer Erickson, Ph.D. University of Kansas Evaluator: Kansas & Missouri SPDGs.
English Language Arts Single Plan for Student Achievement.
Adolescent Literacy – Professional Development
1 SINA Implementation Action Plan Professional Development Assessment Evaluation Questions Requires ongoing Specifies Monitors Student Success Teacher.
FEBRUARY KNOWLEDGE BUILDING  Time for Learning – design schedules and practices that ensure engagement in meaningful learning  Focused Instruction.
Effective Behavioral & Instructional Support Systems Overview and Guiding Principles Adapted from, Carol Sadler, Ph.D. – EBISS Coordinator Extraordinaire.
Teresa K. Todd EDAD 684 School Finance/Ethics March 23, 2011.
After lunch - Mix it up! Arrange your tables so that everyone else seated at your table represents another district. 1.
EDU 385 CLASSROOM ASSESSMENT Week 1 Introduction and Syllabus.
Winston/Salem Forsyth County Schools RESPONSIVENESS TO INSTRUCTION (RTI)
Evaluating Professional Development At the School Site Level Cheryl “Li” Walter, Ph.D. CA SIG Evaluator.
Leadership In Support of English Learners Merle Price January 18, 2005.
Office of Child Development & Early Learning Project MAX: Maximizing Access and Learning Project MAX Maximizing Access and Learning Managing and Sustaining.
Lori Wolfe October 9, Definition of RTI according to NCRTI ( National Center on Response to Intervention) Response to intervention integrates assessment.
Nancy Steele Kelly Vanderbosch The Power of Teams in RtI as a Multi-Tiered System of Support.
Suggested Components of a Schoolwide Reading Plan Part 1: Introduction Provides an overview of key components of reading plan. Part 2: Component details.
Reading First Overview of 2004 Site Visits Jane Granger, M.S.
Readiness for AdvancED District Accreditation Tuscaloosa County School System.
Data Report July Collect and analyze RtI data Determine effectiveness of RtI in South Dakota in Guide.
Assessment: Purpose, Process, and Use OCR Grade 6.
Interventions Identifying and Implementing. What is the purpose of providing interventions? To verify that the students difficulties are not due to a.
Office of Service Quality
Goal Attainment Scales as a way to Measure Progress Amy Gaumer Erickson & Monica Ballay December 3, 2012.
“ Let us not be content to wait and see what will happen, but give us the determination to make the right things happen”- Horace Mann 2014 MCAS Overview.
© 2013, KDE and KASA. All rights reserved. FOUNDATIONS OF STUDENT GROWTH GOAL SETTING: DETERMINING STUDENT NEEDS SETTING A BASELINE What do my students.
East Longmeadow Public Schools SMART Goals Presented by ELPS Leadership Team.
Tier 1 Instructional Delivery and Treatment Fidelity Networking Meeting February, 2013 Facilitated/Presented by: The Illinois RtI Network is a State Personnel.
Interboro School District Keystones to Opportunity Grant Four Year Overview School Years.
Improving Literacy and Numeracy Outcomes Geoff N Masters.
Outcomes By the end of our sessions, participants will have…  an understanding of how VAL-ED is used as a data point in developing professional development.
Wisconsin Personnel Development System Grant Click on the speaker to listen to each slide. You may wish to follow along in your WPDM Guide.
SAM (Self-Assessment of MTSS Implementation) ADMINISTRATION TRAINING
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Model Demonstration Projects
Presentation transcript:

E VALUATION T OOLS AS I MPLEMENTATION D RIVERS Two Implementation Rubrics from the California SPDG 1

E ARLY ERIA: E FFECTIVE R EADING I NTERVENTIONS A CADEMY ERIA established in before the Era of RTI upper-elementary and middle schools focus a diversity of approaches at sites in regional cohorts recently dev ERIA 2.0 middle and high school focus Frequently Asked Questions “What is ERIA?” “How does this relate to RtI 2 ?” “What is ‘intervention’ and where do we get it?” How do we Evaluate this? 2

T WO I NTEGRATIVE E VALUATION T OOLS S ERVE AS I MPLEMENTATION D RIVERS Program Guide articulates PD model a 16-page booklet, explicitly addresses both implementation and intervention practices to guide the design of a site-based program. Implementation Rubric operationalizes PD model a 10-item instrument which provides a framework for trainers, coaches, site team members, and teachers to evaluate and discuss implementation, fidelity, and next steps Everyone is on the same page Sustainability (beyond funding, staff turnover) Scale-up (recruit new sites/districts, beyond SPDG) Diversity of approaches enabled 3

SPDG Evaluators Li Walter and Alan Wood synthesized content expert input and worked to make it readily accessible to a variety of stakeholders. “5 Steps” Step 1: Identify Step 2: Assess Step 3: Deliver Step 4: Monitor Step 5: Improve E VALUATION T OOL : T HE P ROGRAM G UIDE 4

5 Stakeholders from every level were included to provide input both on implementation and intervention practices. A variety of existing documents and other resources were also synthesized into the Program Guide.

6 There is a Table of Contents for ease of use.

7 Implementation practices are outlined over a three-year schedule.

8 Implementation practices are described in detail.

9 The Site Team is key to implementing ERIA. It and its supporting structures are detailed.

An expansive list of key roles are described in detail. 10

While the first half of the Program Guide focuses on implementation practices, the second half focuses on intervention practices and the 5 Steps: Step 1: Identify Step 2: Assess Step 3: Deliver Step 4: Monitor Step 5: Improve 11

Step 1: Identify “Identify struggling readers through universal literacy screening early in the school year using statewide English- language Arts test scores.” 12

Step 2: Assess (1 of 2) “Assess the decoding, reading fluency, and comprehension skills of struggling readers to guide intervention placement and instruction.” 13

Step 2: Assess (2 of 2) Presents a variety of assessment tools and strategies, both for basic and advanced implementation. 14

Step 3: Deliver (1 of 2) “Deliver interventions to assess specific skill needs for success in the core curriculum using evidence-based programs and practices with fidelity.” 15

Step 3: Deliver (2 of 2) Presents a variety of Intervention topics, programs, and models and how they may be appropriate for implementation, both in basic and advanced implementation. 16

Step 4: Monitor “Monitor the progress of struggling students to ensure that interventions are helping students improve and to adjust intervention placements accordingly.” 17

Step 5: Improve “Improve content literacy instructional practices to actively and effectively engage all students in the core curriculum.” 18

Student Outcomes Past successes, increasing English- Language Arts proficiency inclusive of Students with Disabilities, is detailed. 19

E VALUATION T OOL : I MPLEMENTATION R UBRIC The 10 items are intervention practices-focused mostly, with site team and fidelity items The overall tool and process of how the rubric is used drives the implementation practices Self-evaluate and reflect on learning and implementation. Shared with coaches and trainers to guide activities Evaluates the fidelity of implementation of both the PD model and the interventions Former 26-item, 3-point checklist lacked the specificity to be meaningful and useful. 20

I MPLEMENTATION R UBRIC, A DAPTED FROM “G OAL A TTAINMENT S CALES ” Amy Gaumer Erickson and Monica Ballay presented “goal attainment scales” on a June 17 SIG Network webinar: Rubric explicitly describes 5 implementation levels for each of 10 items: Levels 1, 2, and 3 reflect the “Not started,” “In progress,” and “Achieved” implementation levels of former checklist. Levels 4 and 5 detail concrete steps towards optimal implementation, beyond the basics. Each implementation level for each item is explicitly described, building more meaning into the tool than our previous checklist format allowed. 21

22

23

24

25

26

27

Automatically generated report summarizes three years of implementation in a two-page format. 28 The most-recent response to each item is summarized below the trend chart, including text which describes what each implementation level means in explicit terms.

29 The most-recent response to each item’s “Summary” is gathered in a one-page format.

30 The most-recent response to each item’s “Next Steps” is also gathered in a one-page format.

31 All data from all three years of collection is gathered in a single row on the “Hidden Formulas” tab for easy aggregation. All of this other blank space stores the hidden formulas that make the Excel file work. Because this file doesn’t rely on Visual Basic or Macros, we have avoided security and software compatibility issues.

T HE G UIDE AND R UBRICS : W ELL -R ECEIVED Sites love it. Returning sites love the specificity and usefulness. New sites feel like they know what they are getting into. Trainers and coaches can see how sites are progressing and where the needs are. Evaluation Taskforce was encouraged by the possibility of greater ability to learn about the effectiveness of the professional development models. 32

BEST I MPLEMENTATION R UBRIC Building Effective Schools Together 33

34

35

36

37

38

ERIA on the Web: BEST / PBS on the Web: Li Walter: Alan Wood: (707)