ESC Region XI Texas Effectiveness Study PROGRAM UPDATE 2005 Deborah Norris, Project Coordinator Education Service Center Region XI Fort Worth, Texas

ESC Region XI Purpose Provide an overview of the Texas Effectiveness Study and its orientation to the TCIP. Provide a summary of “The New System” for collecting post-school outcome data at the state level. Present and overview of opportunities for local districts to participate in post-school outcome data collection and utilization of data for program improvement through TES mini-grants.

ESC Region XI Texas Effectiveness Study Overview

ESC Region XI Decentralized Project due to the decentralization of specific technical assistance functions and projects of TEA in accordance with Rider 44 of Article III of the General Appropriations Act of 1995, the Education Service Center Region XI was identified to continue work on the project. project coordinated by TEA

ESC Region XI Primary Purpose of the Texas Effectiveness Study is to provide a clear measure of post-school results of youth with disabilities as they transition from high school to adult life

ESC Region XI Data Use information collected through the study is intended to assist with decisions made at the state and local level necessary to improve policy and practices leading to successful post-school outcomes for students served under IDEA “improved results for students”

ESC Region XI Texas Continuous Improvement Process The Texas Continuous Improvement Process (TCIP) is a permanent, annual process that the State uses to continuously identify areas for improvement and implement strategies to improve the provision of special education in Texas.

ESC Region XI General Supervision Secondary Transition FAPE / LRE Parent Involvement Early Childhood Transition CSPD Leadership Council State Supervision Parent Training Early Childhood Transition Post-School Results Access to General Curriculum Juvenile/Adult Services Behavior and Discipline Management Child-Centered Framework CSPD Leadership Council Parent Coordination Texas Effectiveness Study Transition High School/Transition Access to General Curriculum Evaluation Assistive Technology Technical Assistance and Training—VI Behavior/Discipline Management Three Low Incidence Disabilities Texas Autism Conference Multicultural and Diverse Learners Alignment of TCIP Improvement Groups and ESC Decentralized Functions & Projects with cluster areas of the Annual Performance Report Improved Results for Students CSPD Leadership Council

ESC Region XI 2004 Annual Performance Report Secondary Transition | State Goals  Students with disabilities are participating in post-school activities comparably to their nondisabled peers.  Secondary students receiving special education services will successfully transition from high school to post-school activities.

ESC Region XI OSEP Monitoring Report (March 2003) Secondary Transition | Areas of Noncompliance  Identification of other steps to obtain outside agency participation, other agency’s responsibilities or any needed linkages in the IEP  IEPs/Individual Transition Plans (ITPs) do not represent a coordinated set of activities within an outcome-oriented process

ESC Region XI Texas Annual Performance Report to OSEP 2004 APR ( ) Cluster Area 1: General Supervision Cluster Area 2: Early Childhood Transition Cluster Area 3: Parent Involvement Cluster Area 4: Free Appropriate Public Education in the Least Restrictive Environment Cluster Area 5: Secondary Transition

ESC Region XI 2004 Annual Performance Report Secondary Transition | State Data Cluster Area V: Secondary Transition Is the percentage of youth with disabilities participating in post-school activities (e.g., employment, education, etc.) comparable to that of nondisabled youth? Data Source: Texas Effectiveness Study

ESC Region XI 20-region Network Each lead ESC is responsible for establishing and coordinating a 20- region network for their decentralized function. The purpose of the 20- region network is to ensure ongoing communication between ESCs about state-level needs assessment processes, planning, and implementing and evaluating statewide activities.

ESC Region XI High School/Transition Network a representative from each Education Service Center currently serving on the secondary Transition Network also serves as a liaison to the Texas Effectiveness Study information, study activities, and project findings are presented to the Secondary Transition Network for review and comment. recommendations are incorporated into published reports.

ESC Region XI Texas Effectiveness Study The New System

ESC Region XI New Directions for a proposal to expand the TES was approved and implemented October 2004 creates a “system” for collecting post-school outcome data qualitative case studies local collection and utilization of post-school outcome data (mini-grants) Special Education Supplemental Report (SESR) joint website

ESC Region XI TES Toolbox (statewide plan) PurposeForm/FormatWhenWhoIncentive Program QualityStatewide Transition Network - IEP folder review Annually: 9 th, 10 th, 11 th, and 12 th grades Contract Agent review of student records Pay per record Student seed records, future expectations, indication of readiness (self-determination) Exit SurveyBefore graduation or leaving (12 th grade only) Student with teacher monitoring Web-based Paper/pencil Year One Follow-Up Outcomes (four indicators); and satisfaction Post-School Survey 1 year after graduation or leaving HS Direct mail; Phone call follow-up with contracted agent if not contacted by mail Pay contracted agent; incentive drawing for students Year Two Follow-Up Outcomes (four indicators); and satisfaction Post-School Survey2 years after graduation or leaving HS Direct mail; Phone call follow-up with contracted agent if not contacted by mail Pay contracted agent; incentive drawing for students Conduct qualitative case studies - General and Special education former students Qualitative Case Study Interviews AnnuallyContracted agentPay contracted agent to conduct case study interviews

ESC Region XI IEP Folder Review Measure of program quality Conducted annually Sampling Plan: modified cluster sample based on the twenty regions; stratified random sample based on the following student demographics Grades 9-12 Primary disability Gender Ethnicity IEP Folder Review conducted by contracted agent Data collector training via TETN (Texas Education Telecommunications Network) Aggregate report to TEA

ESC Region XI Schematic for Gathering Data (statewide plan) st cohort12 th Exit F1F2 2 nd cohort12 th Exit F1F2 3 rd cohort12 th Exit F1F2 4 th cohort12 th Exit F1F2 5 th cohort12 th Exit F1F2

ESC Region XI Sample Size and Selection (statewide plan) Sample size Special education (10%) General education (1%) Stratified random sample Primary disability Region/community type Gender Ethnicity

ESC Region XI Qualitative Case Studies (statewide plan) Each year a sample of former students from both the general and special education sample will be selected for qualitative case study interviews. A contracted agent of the project will conduct the case study interviews, summarize main points, and present a report to the ESC Region XI for review prior to publishing.

ESC Region XI Opportunities for Local Involvement in Data Collection Activities To encourage district level interest in self-assessment and improvement of transition activities, the Texas Effectiveness Study project will make available the measurement instruments (program quality, exit, and follow-up surveys) and technical assistance necessary for local improvement efforts.

ESC Region XI The Local System A local system parallel to the state level post-school data collection system will be used by LEAs to collect and examine their own post-school outcome data. LEAs will receive technical assistance and training necessary, through the TES decentralized project, to collect and use local data to effectively plan for improved results for students. –TES Action Committee, 12/2004

ESC Region XI TES Mini-Grants Application process Voluntary Seed money will be awarded to approximately 5% of districts annually; statewide Funded for two (2) consecutive years

ESC Region XI TES Mini-Grant Training and Technical Assistance Training modules will be developed on the following topics and delivered via distance learning quantitative and qualitative data collection data analysis and reporting interpreting and using results for planning and program improvements program sustainability

ESC Region XI TES Mini-Grant Technical Assistance Implementation support Survey tools Assistance with data analysis/reporting Data storage and retrieval on secure server

ESC Region XI TES Mini-Grant Timeline February 2005 TETN presentation to ESC Special Education Directors Letters mailed to District Superintendents announcing mini-grants Application deadline established

ESC Region XI Temporary Web Address uct/txeffstudy/default.htm Deborah Norris, TES Project Coordinator