Southern Regional Education Board HSTW HSTW Network Meeting November 18, 2009 Administering the 2010 HSTW Assessment for HSTW Sites

Southern Regional Education Board HSTW About the HSTW Assessment HSTW is a research-based school improvement model HSTW Assessment is used to set baselines, acknowledge progress, identify areas for improvement, and set priorities Only initiative combining student achievement data with students’ perceptions of school and classroom practices Required of HSTW sites in even-numbered years Administered to seniors to collect data on entire high school experience

Southern Regional Education Board HSTW Examples of How Schools Use the Results Lobby for state actions to support school improvement Identify a need for improvement Gain support for school improvement Engage the entire faculty in school improvement Set priorities for school improvement Improve classroom practices

Southern Regional Education Board HSTW Five Components Reading test Mathematics test Science test Student survey Course-taking patterns School and classroom experiences Teacher survey

Southern Regional Education Board HSTW Reading Test 90 minutes 80% informational texts; 20% literary non-fiction texts Includes meaning vocabulary Includes paired texts (to assess critical analysis) Does not include literary fiction or poetry

Southern Regional Education Board HSTW Mathematics Test 70 minutes Content 10% Number Properties and Operations 30% Measurement/Geometry 25% Data Analysis, Statistics and Probability 35% Algebra

Southern Regional Education Board HSTW Science Test 70 minutes Content 40% Life Sciences 40% Physical Sciences 20% Earth and Space Science

Southern Regional Education Board HSTW Student Survey Section 1 Course-taking patterns Sections 2 and 3 School and classroom experiences Based on HSTW Key Practices

Southern Regional Education Board HSTW Teacher Survey School and classroom experiences School mission High expectations and extra help Guiding and supporting students Curriculum content and engaging students in learning Transitions Leadership and professional growth

Southern Regional Education Board HSTW Results HSTW Award of Educational Achievement Student reports School report

Southern Regional Education Board HSTW HSTW Award of Educational Achievement Mailed to schools April 30, 2010 Awarded to students who: Meet all three readiness goals Complete at least two parts of the HSTW-Recommended Curriculum English/language arts, mathematics, science Complete a concentration Career/technical, mathematics/science, humanities

Southern Regional Education Board HSTW Student reports Mailed to schools April 30, 2010 Performance on reading, mathematics and science test Performance level Completion of recommended curriculum and concentration Award status

Southern Regional Education Board HSTW HSTW Assessment Report Mailed to schools June 30, 2010 Two months earlier than previous years! Executive Summary One page summary of performance and implementation Overview Slightly longer summary Full report Tables breaking out achievement by experiences Teacher survey results

Southern Regional Education Board HSTW Administration Materials Test Administration Guide Sampling Instructions Student Roster Form Course Description Guide Course Matching Chart Checklist Test Description and Sample Question Booklet Information for Sites Tasks and Timelines

Southern Regional Education Board HSTW TaskScheduleEstimated Time Identify studentsSept. – Nov hours Identify assistantsSept. – Nov hour Schedule time and placeSept. – Nov hours Notify students and teachersSept. – Nov hours Prepare student rosterOct. – Dec hour Complete course matching chartOct. – Dec days Prepare student transcriptsJan days Receive and check materialsJan. 20, hour Assign answer documents to students Jan , hours Complete section 1 of student survey for students Jan. – Feb days Administer assessment and teacher survey Jan. 29 – Feb. 19, days Return materials No later than Feb. 19, hour Sample Timeline

Southern Regional Education Board HSTW Administering the Assessment 3. Identify students Use sampling plan selected on order All seniors Random sample of 60+ seniors All CT seniors Random sample of 60+ CT seniors Include all currently enrolled students in sampling Only exclude students if IEP exempts them from state assessments Use sampling instructions provided to select sample

Southern Regional Education Board HSTW Identifying Students to Participate Only include seniors If selecting a sample, select a true random sample using the instructions provided Only exclude students if their IEP exempts them from state assessments Accommodations provided for state assessments should be provided for this assessment Contact ETS by October 30, 2009 to request large-print or CD materials Accommodations exist for English language learners

Southern Regional Education Board HSTW Administering the Assessment 4. Scheduling Identify assistants One assistant per 15 students is ideal Schedule dates, times and locations Include make-up sessions SREB recommends administering assessment over 2-3 days Schedule date, time and location for teacher survey

Southern Regional Education Board HSTW Administering the Assessment 5. Notification Notify students, parents and teachers Provide informational materials and/or schedule an informational meeting

Southern Regional Education Board HSTW Administering the Assessment 6. Prepare student roster form Include names of all participating students Will need to include each student’s Assessment ID number from the answer document he or she is assigned Keep fully completed roster on file with testing records for five years Recommend including students’ addresses to assist with Follow-Up Survey of 2010 Graduates Needed to identify students for student reports and awards if they failed to include their name on their answer document

Southern Regional Education Board HSTW Administering the Assessment 7. Course-taking preparation Work with department chairs to complete course-matching chart, using course description guide Used to link local course titles to generic SREB course titles Include all courses current seniors could have taken during high school Collect transcripts and course schedules for participating students, including spring courses

Southern Regional Education Board HSTW Administering the Assessment 8. Receive assessment materials Materials scheduled to arrive by January 20, 2010 New in 2010 – HSTW Teacher Survey materials will be included with student materials from ETS Verify contents according to instructions immediately This gives ETS time to send new materials should an error have occurred Keep secure (locked) until testing begins These are secure testing materials and all materials (used and unused) will need to be returned Keep the boxes – you will need them to return materials

Southern Regional Education Board HSTW Administering the Assessment 9. Prepare assessment materials Assign each student an answer document Record each student’s Assessment ID number from the answer document on the student roster form Complete section 1 (transcript analysis) for students Strongly recommended, but not required Reduces testing time Increases accuracy

Southern Regional Education Board HSTW Administering the Assessment 10. Review testing arrangements Confirm dates, times and locations Remind participants Review administration plan with assistants

Southern Regional Education Board HSTW Administering the Assessment 11. Administer assessment Student and Teacher Window: January 29 – February 19, 2010 Administration guide includes scripts and complete instructions for administering the student assessment Students must complete all four components All materials must be postmarked for return using the enclosed instructions and labels no later than February 19, 2010

Southern Regional Education Board HSTW Administering the Assessment 12. Return materials Pack student and teacher materials using enclosed instructions Completed answer documents will be packed in a different envelope and use a different return label than the test books and other materials If the necessary envelopes and labels are not included, you must call ETS (Lisa Rion at ) for replacement materials New in 2010 – teacher survey materials will be returned with student materials to ETS All materials must be postmarked for return no later than February 19, 2010 Keep the receipt and tracking number!!!

Southern Regional Education Board HSTW Important Dates to Remember Order window September 1 – October 30, 2009 Administration materials available online September 1, 2009 Test materials arrive at sites January 20, 2010 Student and teacher administration window January 29 – February 19, 2010 Final return deadline February 19, 2010 Awards and student reports mailed to sites April 30, 2010 Payment due to SREB April 30, 2010 School reports mailed to sites June 30, 2010

Southern Regional Education Board HSTW Making the 2010 Assessment a Success Communication Letters/informational sessions for students and parents Announcements to faculty and staff Stress importance, intended use and value of assessment

Southern Regional Education Board HSTW Making the 2010 Assessment a Success Cooperation Importance of the assessment to the school’s improvement goals Importance of students, administration and faculty taking it seriously Handling make-up work Cooperation from teachers whose classes might be interrupted by the assessment

Southern Regional Education Board HSTW Making the 2010 Assessment a Success Encourage all students to do their best Promote the HSTW Award of Educational Achievement Recognize those who receive the HSTW Award of Educational Achievement Explain the new student readiness reports and how it can help with their resumes Build enthusiasm Be honest – explain how this helps the school and future students Make students feel special for participating in the assessment and thank them for their participation

Southern Regional Education Board HSTW For More Information… Go to SREB’s Web pages on assessment for more ideas and information! Allison Timberlake, Director of Assessment and Evaluation (404) Fran Mathis, Research Assistant (404) George Johnson, HSTW Coordinator Sheri Abramson-Einhorn, NJ Department of Education