NAEP 2017 Campus Testing Coordinator (CTC) Training October 2016 National Assessment of Educational Progress (NAEP) Trial Urban District Assessment (TUDA) NAEP 2017 Campus Testing Coordinator (CTC) Training October 2016

NAEP Overview NAEP Background information Trial Urban District Assessment Criteria for TUDA Project Who takes NAEP? Participation Policies Role of Campus Test Coordinator Key Players for NAEP Managing MyNAEP Website Provide School Information Prepare for Assessment Review and Verify List of Students Selected for NAEP Pre-assessment Review Call Results Accommodations Timeline of Events Contacts

What is NAEP?

About NAEP National Assessment of Educational Progress Established in 1969. The National Assessment of Educational Progress (NAEP) is referred to as The Nation’s Report Card. Provides an essential measurement of student achievement in America in core subjects like mathematics, reading, science, and writing. It is the only nationally representative assessment It reports on student achievement at the national and state levels as well as selected urban districts.

TUDA Trial Urban District Assessment The Trial Urban District Assessment (TUDA) is a special project within the main NAEP of the National Center for Education Statistics, the National Assessment Governing Board (NAGB), and the Council of the Great City Schools to determine the usefulness of reporting district-level results. TUDA assesses the performance of public school students at the district level in grades 4 and 8. NAEP has served as a framework for reporting district level results.

Criteria for TUDA Project Must be located in large cities having a population of 250,000 or more. Must be large enough to support a three-subject assessment cycle for NAEP in grade levels included in the state assessment program. Must have a majority (50 percent or more) of students meeting at least one of the following criteria: Either African American or Hispanic. Eligible for participation in the National School Lunch.

Who takes NAEP? The sample of schools drawn for the TUDA assessment is representative of all students in the district. A random sample of students is selected.   The sample of students in the participating TUDA school districts is an extension of the sample of students who would usually be selected by NAEP as part of state and national samples. The numbers of students assessed vary across the districts include students with disabilities (SD) and English language learners (ELL) provided with accommodations.

NAEP Participation Policies Encourage participation without altering assessment constructs Attain comparable inclusion rates across states and districts Goal to include 95% of all students Will prominently display jurisdiction meeting the goal in national reports Goal to include 85% of SD and ELL Will identify jurisdictions falling below in national reports

The Role of NAEP/TUDA Campus Testing Coordinator (CTC) You are the liaison for all NAEP assessment activities in your school. Work with NAEP field staff during Pre- assessment Review Call (PRC) and during testing. Monitor and maintain MyNAEP website (www.mynaep.com)

Key Players for NAEP NAEP State Coordinator – is the chief resource to district. District TUDA Coordinator – serves as overseer for district’s assessment. Campus Test Coordinator – liaison between NAEP field staff and campus. NAEP Field Staff: Field Managers (Paper and Pencil/Digital Based Assessment) – partner with NAEP State Coordinator and District TUDA Coordinator Field Supervisor – troubleshoots all testing matters. Assessment Coordinator – works with CTC regarding testing arrangements. Assessment Administrator – serves as proctor for test administration.

Campus Test Coordinator District TUDA Coordinator (CTC) District TUDA Coordinator (DTC) NAEP State Coordinator (NSC) NAEP Field Manager (FM) Field Supervisor (FS) Assessment Coordinator (AC) Assessment Administrator (AA)

CTCs Monitor and Maintain MyNAEP The MyNAEP website provides a direct communications link to NAEP that shows the campus what to expect throughout the NAEP assessment process. NAEP and the State Coordinator can provide information and instructions to schools and respond to specific questions. CTCs are to log onto www.mynaep.com and select Please Register for registration using the assigned eight-digit ID. Refer to slides 15 – 18. Complete the Provide School Information section (no later than October 7, 2016). See slides 20 – 22. The District Coordinator submits the student file for the campuses in November 2016 and will complete the Update Student List in January 2017.

My NAEP Website (www.mynaep.com) Registration

My NAEP Website (www.mynaep.com) Provide School Information

My NAEP Website (www.mynaep.com) Prepare for Assessment

My NAEP Website (www. mynaep My NAEP Website (www.mynaep.com) Pre-assessment Review Call (PRC) Activities

When Will I Be Contacted by NAEP? In early December, a NAEP staff member will make an introductory call to set up your pre-assessment review call (PRC). PRC will be in January 2017 prior to test date. PRC will be listed on the MyNAEP website.

To do List before to the PRC Complete Prepare for Assessment tasks Review and Verify List of Students Selected for NAEP (available for viewing on December 5, 2016) Complete SD/ELL Student Information Notify Parents Manage Questionnaires Plan for Assessment Day Encourage Participation Update Student List

How Do I Prepare for the PRC? Locate the pre-assessment packet that should arrive in early December Await verification call from NAEP staff that packet has arrived and ask questions Review all items in packet Distribute SD/ELL questionnaires to staff most knowledgeable on how students test on STAAR Send parent notification letter (Sample on MyNAEP)

What Happens During the PRC? You will work with your AC to: Confirm students that have withdrawn since the student list was submitted. Confirm additional students added to the assessment. Confirm missing or corrected student demographic data. Review the SD and ELL Worksheets and discuss accommodations. Receive School and Teacher Questionnaires. Provide a dated copy of the Parent/Guardian Notification Letter. Discuss Logistics Information Form.

Texas NAEP Accommodations for English Language Learners (ELL) and Students with Disabilities (SD)

On NAEP Test Day CTC will provide a work area for NAEP staff before, during, and after the assessment. NAEP staff provides all assessment materials and conducts sessions. CTC is responsible for making sure sampled students attend sessions. Attendance rates need to be high as possible to meet the 95% participation requirement. CTC should assemble a team of campus staff to assist with troubleshooting during the test. NAEP staff administer the tests but do not have your authority over the classroom

Results

NAEP Assessments . . . have no student-level results (each student gets only a small part of the complete assessment); have no school-level results; TUDAs only have district-level results; are not designed to assess student achievement against expectations of a specific curriculum. NAEP assessments allow comparisons across states and to the nation; state assessments do not.

How are NAEP results reported? NAEP results are presented in two ways: as scale scores and as percentages of students attaining achievement levels. Scale scores describe what students know and can do. (0-500 depending on test) Achievement levels describe what students should know and be able to do. Basic: partial mastery of prerequisite knowledge and skills for fundamental proficiency Proficient: solid academic performance, demonstrated competency over challenging subject matter Advanced: superior performance

Dallas NAEP Grade 4 Math Results 2011, 2013, and 2015 Figure 1: Grade 4 Math Comparisons by Demographic Category, 2011, 2013, and 2015 Significant gains were made in fourth- grade math from 2013 to 2015. All student groups demonstrated an increase in performance from 2013 to 2015. Dallas black students demonstrated an upward trend in performance. Dallas Hispanic students continued an upward trend in student performance. Dallas English language learners demonstrated an upward trend in student performance. Dallas economically disadvantage students continued an upward trend in student performance.

Dallas NAEP Grade 8 Math Results 2011, 2013, and 2015 Figure 2: Grade 8 Math Comparisons by Demographic Category, 2011, 2013, and 2015 Grade 8 demonstrated a decline in math performance from 2013 – 2015. Dallas Black students held steady compared to 2013. Dallas Hispanic students registered a decline compared to 2013. English language learners in Dallas registered a decline compared to 2013. Dallas economically disadvantage students performed similarly to those in national public schools.

Dallas NAEP Grade 4 Reading Results 2011, 2013, and 2015 Figure 3: Grade 4 Reading Comparisons by Demographic Category, 2011, 2013, and 2015 Grade 4 students demonstrated a decline in reading performance from 2013 to 2015. Dallas black students registered no significant difference in performance from the previous test administration. Dallas Hispanic students saw a decline in performance compared to the previous test administration. English language learners in Dallas experienced a decline in performance. Dallas students identified as economically disadvantaged saw a slight decline in performance compared to 2013.

Dallas NAEP Grade 8 Reading Results 2011, 2013, and 2015 Figure 4: Grade 8 Reading Comparisons by Demographic Category 2011, 2013, and 2015 Grade 8 students demonstrated a slight decline in performance from 2013 to 2015. Black students showed a slight decline. Hispanic students held steady compared to 2013. English language learners’ performance was consistent with the previous test administration. Performance for economically disadvantaged students registered a slight decline compared to 2013

Calendar of Events Dates and Deadlines Activity June 2016 District were notified of schools selected for NAEP 2017. Principals received an email notification. August 2016 Principals were sent School Coordinator letter (assessment dates were included). September 2016 Window for School Coordinator to complete the Provide School Information (PSI) on MyNAEP website. October/November 2016 E-file—October 3 – November 11 (will be submitted by Assessment Programming Support) December 2016 Pre-assessment Packets arrive at schools; Initial call from NAEP field staff; Student list available to view (December 5) January/March 2017 Assessment dates (January 30 – March 10) Pre-assessment Review Call (PRC) from NAEP Assessment Coordinator (begins the week the district returns from Winter Break)

Contacts Robert Mount, Ph. D Director of State and National Assessments (SNA) Evaluation and Assessment 972-925-6410 mount@dallasisd.org Frederick Washington Assessment Specialist/ District TUDA Coordinator State and National Assessments 972-925-6419 fwashing@dallasisd.org Dr. Charlenta Govan Districtwide Campus Testing Coordinator chgovan@dallasisd.org Kim Ackermann State NAEP Coordinator 512-463-9536 kim.ackermann@tea.state.tx.us