NAEP 2019 Pre-Administration Workshop 10/2/2018 NAEP Pre-Administration Training 10:00 am – 12:00 pm   https://register.gotowebinar.com/register/6419059225544156418 10/4/2018 NAEP Pre-Administration Training – LIVE Repeat 1:00 pm – 3:00 pm https://register.gotowebinar.com/register/2667741055851531266

AGENDA Overview Sampling School Coordinator Responsibilities Assessment Process Results Resources

OVERVIEW

Testing Requirements National Assessment of Educational Progress (NAEP) Under the umbrella of the U.S. Department of Education The Every Student Succeeds Act (ESSA) requires states/districts who receive Title I funding to participate in the biennial NAEP assessment in reading and mathematics at grades 4 and 8. Georgia law and State Board of Education rules require participation in all NAEP assessments.

Unique Features of NAEP National testing program, same assessment in every state Sample of schools to represent demographics of state Students in selected schools are sampled Each student is only assessed in one pre-assigned subject Results for state or selected district only Assessed subjects vary by year Contracted assessment team Six month results window Results can be aggregated by demographic variables Special research studies

NAEP Grade Levels and Content Areas Developed by the National Assessment Governing Board (NAGB) Grades and ages Grades 4, 8 and 12 Ages 9, 13, and 17 (Long-term trend) Developed frameworks and assessments Reading - Economics Mathematics - Civics Science - Foreign language U.S. History - Writing Geography - The Arts

NAEP Purpose To measure student achievement in the context of instructional experiences. To track achievement of fourth-, eighth-, and twelfth- graders over time in selected content domains. To provide the only comparison to the achievement of students in every other state in the nation. To provide the comparison of the students in each state to the students enrolled in the nation’s public schools.

SAMPLING

NAEP Representative Sample NAEP is designed to report results at the national and state level Results for selected trial urban districts (TUDA); Atlanta is a TUDA Every student in every school not required to take the assessment A sampling frame created using the Common Core of Data (CCD) NAEP administered to a sample of students from this frame who represent the student population of the nation as a whole and of individual states and districts participating in the Trial Urban District Assessment (TUDA).

School Selection

Student Selection Students selected based on grade (4, 8 or 12) List of all enrolled students submitted to NCES Students randomly selected Every student is eligible to be selected Sampled students assigned to only one subject In general, 30 students per subject, per grade SD and ELL students can receive NAEP approved accommodations No implication for students who do not receive accommodations because neither students nor schools receive scores

Subject Selection

NAEP 2019 Program     National 4 & 8 State/TUDA 4 & 8 National 12 2 DBA sessions 25 students each 1 DBA session for PR National 4 & 8 1 PBA, 12-13 students National 12 19 students each 1 PBA, 30 students Mathematics   State/TUDA1 Puerto Rico  Pilot2  National3 Reading State/TUDA1 Science Vocabulary Special studies with additional student questionnaires: 1=National Indian Education Study (NIES), 2=Extended Student Questionnaire (ESQ, or “SES-SQ”), 3=Computer Access and Familiarity Study (CAFS) Assessment window = 1/28/19 – 3/8/19 

2019 Georgia Sample 2019 State Results Mathematics Reading Georgia Schools (excluding TUDA) Grade 4: 140 schools Grade 8: 151 schools Grade 12: 60 schools TUDA 4th and 8th grade only 78 schools

2018/19 International Participation International Computer and Information Literacy Study (ICILS) Computer based assessment for 8th graders Measure skills and experiences using technology to investigate, create, and communicate More than 20 countries International Early Learning Study (IELS) Tablet based study of children’s emergent skills of 5- and 6-years olds Literacy, numeracy, empathy and trust, and self-regulation Multiple countries Program for International Student Assessment (PISA) Assessment of reading, mathematics, science literacy and financial literacy of 15-year olds More than 70 countries Teaching and Learning International Survey (TALIS) Online survey of teachers of grades 7-9 and the principals of the schools Describe conditions related to teaching in their schools and successes and challenges faced by school leaders More than 40 countries Trends in International Mathematics and Science Study (TIMSS) Tablet based assessment of 4th and 8th graders More than 60 countries

SCHOOL COORDINATOR RESPONSIBILITIES

NAEP Important Dates District Superintendents notified of school selection in June System Test Coordinators notified of school selection and assessment dates in June Principals of sampled schools notified in August; school coordinator responsibilities sent; reschedule requests being taken now Contact from NAEP assessment team in early December NAEP assessment – last week in January through first week of March January 29 to March 9, 2019

What is MyNAEP? www.mynaep.com MyNAEP serves as your primary resource and action center for the NAEP assessment. All preassessment activities are completed via MyNAEP. The site contains confidential information, so all users will be prompted to accept a confidentiality agreement. Requires a username and password. www.mynaep.com

MyNAEP Activity Timeline 1 3 2 4 5 Register for MyNAEP Provide School Information Prepare for Assessment Support Assessment Activities Wrap Up August - September December - January One week before the assessment After the assessment

Getting Started on MyNAEP How to Register for MyNAEP The first MyNAEP School Coordinator task is to: Register on the MyNAEP website and familiarize yourself with the website,   All required tasks and information will be posted here.   Review the list of School Coordinator activities by early October.

How do I register for the site? (Completed) Each school received a MyNAEP registration ID.

How do I register for the site (cont’d)?

Recovering your password Select the “Forgot Password” link Enter your email address Receive email with temporary password Login with temporary password Create new password

Provide School Information (Completed)

Submission of Student List (Due in mid-November) Submitted by NAEP State Coordinator for all schools Students in sampled grade only List provided by DOE Technology group Student Information Name GTID MOB, YOB Gender Ethnicity Race SD ELL Lunch Status (Provided by school later) Economically Disadvantaged

Prepare for Assessment The Prepare for Assessment menu includes 7 activities Only school coordinators and principals have full access to this menu The list of selected students will be posted under Review and Verify List of Students on December 3rd All 7 tasks should be completed before the scheduled preassessment review call

Prepare for Assessment: How does it work? Each activity has a tutorial video and a “Additional Resources” section On average, the videos are about 5 minutes each Resources are helpful documents that support the activity

Prepare for Assessment: How does it work? Each activity has a tutorial video and a “Additional Resources” section On average, the videos are about 5 minutes each Resources are helpful documents that support the activity

Prepare for Assessment: How does it work? The menu serves as a “virtual checklist” Checkmarks will appear after activities are completed White checkmarks indicate information that will be confirmed by your NAEP representative during the preassessment review call

Prepare for Assessment: How does it work? During the preassessment review call, the NAEP representative will review and confirm all activities The white checkmarks will turn green Green checkmarks indicate that the information is in “read only mode” Contact your NAEP representative to make any changes

Prepare for Assessment: How does it work? The first 6 activities will be available on December 3rd Please complete these before winter break Update Student List will be available in January Complete this last activity when you return from winter break

Prepare for Assessment: Review and Verify Students Review the list of selected students, and make the following updates Identify students who are withdrawn, no longer enrolled, foreign exchange, not attending classes on campus, not in the selected grade Update any missing or incorrect demographic information Update classifications for students with disabilities, 504 plan students, and English Language Learners

Prepare for Assessment: Complete SD/ELL Information Select Complete SD/ELL Student Information. This section will become available on the MyNAEP website in December 2018. Provide information for students with disabilities (SD) and English language learners (ELL) who are in the sample. If you do not see a student sampled for NAEP who is SD and/or ELL in this section, you must return to the Review and Verify Information for Student Selected for NAEP section and correct their status here. Fig. 1

Prepare for Assessment: Complete SD/ELL Information Provide additional information about students with disabilities (SD) and English language learners (ELL) How each student is assessed on the state assessment Testing accommodations that each student typically receives The IDEA category that best describes the student’s disability How long each student has been enrolled in U.S. schools (ELL) Level of English proficiency (ELL) State Inclusion Policies are posted on MyNAEP page

Prepare for Assessment: Complete SD/ELL Information School coordinators can assign this task to SD/ELL specialists Enter the names and email addresses of up to 5 specialists They will receive an email with registration info

Prepare for Assessment: Notify Parents Download and distribute the parent/guardian notification letter template Customize text and include school letterhead Verify that parents/guardians of all sampled students were notified by entering the date the letter was sent Upload an electronic copy of the customized parent letter

Prepare for Assessment: Manage Questionnaires Enter the names and email addresses of questionnaire recipients, then send links to online questionnaires The school questionnaire is assigned to the principal Teachers at grade 4 & 8 schools should be assigned teacher questionnaires Teachers of American Indian/Alaska Native students will be assigned an additional questionnaire

Prepare for Assessment: Plan for Assessment Day Assign a location and time for each assessment session and answer logistics questions Let the NAEP representative know where to park at the school, how to check in, and what to do if there is a weather delay

Prepare for Assessment: Encourage Participation Use recommended strategies to inform students and teachers about NAEP Includes short 5 minute videos for teachers and students about the importance of NAEP

Prepare for Assessment: Update Student List (Excel) Create an Excel list of all currently enrolled students after January 1, 2019 NAEP uses this list to give newly eligible students an opportunity to be sampled The list should include the following information for each student: State-level unique student ID *optional, no SSNs First name Middle name *optional Last name Month of birth Year of birth

Prepare for Assessment: Update Student List School coordinators can assign this task to a data specialist The specialist will receive an email with registration info

Support Assessment Activities Print reminders about the scheduled NAEP assessment Student appointment cards Teacher notification letter List of sampled students (attachment for letters) Optional section Recommended timeframe: 1 week before the assessment

Wrap Up Safeguard all materials until the date noted on the red NAEP storage envelope You will receive an email reminder at that time to destroy the contents of the storage envelope in a secure manner

MyNAEP Resources Live chat Videos* Tutorials NAEP Help Desk, 1-800-283-NAEP(6237) or NAEPHelp@westat.com *Videos available for each step of the process, will answer many questions that might arise

ASSESSMENT PROCESS

Assessment Details Contracted assessment team All materials brought to school on assessment day Pre-determined locations Separate accommodations sessions Assessment resides on tablets

Assessment Components Digitally based assessment transition Science interactive computer tasks Science hands-on tasks Student questionnaires

Assessment Components

Assessment Components

Assessment Components

Assessment Components https://nces. ed

RESULTS

NAEP Test Score Ranges Average scale scores and achievement levels reported for reading, mathematics and science. Example scale scores Range is 0-500 for reading and mathematics Range is 0-300 for science Achievement levels Advanced, Proficient, Basic Indicate the percentage of students within the total population, or in a particular subgroup, that meet or exceed expectations of what they should know and be able to do.

NAEP Results NAEP website All previously released results http://nces.ed.gov/nationsreportcard/

International Results National Center for Education Statistics (NCES) https://nces.ed.gov/surveys/international/ ICILS IELS PIRLS PISA TALIS TIMSS

Use of NAEP Data Large database of released items Sub-group aggregation of results Comparison of results to other states Results in context of teacher and school characteristics Results in context of student experiences

RESOURCES

NAEP Resources NAEP Questions Tool More than 2000 questions from previous assessments Scoring guide Actual student responses Question performance data http://nces.ed.gov/nationsreportcard/itmrlsx/default.aspx

NAEP Resources NAEP Questions Tool (Cont’d)

NAEP Resources NAEP Data Explorer National, state, region, district, and subgroup results Demographic survey data http://nces.ed.gov/nationsreportcard/naepdata/

NAEP Resources NAEP Data Explorer (cont’d)

NAEP Resources NAEP Explorer (cont’d)

NAEP Resources NAEP Explorer (cont’d)

NAEP Informational Video Posted on NAEP page of Assessment link of DOE website http://www.gadoe.org/Curriculum-Instruction-and- Assessment/Assessment/Pages/NAEP.aspx

NAEP State Coordinator Bobbie Bable bbable@doe.k12.ga.us 404-657-6168

Questions?