NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, :00-3:30

2 NAEP Alliance Introduction to eNAEP

3 NAEP Alliance NAEP Model (2014 & beyond) Administration on NAEP-provided touch- enabled devices 2 sessions of 25 students per school eNAEP delivery system  Web application  Compatible across various devices, operating systems, and web browsers (i.e., future-proofed)  Can run on virtually any resolution (flexible layout)

4 NAEP Alliance eNAEP Development eNAEP is built to support all NAEP subjects. Provides a consistent user experience across all subjects. Planning for a progressive rollout of functionality over the next few years: – 2014: Initial version (subset of item types & tools) – 2015: Enhanced version (more tools, features & item types) – 2016: Additional item types – 2017: Additional interactive item types

5 NAEP Alliance Summary of Planned eNAEP System Features Features2014 Proof of Concept2015 TBA Startups & Pilots VolumeYes TutorialsNoYes In-System HelpYes Text-to-SpeechNoYes ZoomNoYes HighlighterN/A*Yes Elimination ToolN/A*Yes Change Color ThemeNoTBD** * There are no discrete or questionnaire items in 2014 POC, so these tools are not applicable. **Some accommodations and potential universal design features require discussion by the AICC.

6 NAEP Alliance Additional Features 2015 & Beyond Additional Features2015 & beyond Accommodations, e.g., bilingual, magnification Universal Design features, e.g., text-to-speech, zoom 508 compliance Observable data capture Discrete item types and survey questions Disconnected mode Updates in the field supported Subject-specific tools, e.g. calculator, equation editor Adaptive testingTBD Dynamic distribution of formsTBD Automated scoringTBD

7 NAEP Alliance NAEP 2015 TBA Start Up  January 26 – March 6, 2015  132,000 students  Administered on tablets  Mathematics, reading, and science  Grades 4, 8, and 12  Interactive computer tasks (ICTs) and hands-on tasks (HOTs) in science

8 NAEP Alliance Equipment  Surface Pro 3 tablets  Laptop server  Routers and Ethernet cables  MiFi device  Extension cords, power strips, and tape  Earbuds and headphones  Styluses  Flash drives  Antibacterial wipes

9 NAEP Alliance Surface Pro 3 Tablets – 27 Tablets  25 Student tablets  2 Monitor tablets

10 NAEP Alliance eNAEP Network Equipment  Laptop server  Router  Blue Ethernet cable

11 NAEP Alliance MiFi Device  Wireless device to send student response files from the laptop server to the central server

12 NAEP Alliance NAEP Earbuds  NAEP students keep earbuds  Headphones available when requested

13 NAEP Alliance Styluses  30 Styluses  Re-use for all assessments

14 NAEP Alliance Flash Drives  2 Flash drives  Used for disconnected mode assessments

15 NAEP Alliance 2015 Feedback ChoiceNumber of schoolsPercentage of schools 1 = Touchscreen (specify)1173.5% 2 = Touchpad (specify)220.7% 3 = Stylus (specify) % 4 = Keyboard (specify)521.5% 5 = None of the above % Did students report (or did you observe) any problems with using any of the following? Source: Field Staff Session Debriefing Form

16 NAEP Alliance 2015 Feedback In your observations, did more students use the touchscreen, touchpad, or stylus? Source: Field Staff Session Debriefing Form ChoiceNumber of schoolsPercentage of schools 1 = Yes % 2 = No – How many did you have to plug in? %

17 NAEP Alliance 2015 Feedback Did all the tablet batteries last the entire group? Choice Number of schools Percentage of schools 1 = Touchscreen1303.7% 2 = Touchpad2015.8% 3 = Stylus % 4 – Used equally % Source: Field Staff Session Debriefing Form

18 NAEP Alliance 2015 Feedback Overall, how would you rate the students' engagement in the TBA Assessment? Source: Field Staff Session Debriefing Form Response Number of schools Percentage of schools 1 = Very engaged % 2 = Somewhat engaged3499.9% 3 = Not at all engaged100.3%

19 NAEP Alliance eNAEP System Demonstration

20 NAEP Alliance Demonstration Features Supervisor interface Student login Tutorial Demonstration Monitoring Demonstration Tools Demonstration NAEP Alliance

21 NAEP Alliance Questions?