Online Assessment Development and Implementation Collaborative Conference for Student Achievement April 20, 2011 Jim Kroening Hope Tesh
4/20/11 page 2 Why is NC Transitioning to Online Assessments? SMARTER Balanced Assessment Consortium (SBAC) Computer-Adaptive tests in grades 3-8 ELA and Mathematics Performance tasks delivered online Interim assessments and formative practices delivered online Professional development delivered online
4/20/11 page 3 Current Online Assessment Utilization Over 40,000 student responses written in the Writing Instruction System (WIS) as of 01/14/11 10,297 EOCs administered online as of 01/20/11
4/20/11 page 4 How does NC Plan to Transition to Online Assessments? Spring 2011 Online item tryouts Participation in at least one EOC online assessment Online field tests (English II, Biology, grades 5 & 8 Science, NCEXTEND2) Participation in one or more EOC online assessments First operational administrations (English II, Biology, grades 5 & 8 Science, NCEXTEND2)
4/20/11 page 5 Benefits of Online Assessments Universal Design Designed for increased accessibility One-item per test page Large font High contrast screen Background color Electronic highlighter, calculator Computer Reads Test Aloud Accommodation
Benefits (continued) 4/20/11 page 6 Developed as Online Assessments Student Engagement Technology-Enhanced Items Scheduling/Staffing Flexibility Accommodated Test Administrations Scanning/Scoring Test Security Reporting
Online Assessment Tutorial 4/20/11 page 7
Technology-Enhanced Item - Biology 4/20/11 page 8
4/20/11 page 9 Technology-Enhanced Item – English II
NCEXTEND2 Grade 5 Science Item 4/20/11 page 10
NCTEST Version 1 4/20/11 page 11 Operational EOC Online assessments PDF Technical requirements: List of Tests that can be accessed with NCTest Registration (NCR) Operational Reporting Technology Information/Requirements (e.g., platform, add ons, javascript, proxy servers, firewalls, pop-up windows, footprint/bandwidth used, wireless networks)
NCTest Version 2 Spring 2011 Item Tryouts including the Online Assessment Tutorial Field tests Compatible with personal learning devices Not flash paper based Computer Reads Test Aloud Accommodation 4/20/11 page 12
NCTest Version 2 Technical Requirements (Spring 2011 Item Tryouts) Suggested browsers include: IE 7, 8 (IE 6 is NOT supported) Firefox 3.5+ Safari 5+ Screen minimum resolution – 1024 x 768 Adobe Flash 9 or better Updated technical requirements will be available for fall /20/11 page 13
Challenges Paradigm Shift Partnership Development Funding/Local Infrastructure Short-term and Long-Range Planning Logistics Test administration window Computer lab scheduling Technical Wireless Test security related to personal learnin g devices 4/20/11 page 14
Locally: How to Implement? Not a Recipe Leadership Team Effort Organization and Planning Tackle Issues One Step at a Time Competition Help Desk One Toe in the Water Support Each Other 4/20/11 page 15
For More Information… ACRE Home Page Assessment (ACRE) Online Assessments Best Practices Guide (Coming Soon!) Resources 4/20/11 page 16
Questions? 4/20/11 page 17
Contact Information Jim Kroening Testing/Accountability Lead Consultant Hope Tesh Testing Policy and Operations Consultant /20/11 page 18