1. Using Computers for Testing: It’s Not Just Plug and Play © 2010 Measured Progress. All rights reserved. The CBT Story From Three States

2. Using Computers for Testing: It’s Not Just Plug and Play  Three states with three different CBT vendors and very different programs.  Each presenter will tell the story of their state’s transition from paper-based to computer-based delivery of assessments.  It turns out that transitioning from paper- based to computer-based testing is more of a complicated novel than a short story…

3. Using Computers for Testing: It’s Not Just Plug and Play Presenters  Julie Quinn, Computer-Based Assessments Specialist, Utah State Office of Education  Scott Cook, ISAT Coordinator, Idaho State Department of Education  Tony Alpert, Director of Assessment, Oregon State Department of Education  Dona Carling, Director, Client Services, Measured Progress

4. Using Computers for Testing: It’s Not Just Plug and Play © 2010 Measured Progress. All rights reserved. Observations from a contractor

5. Lessons learned from these states:  It can be done!  Statewide software implementation is challenging.  Planning is critical.  Benefits and disadvantages have to be balanced.  Roles will change, therefore skills needed will change.  Risk management becomes part of the new world.  Know about technical readiness of schools.  Maintaining dual program is not cost-effective, but may be a reality for a time. Using Computers for Testing: It’s Not Just Plug and Play

6.  Plan, plan, plan, ...and then expect things to not go according to plan. Plan for:  how much how fast—what can the system bear?  contingencies  what should stay the same and what should be different  training and practice  getting folks from the field on board early  technical support for the field  shifting thinking from PBT-centric to CBT-centric  functionality testing Using Computers for Testing: It’s Not Just Plug and Play

7.  A vendor partnership is necessary.  Need to have the same metrics for success.  Need to have a good communication plan.  Must have a thorough plan for each process. Have to think ahead about how the transition to CBT will change things.  Agree to a formal Service Level Agreement.  Honesty about what is possible / feasible / risky.  Risk management becomes part of new way of life.  Change management is critical. Using Computers for Testing: It’s Not Just Plug and Play

8.  Lots of old questions have to be re-asked. What does standardized test mean? What is an appropriate testing window? How do we handle calculators? How do we handle accommodations? Does it make sense to do “it” the same way it is done in paper? Do we allow for auto-updating of software? What about alternative settings? Using Computers for Testing: It’s Not Just Plug and Play

9. Measured Progress It’s all about student learning. Period. Dona Carling, Director, Client Services E-mail: dcarling@measuredprogress.org Phone: 603.749.91032