1. Best Assessment Practices

2. A GENDA Introductions & History Jon S. Twing, Ph.D., Pearson Where Do We Go From Here? Lisa Ehrlich, Ph.D., Measured Progress How To Use the Best Practices Joe Willhoft, Ph.D., Washington DOE Wes Bruce, Indiana DOE Distinguished Commentary and Vision Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO) 2

3. Introductions & History Jon S. Twing, Ph.D., Pearson

4. Long Duration-Collaborative Effort - 2007-2010 - ATP, CCSSO - A lot of hard work by a lot of people Purpose was to define and describe best practices in operational fulfillment of large-scale, high-stakes assessment - Voluntary, inclusive and non-proprietary - Tells us what to do, not how to do it - Applicable to other venues like Common Core Process involved internal and external review, professional editing and publishing H ISTORY 4

5. F ORESHADOWS OF THE F UTURE Many requests made for the Best Practices document have already been made: - US Inspector General - GAO - States for inclusion in RFP’s - Service Providers for inclusion in Proposals - For use as Training Materials The need seems present and time will tell if the publication is a success 5

6. Where Do We Go From Here? Lisa Ehrlich, Ph.D., Measured Progress

7. W HERE DO WE GO FROM HERE ? Use of Best Practices document by service providers How do I get a copy? Version II – yikes! 7

8. S ERVICE P ROVIDER U SE Guideline for statewide assessment programs RFP requirement for contract work Baseline for operational program standards Used to improve or refine existing procedures or processes Gap analysis to identify area(s) needing attention Training document for new employees 8

9. H OW DO I GET A COPY ? To be notified when the document is on Amazon, please send an email to: operationalbestpractices@gmail.com Complementary copies for States and ATP publishers/vendors Posted for sale on central site linked to CCSSO and ATP sites Comprehensive Best Practices communication plan with AAP Test Committee developed A webinar will be held on July 28 th to introduce the document, for more information please send an email to: operationalbestpractices@gmail.com 9

10. V ERSION II OF B EST P RACTICES Convene new working group in 2011 to begin work on Version II document. - On line assessment expanded - Accommodations - Race to the Top program requirements Want to participate? Please contact Bob Olsen (roberto@ccsso.org) or Alan Thiemann (ajthiemann@gmail.com). 10

11. How To Use the Best Practices Joe Willhoft, Ph.D., Washington DOE

12. C HANGES IN OUR W ORK Race to the Top - Consortia & Common Core Standards and Assessment ◦ Integrated Comprehensive Assessment System ◦ Developed Over Next four Years ◦ Includes Summative and Formative Components ◦ Includes Common Achievement Standards, Item Bank, and Reporting System ◦ Computer Adaptive 12

13. C HANGES IN OUR W ORK ( CONT ’ D ) - Timeline ◦ Proposals Due to U.S Department of Education (USED) June 23 ◦ USED Decision to states by end of September ◦ Work Beginning October 2010 ◦ Assessments in place 2014-2015 13

14. C HANGES IN OUR W ORK ( CONT ’ D ) - Teacher Involvement Like Never Before ◦ Need to Understand the Basic Process and Collaborate on the Plan - Consortia and State Policy must follow Best Practices ◦ More than ever we require common language for states, districts, teachers, and vendors 14

15. U SING B EST P RACTICE H ERE AND N OW - Near-term work for states and vendors ◦ Next 3-4 Years for Ongoing Activities - Need for continuation of best practices ◦ New Contracts and Amendments ◦ New Staff and Training ◦ Online Testing 15

16. How To Use the Best Practices Wes Bruce, Indiana DOE

17. W HY S TATES N EED B EST P RACTICES States have much to lose when operational breakdowns occur - Direct impact on students and families - Loss of credibility for the assessment - Impact on Federal & State Accountability Systems - Provides a reason for “change” - Policy implications - Legislative/budget implications 17

18. W HY S TATES N EED B EST P RACTICES ( CONT ’ D ) Capacity of SEA staffing - Turnover at SEAs - Capacity building and training Removes some of client/service provider tensions - Cooperation critical to success – provides common goal - “Partnership” model can be more flexible than a strict procurement model Helps provide metrics, success indicators and early warning mechanisms in a systemic fashion - Helps planning and avoids reacting on short notice to unexpected events 18

19. H OW WILL S TATES USE THE “B EST P RACTICES ”? Professional Development Procurement Policy Guidance/Defense 19

20. P ROFESSIONAL D EVELOPMENT New State Assessment Director - Has an “Owner’s Manual” New Assessment Staff Member - Specific chapters based on responsibility Working committees - A resource to help understand complexities and demands of large scale 20

21. P ROCUREMENT Inclusion in RFP - Specific portions - By reference Use as a tool for proposal evaluation - Ability to demonstrate adherence to these standards Contract - Establishing common expectations for quality and deliverables 21

22. P OLICY G UIDANCE /D EFENSE Reference for policy makers, legislators and staff on the how and why of assessment practice Use when testifying to committees State Policy Makers - A reference to demonstrate our estimates of time needed for quality are supported by the industry - A demonstration of where costs come from in the assessment program 22

23. Distinguished Commentary and Vision Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO)