1. 2011 SBAC Architecture: Implications for Technology and Testing Providers (Part 1) Co-Hosted with ATP February 6, 2011

2. 2011 Announcements This webcast is being recorded. The audio visual file and presentation slides will be available on the SIIA Education Division home page. www.siia.net/educationwww.siia.net/education Submit questions at any time via the “Chat” feature. SIIA Events: http://siia.net/events/events.asphttp://siia.net/events/events.asp – SIIA Ed Tech Government Forum, March 7-8, 2012, DC – www.siia.net/etgf www.siia.net/etgf – SBAC Architecture Webinar Series: Part 2, February 21, 4 p.m. Part 3, March 13, 4 p.m. – SIIA Ed Tech Industry Summit, May 6-8, SF – www.siia.net/etiswww.siia.net/etis 2

3. 2011 Speakers John Jesse, Utah Department of Education Assessment Director & Co-Chair of the SBAC Technology Approach Working Group Thomas Squeo, CIO, Measured Progress Jill Abbott, Executive Director, SBAC System Architecture Development, Measured Progress & CEO, Abbott Advisor Group Robert, Mohundro, Head of Program Management Office, Measured Progress Michael Powell, Architect, Measured Progress 3

4. 2011 SIIA Resources CCSSO-SIIA Advisory Forum: Key Technology Considerations for the Next Generation of Student Assessments (October, 2011) http://www.ccsso.org/News_and_Events/Current_News/CCSSO_Kicks_off_Assessment_Advisory_Forum_Series.html http://www.ccsso.org/News_and_Events/Current_News/CCSSO_Kicks_off_Assessment_Advisory_Forum_Series.html SIIA Webinar: SMARTER Balanced Assessment Consortium: Technology Update (November, 2011) http://siia.net/index.php?option=com_content&view=article&id=891:siia- webinar-smarter-balanced-assessment-consortium-technology-update&catid=159:education-articles&Itemid=934 http://siia.net/index.php?option=com_content&view=article&id=891:siia- webinar-smarter-balanced-assessment-consortium-technology-update&catid=159:education-articles&Itemid=934 SIIA Comments to U.S. DoED RFI on RTTA Technology Standards (January, 2011) and Related Blog http://siia.net/index.php?option=com_docman&task=doc_download&gid=2792&Itemid=318 http://siia.net/index.php?option=com_docman&task=doc_download&gid=2792&Itemid=318 http://www.siia.net/blog/index.php/2011/01/balancing-technology-standardization-and-innovation-in-race-to-the-top- assessments/ SIIA Comments to US DoED Proposed RTTA Technology Standards Priorities (November, 2011) http://siia.net/index.php?option=com_docman&task=doc_download&gid=3177&Itemid=318 http://siia.net/index.php?option=com_docman&task=doc_download&gid=3177&Itemid=318 SIIA Interoperability Primer -- TBA 4

5. Measured Progress ©2011 SMARTER Balanced Assessment Consortium IT Systems Architecture Conversation with SIIA and ATP February 6, 2012

6. 2011 Agenda High-Level Overview of SBAC SBAC Governance SBAC Architecture Discussion and Q/A

7. Measured Progress ©2011 SBAC Overview

8. 2011 Collection of 29 member states Collaboratively working to develop a student assessment system aligned to a common core of academic content standards Innovation The goal of the Consortium is to ensure that all students leave high school prepared for post-secondary success in college SBAC Overview

9. 2011 To develop a set of comprehensive and innovative assessments for grades 3-8 and high school in English language arts and mathematics aligned to the Common Core State Standards Students leave high school prepared for postsecondary success in college or a career through increased student learning and improved teaching The assessments shall be operational across Consortium states in the 2014-15 school year SBAC Purposes

10. 2011 Balanced Assessment System Common Core State Standards specify K-12 expectations for college and career readiness Common Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools to improve teaching and learning Interim assessments are flexible, open, and provide actionable feedback Summative assessments are benchmarked to college and career readiness Teachers can access formative assessment practices to improve instruction

11. Measured Progress ©2011 SBAC Governance

12. 2011 Architecture Review Board (ARB) – Reviews and prioritizes all changes to architecture – Review and advises buy vs. build decisions – Assists in monitoring of contractors – Reviews architecture implementations for compliance with SBAC technology standards – Evaluate architecture metrics Structure

13. 2011 Core Architecture Team – Define and recommend standards for ARB – Support project delivery risk management – Advise on delivery systems and infrastructure design and implementation – Capture data on architecture governance metrics Extended Architecture Team – Evaluate and recommend interoperability standards – Provide expertise on components – Research technology trends Structure

14. Measured Progress ©2011 SBAC Architecture

15. 2011 Workshops – Scoring, Distributed Scoring, Reporting, Portals/Dashboards and Collaboration – Item Authoring, Item Banking, Digital Library, Interoperability and Test Creation – Test Creation, Test Delivery Platform, Adaptive Testing and Integration Framework Report Out and Workshops Review Periods How We Got Here

16. 2011 Choose single-responsibility systems Design for emergent reuse Develop homogeneous systems Demand driven releases Business continuity Low costs for SEA Architecture Principles

17. 2011 High-Level System Component Diagram

18. 2011 Assessment Creation Domain Definition

19. 2011 Assessment Reporting and Shared Services Domain Definition

20. 2011 Need to be deployed and hosted in numerous different environments Nine requirements: – Deployable at the Consortium level – Must support installations at the Consortium, state or LEA – Must support cloud-based hosting as well as traditional – Must support multi-tenancy at the state and above – Components support partitioning – Support all security requirements – Only approved personnel have access to items and data – SBAC items exported to SBAC-certified systems only – If applicable, SBAC Item Bank must support state-specific items Deployment and Hosting

21. 2011 Deployment and Hosting – One Scenario All components are deployed at the consortium level, and one or more states use the components without modification.

22. 2011 Components shouldn’t access other components’ data store directly Use a storage mechanism that fits intended use of data Storage mechanism must allow for multi-tenancy Only one source of truth for each data element Determine if history of domain object needs maintaining All services and databases only accept data stored that follows minimum data rules Each entity must have a unique key Tables must be normalized to the third normal form General Data Architecture Principles

23. 2011 5 swim lanes depicting use cases Tables recommending standards for each swim lane Interoperability

24. 2011 Multiple types required: – Component to component – User authentication and authorization – Item-level – Student data Security

25. 2011 Component Server Matrix Technical Architecture Definition

26. Measured Progress ©2011 Next Steps

27. Measured Progress ©2011 Discussion and Question and Answer