Test Assessing Secondary Completion TASC

TASC Overview  Test Assessing Secondary Completion (TASC) is a secure, reliable and valid assessment measuring core content areas equivalent to that of graduating high school students.  Key Features –Newly created content, aligned to Common Core State Standards –Normed passing score and College and Career Readiness cut score –Measures Reading/Language Arts, Writing, Mathematics, Science, and Social Studies –Available in English, Spanish and special formats (large print, Braille, and audio) –Available in paper/pencil and online formats –Option to accept previous test scores  Price –$54 per student – includes materials, scoring and reporting –2 free re-takes per student –$10 Official Readiness test – paper based or online  Adopted by the State of New York Copyright © 2013 CTB/McGraw-Hill LLC. 2

TASC Framework  Reading/Language Arts: 45 Questions  Math: 45 Questions  Science: 40 Questions  Social Studies: 40 Questions  Writing: 1 Question  4-5 hour total anticipated time Copyright © 2013 CTB/McGraw-Hill LLC. 3

CTB/McGraw-Hill Overview Full service, large scale assessment publisher, founded in 1926 Over 45 years experience serving adult education community with high quality, nationally researched assessment (paper, online, adaptive) Strong content development capabilities, authoritative Common Core expertise, universal design/accessibility leadership, engaging and rigorous content Highly accomplished research and psychometric staff and practices ensure validity, reliability, professional support Well engineered, robust systems from content management through test delivery & reporting Trusted provider of secure, summative tests, including high school and end- of-course testing programs Online Assessment System (OAS): More than 10,000 sites, 5 million tests administered annually

A distinguished history in assessment McGraw-Hill Confidential – Not for public use

Why develop TASC?  41 States are looking for options  Support for targeted population –Access –Formats –Price  Need for a gradual shift to the Common Core  Building on our Mission – Help the Teacher Help the Student Copyright © 2013 CTB/McGraw-Hill LLC. 6

Test and Research Design  Spring 2013 Field Test –Item analysis, DIF, norming, scaling, operational forms construction  Fall 2013 Special Studies –Comparability of CBT and PBT; Spanish-English  Ongoing Embedded Field Testing/Pool Replenishment –New form development Copyright © 2013 CTB/McGraw-Hill LLC. 7

Implementation of Evidence-Centered Design Copyright © 2013 CTB/McGraw-Hill LLC. 8 Inferences & Interpretations Construct Definition Consideration of Performance Levels Blueprint and Specifications Develop Items/Tasks Review Items/Tasks Field Test Operational Administration CADDS Process DEVELOPMENT DESIGN

TASC Constructs  English Language Arts –Common Core State Standards  Mathematics –Traditional pathway of the Common Core State Standards  Science –Next Generation Science Standards  Social Studies –CTB Social Studies Standards based on national frameworks in the areas of US history, world history, civics and government, and economics Copyright © 2013 CTB/McGraw-Hill LLC. 9

TASC Test Design  operational test includes –Multiple-choice items –3 Forms each for English and Spanish –Writing prompt (evidence-based writing) –Gridded-response items (Mathematics) –Stimulus-based science and social studies item sets –3 new test forms each year  2016 operational test (and beyond) includes an increased coverage of the CCSS through inclusion of additional item types and increased rigor –Constructed-response items –Technology-enhanced items 10 Copyright © 2013 CTB/McGraw-Hill LLC.

Webb’s Depth of Knowledge  Level 1 Recall –Recall of a fact, information or procedure  Level 2 Skill/Concept –Use information or conceptual knowledge, two or more steps, etc.  Level 3 Strategic Thinking –Requires reasoning, developing a plan or sequence of steps, some complexity, more than one possible answer  Level 4 Extended Thinking –Requires an investigation, time to think and process multiple conditions of the problem or task Copyright © 2013 CTB/McGraw-Hill LLC. 11

Webb’s Depth of Knowledge Copyright © 2013 CTB/McGraw-Hill LLC. 12

A Roadmap for AI Essay Scoring 2014 Conduct human-human agreement studies on essays to refine rubrics as necessary Prepare for implementation of automated scoring for the essay prompts 2015 Score online responses with ‘highly validated’ human score (double reads w resolution)* Randomly form training and validation sets Train AI engine with training set AI score the validation set Compare human-AI performance to human- human agreement Release operational parameters 2016 Operational AI scoring with: Evaluation of statistics stability Monitoring AI scores via human read-behind

Copyright © 2013 CTB/McGraw-Hill LLC. 14 Mathematics sample gridded-response item

Sample Math UI & Question

Sample Reading UI & Question

Broadband Connectivity - Specifications  Efficient Bandwidth Usage –Current Architecture Rated to support over 200,000 simultaneous students testing –A site with a 1Mbit Connection can support 200 simultaneous examinees  Details –Prior to Administration Install OAS Client – 20MB (once per workstation) Pre-position TASC Content – 5MB (once per workstation) –During Administration Student Login – 10Kb (one time per sub-test) Student Multiple Choice Response Capture – 1Kb (~every 30s) Student Constructed Response Capture – 2 – 10Kb depending on length of response (~every 30s) –Post Administration Student Finish Notification – 1Kb (one time per sub-test) Copyright © 2013 CTB/McGraw-Hill LLC. 17

Working with the State and Test Centers  CTB capabilities include: –Relationship Management with State and Test Centers –Registration and Payment –Accommodation Guidance –Communication and Awareness –Scoring and Reporting –Data Transfer –Program Financials and Contract Management –Transcripts Copyright © 2013 CTB/McGraw-Hill LLC. 18

CTB’s Capacity  Over 10,000 test sites for OAS  4 million scan sheets processed per day at peak  2 shifts of 700 scorers per day at peak at our Primary Scoring Center  Well defined process to ramp up resources  Ability to handle unpredictable volumes  Extensive experience in test distribution Copyright © 2013 CTB/McGraw-Hill LLC. 19

Test Distribution Examples  CTB annually serves pickup locations nationally.  CTB Transportation overall business in High secure programs around the country example below: –Georgia CRT- 175 sites delivery and pick up at 26,000 boxes with zero missing –Indiana ISTEP- 600 sites delivery and pick up over 15,000 with zero missing –Missouri MAP- 550 sites delivery and pick up over 16,000 boxes with zero missing Copyright © 2013 CTB/McGraw-Hill LLC. 20

Training  Develop a training plan with State  Pre-assessment training for CBT and PBT –Live webinars and on-site training –Recorded webinars –Manuals for proctors and administrators  Logistics –Shipping –Data exchange for State Copyright © 2013 CTB/McGraw-Hill LLC. 21

Recap  CTB/McGraw-Hill Company Overview  Solution Overview: Test Assessing Secondary Completion (TASC)  TASC Test Design and Validation –Content –Research  Operational Implementation of TASC  Questions and Answers Copyright © 2013 CTB/McGraw-Hill LLC. 22

Questions and Answers Copyright © 2013 CTB/McGraw-Hill LLC. 23

Contact info  Mike Johnson National Adult Education Manager  Copyright © 2013 CTB/McGraw-Hill LLC. 24