K-PREP END-OF-COURSE QUALITY CORE PRESENTED BY: KATHY MOORE AND PAM POWERS KDE:OAA: KM&PP: 10/12/2015 1

NEW PLATFORM - SAME ASSESSMENT ACT purchased an online platform to replace the Vantage system. Ordering, rostering, and student testing experience will be different. The assessment is the same. Two separate EOC sessions Multiple Choice 1 (Paper or Computer) Multiple Choice 2 (Paper or Computer) School staff may choose to utilize both paper/pencil and CBT at the same site. Students must complete both sections using the same mode (paper or CBT) Sessions are 45 minutes each KDE:OAA: KM&PP: 10/12/ Both

MONITORING TESTING TIMES Paper/pencil and Computer-based sessions must be timed by the test administrators. There is not built in timer for Computer-based testing. This is a change for Computer-based testing. KDE:OAA: KM&PP: 10/12/ Both

GLOSSARY OF TERMS CBT-Computer Based Testing P/P- Paper/Pencil Pacific Metrics (aka Pac Met) – ACT’s new QualityCore national online system (replaces Vantage) DTC-National role = Kentucky role – DAC STC-National role = Kentucky role – BAC TA –National role = Kentucky role – person substituting for teacher during test administration Daily Access Code – 5 letter system generated code needed for student access to the online testing system (unique to each class, each day) A full listing can be found at: content/uploads/2015/08/New_Roles_and_Definitions.pdfhttp:// content/uploads/2015/08/New_Roles_and_Definitions.pdf KDE:OAA: KM&PP: 10/12/ Both

ROLES AND RESPONSIBILITIES KDE:OAA: KM&PP: 10/12/2015 5

DAC RESPONSIBILITIES Ensure all staff with the potential to be involved with testing have been trained on the Administration Code and/or Inclusion of Special Populations Assign/Edit BACs and Technology Coordinators Print and/reissue password for BACs and Technology Coordinators Set up school testing windows Work with Technology Coordinator to download secure browser Monitor daily administration reports KDE:OAA: KM&PP: 10/12/ Both

BAC RESPONSIBILITIES Register school for testing (one-time event) Assign teachers and test administrators Print and/reissue passwords for teachers and test administrators Review and edit rosters (teacher/class and student/class) Assign accommodations Download and print class rosters Print Avery labels (CBT) Reopen test sessions (CBT) Monitor reports KDE:OAA: KM&PP: 10/12/ Both

TECHNOLOGY COORDINATOR RESPONSIBILITIES Access Technology Resources Download secure browser (If the secure browser was loaded prior to September 15, it will need to be reloaded.) Communicate with DAC as needed KDE:OAA: KM&PP: 10/12/ CBT

TEACHER RESPONSIBILITIES COMPUTER-BASED TESTING View and print Daily Access Code View and/or print student rosters Reopen test sessions View reports PAPER/PENCIL TESTING View and/or print student rosters View reports KDE:OAA: KM&PP: 10/12/ Both

TEST ADMINISTRATOR RESPONSIBILITIES Know which classes are to be tested Will have access to and distribute Daily Access Code to students KDE:OAA: KM&PP: 10/12/ CBT

GETTING STARTED Review QualityCore Trainings conducted by Pacific Metrics and KDE Download and Review manuals Access the system KDE:OAA: KM&PP: 10/12/ Both

DAC RESPONSIBILITIES KDE:OAA: KM&PP: 10/12/ Both

ACCESS TO ONLINE SYSTEM DAC names are already in the system DACs received Username and Password from ACT on September 1 Note: As of the date of this presentation student information from Infinite Campus has not been loaded into the system. KDE is working with ACT for the initial upload which will be followed multiple updates during the year. KDE:OAA: KM&PP: 10/12/ Both

TESTING WINDOWS – DAC Two broad state windows Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. Within the 10-day window, schools choose one day per content area. Multiple content areas may be tested per day. For P/P testing, DACs will need to individually enter the chosen 10 day school window for each school in the system. For schools using CBT testing only, DACs may use the broad state windows. KDE:OAA: KM&PP: 10/12/ Both October 1 – December 18, 2015 January 4 – July 15, 2016

TESTING SESSIONS Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. The first computer based test must begin at the same time as the paper based test. School staff may choose to utilize both paper and CBT at the same site. Students must complete both sections using the same mode (paper or CBT) Note: A minute break is allowed between test sessions. KDE:OAA: KM&PP: 10/12/ Both

SETTING TEST WINDOWS Paper/Pencil Testing Setting large semester window forces the school to contact ACT to order materials. Set windows based on individual test schedule needed, not by large semester window. Set Individual Test Windows for Paper/Pencil Testing Must be established 30 days prior to first day of testing to receive pre-printed materials Accommodated materials Computer-Based Testing Set windows based on large semester window. School will create roster for testing within the semester window. Only contact ACT for accommodated paper/pencil materials. Set Semester Test Windows in system for Computer-Based Testing October 1 – December 18, 2015 January 4 – July 15, 2016 KDE:OAA: KM&PP: 10/12/ Both

SETTING TEST WINDOW(S) PER SCHOOL Test Coordinators Manual pp KDE:OAA: KM&PP: 10/12/

CREATING STC (BAC) OR SCHOOL ACCOUNTS DAC CREATES BAC ACCOUNT(S) BAC CREATES TEACHER ACCOUNTS KDE:OAA: KM&PP: 10/12/ Both

CREATE SCHOOL/BAC ACCOUNTS Test Coordinators Manual pp KDE:OAA: KM&PP: 10/12/

CREATE SCHOOL ACCOUNTS KDE:OAA: KM&PP: 10/12/

PRINT/ PASSWORD LETTERS KDE:OAA: KM&PP: 10/12/

RESET/REISSUE BAC PASSWORD KDE:OAA: KM&PP: 10/12/

CREATING TEACHER ACCOUNTS DAC CREATES BAC ACCOUNT(S) BAC CREATES TEACHER ACCOUNTS KDE:OAA: KM&PP: 10/12/ Both

CREATING TEACHER ACCOUNTS Manual Creation – Test Coordinators Manual pp CSV file upload – Test Coordinators Manual pg. 65 or wait for KDE upload KDE:OAA: KM&PP: 10/12/

ASSIGN A TEACHER TO A CLASS KDE:OAA: KM&PP: 10/12/

EDIT A TEACHER’S CLASS KDE:OAA: KM&PP: 10/12/ Both

EDUCATOR RESOURCES The QualityCore Educator Resources are included in the new platform and CIITS. Benchmark Assessments Course Descriptions and Syllabus Course Objectives Course Outline Test Blueprint Example Unit Formative Item Pool KDE:OAA: KM&PP: 10/12/ Both

CREATING STUDENT ROSTERS ORDERING MATERIALS KDE:OAA: KM&PP: 10/12/ Both

LOADING STUDENT INFORMATION Student information will have to be loaded by school until KDE notifies districts regarding the state student upload. The state upload is currently in development and will be completed as soon as possible. KDE will then extract multiple times from Infinite Campus (IC) throughout the year to update students enrolled at the high school level within each district. Please keep student records updated in IC. Note: Middle school students taking courses for high school credit will not be included. KDE:OAA: KM&PP: 10/12/ Both

STUDENT ROSTER UPLOAD BY SCHOOL Function available to add multiple student records to roster(s) via upload. Detailed instructions are posted to the ACT QualityCore website. ( Ad Hoc currently in Infinite Campus for each course to create the CSV file needed for upload into the QualityCore system. EOC Bulk Roster Registration Algebra II EOC Bulk Roster Registration Biology EOC Bulk Roster Registration English II EOC Bulk Roster Registration U. S. History KDE:OAA: KM&PP: 10/12/ Both

KDE STATE COURSE CODES KDE:OAA: KM&PP: 10/12/ ENGLISH II English Pre-IB English AP Language and Composition ALGEBRA II Algebra 2 U.S. History U.S. History Survey United States History, Reconstruction to the Present AP American History Advanced US History (newly added) BIOLOGY Life Science/Biology Biology II Honors Biology Biochemistry –Botany Microbiology Ecology –Medical Science IB Environmental Systems Pre-IB Biology IB Biology IB Biology AP Biology AgriBiology Intro Biology with Earth/Space Science Astrobiology Conceptual Progression Science III Integrated Science I Integrated Science II Integrated Science III Both

ROSTERS Rosters are created by either the District Student Upload CSV file or the KDE student/teacher upload. For those who need to test before the KDE/ACT file upload with student and teacher information, please do the following Teachers must be created and associated with a class. Students must be associated with a teacher during creation of the student account. The above two steps may be accomplished at one time by following the directions for a Student Upload. Accommodated materials are ordered by including the information in each student profile. KDE:OAA: KM&PP: 10/12/ Both

ADD A NEW STUDENT TO A ROSTER KDE:OAA: KM&PP: 10/12/

ASSIGNING ACCOMMODATIONS To verify that all accommodations have been assigned in the system, view the available accommodations reports. Once entered in the ACT QualityCore online system, accommodation information is automatically sent to ACT for order fulfillment of the associated materials 30 days prior to administration. KDE:OAA: KM&PP: 10/12/

ACCOMMODATED MATERIALS Accommodated materials can be ordered in the online system at the same time as P/P materials or by contacting ACT QualityCore Support at Accommodated materials must be ordered at least 4 weeks in advanced of testing date. BACs need to ensure that Block L (Special Codes) of the student answer document is properly bubbled with the appropriate accommodation. Special Codes can be found on page 17 of the Administration Manual. KDE:OAA: KM&PP: 10/12/ Both

RECEIVING/STORING MATERIALS KDE:OAA: KM&PP: 10/12/ P/P

RECEIVING/STORING MATERIALS Shipments will be to the district—specific information will shared through when available Verify the material received matches the Packing List Check shipment contents Testing Boxes Test Booklets with answer document (reference sheets) Reference Sheets- Alg 2 only Administration Manual, Teacher Manual School Header—in Administration Manual Group Header- One per roster KDE:OAA: KM&PP: 10/12/ Materials are to be securely stored at all time when not in use. Discrepancies— Call (866) P/P

RECEIVING/STORING MATERIALS CONTINUED Tracking Log useful for distribution to teachers Form found in Administration Manual and Test Administration Manual KEEP original boxes for return shipping. KDE:OAA: KM&PP: 10/12/ P/P

COMBINED MC TEST BOOKLETS AND ANSWER DOCUMENTS Student answer document with pre-printed student information is located inside the test booklet. Cover of test booklet contains pre-printed roster and student information. Booklets are packed by roster for easy distribution on test day. KDE:OAA: KM&PP: 10/12/ P/P

Bubble student information in boxes A-G, I and J. 40 P/P

ANSWER DOCUMENT W/O PRE-PRINTED STUDENT INFO Student On Roster: If student is on the roster, the Test Coordinator must retrieve the student’s QualityCore ID from the system. Click Teacher Management Tab, View Rosters, appropriate roster, and select print roster to view the QualityCore ID. Grid student information on the answer document including the QualityCore ID in box D. Student Not On Roster: Add student to roster. A QualityCore ID will be generated. Click Teacher Management Tab, View Rosters, appropriate roster, and select print roster to view the QualityCore ID. Grid student information on the answer document including the QualityCore ID in box D. KDE:OAA: KM&PP: 10/12/ P/P

ADMINISTERING THE EOC ASSESSMENT KDE:OAA: KM&PP: 10/12/ Both

TEST DAY ACTIONS Teacher Manual includes scripts for both paper/pencil and computer-based testing. Teacher Manual Scripts begin on page 12. KDE:OAA: KM&PP: 10/12/ Both

ACCEPTABLE MATERIALS COMPUTER Scratch Paper-Please collect and destroy securely. Calculators Reference Sheets (Algebra II) PENCIL/PAPER Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) 44 KDE:OAA: KM&PP: 10/12/2015 Both

PROHIBITED MATERIALS COMPUTER Notes Foreign language or English dictionary Personal alarms on devices such as cell phones and watches PENCIL/PAPER Scratch paper Notes Foreign language or English dictionary Personal alarms on devices such as cell phones and watches 45 KDE:OAA: KM&PP: 10/12/2015 Both

IRREGULARITIES A disturbance or distraction occurs that could affect one or more students’ scores. A student becomes ill and discontinues testing. A student questions or challenges a test item. A student uses unauthorized testing aids. Complete a Testing Irregularity Report Forms found in Administration Manual Keep copy for own records Return original to ACT placed behind the School Header Sheet KDE:OAA: KM&PP: 10/12/ Both

STUDENT OATH The Student Oath is similar to Kentucky’s K-PREP Student Honor Code. Students using Computer-based testing must agree to the oath before the system will allow them to access the test. KDE:OAA: KM&PP: 10/12/ Both

NEW KDE CALCULATOR POLICY Follow ACT’s calculator policy for all ACT assessments. Calculator information is also in the Administration Manual, Test Administration Manual and Test Coordinators Manual (pg. 4) KDE:OAA: KM&PP: 10/12/ Both

SEATING CHART KDE:OAA: KM&PP: 10/12/ Both

EXEMPTION TYPES Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. Extraordinary Circumstance (Other Exemption) choice has open field to enter information. For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE website. SDRR will be open for exemption applications in November and remain open throughout the school year. KDE:OAA: KM&PP: 10/12/ Both

EOC TEST POLICY The student will take the EOC assessment at the end of instruction. If student is enrolled in an EOC class and will not pass the class, then the student will not test until instruction is complete. The policy has not changed from last year. KDE:OAA: KM&PP: 10/12/ Both

TEST SECURITY The Kentucky Department of Education (KDE) along with the testing contractor will be doing analysis of student responses and data to determine if possible inappropriate practices have occurred. All instances of impropriety should be reported Student Testing staff Complete ACT Security Agreement Form found in each manual Keep copy for own records Fax to ACT KDE:OAA: KM&PP: 10/12/ Both

SHIPPING/RETURNING MATERIALS KDE:OAA: KM&PP: 10/12/ P/P

RETURN SHIPPING Packing Envelopes Used Answer Documents Testing Irregularity Report Instructions can be found in Administration Manual Boxes Pre-addressed shipping labels for scorable and nonscorable Instructions and graphics can be found in the Administration Manual. KDE:OAA: KM&PP: 10/12/ KDE and ACT recommend return shipping from the school. P/P

RETURN SHIPPING REGULAR VS. ACCOMMODATED MATERIALS Materials must be returned within two days after testing is completed. Two different return addresses. Regular materials: Manuals (used and unused) Test Booklets (used and unused) Reference Sheets Completed Test Booklet Tracking Log All completed scannable answer documents Accommodated materials Large-print Test Booklets (used and unused) Large-print Reference Sheets (used and unused) Audio CDs Reader Scripts (used and unused) Braille Test Booklets and Reference Sheets Completed Test Booklet Tracking Log KDE:OAA: KM&PP: 10/12/ QualityCore Processing Center 50 Education Way Dover, NH ACT Services McCarrel Center 2727 Scot Blvd. P.O. Box 4059 Iowa City, IA P/P

GROUP HEADERS One per roster created online If pre-printed: Verify teacher’s name gridded in Block B matches name on Teacher Roster. Verify the course gridded in Block C is correct. Enter the class period in Block D. If not pre-printed: Grid Block B with teacher name exactly as it appears on Teacher Roster screen. Fill in circle Block C next to course and Block D for class period Complete the rest of the sheet according to printed directions. KDE:OAA: KM&PP: 10/12/ P/P

RETURN SHIPPING: GROUP HEADERS KDE:OAA: KM&PP: 10/12/ Group Header 1 Roster 1 Roster 2 Group Header 2 P/P

REPORTS KDE:OAA: KM&PP: 10/12/ Both

REPORTS FROM NEW SYSTEM P/P student results will be available in the online system in 5 days after receipt of materials by ACT. CBT—currently student results will be available in the online system in 5 days. KDE is working with ACT to improve the delivery time of the CBT results. KDE:OAA: KM&PP: 10/12/ Both

REPORTS FROM VANTAGE Student reports from previous administrations are available from ACT. District Assessment Coordinators and School Test Coordinators can request EOC reports from the old Vantage system. Contact ACT QualityCore Support by phone ( ) or by e- mail at to request The customer support team will send a secure URL where the reports can be downloaded. A password will be sent to decompress the files. KDE:OAA: KM&PP: 10/12/ Both

QUESTIONS (502) KDE:OAA: KM&PP: 10/12/ Both