Office of Accountability Research, Evaluation & Assessment SCHOOL ASSESSMENT COORDINATOR (SAC) TRAINING September 14, 2015 Cognitive Ability Testing – CogAT7 October 13 – 29 and November 9 – 12 & 16 – 17, 2015 RIVERSIDE PUBLISHING HOUGHTON MIFFLIN HARCOURT

Office of Accountability Research, Evaluation & Assessment 2 CogAT Sections: 8 Introduction and Test Overview Important Dates Roles and Responsibilities – SAC Test Security and Policies Test Administration Test Materials Contact Information 9 Sample for Applying the Student Label 7 7 Returning Kindergarten Materials

Office of Accountability Research, Evaluation & Assessment 3 9/24/15 - Barcode file to Riverside 10/6/15 - Student barcode labels received 10/13 – 10/29/15 - CogAT7 online test window (grades 1-5) 11/9 – 11/12/15 - CogAT7 Screening Kdg paper/pencil test window 11/16 – 11/17/15 - CogAT7 Screening Kdg (Make-up) 11/18 /15 – SMART Delivery picks up test materials 1 Important Dates

Office of Accountability Research, Evaluation & Assessment Introduction and Test Overview 4 2 Form 7 of the Cognitive Abilities Test (CogAT) evaluates the level and pattern of verbal, quantitative, and spatial (nonverbal) reasoning abilities for students from kindergarten through grade 12. These abilities reflect the overall efficiency of cognitive processes and strategies that enable individuals to learn new tasks and solve problems. CogAT7 has three batteries – Verbal, Quantitative, and Nonverbal. Within each battery contains three subtests. The abilities evaluated are those that enable students to acquire, organize, store in memory, and recall information; to make inferences; to detect relationships; to comprehend and analyze problem situations; to form concepts; to discover and remember sequences; to recognize patterns; to classify or categorize objects, events, and concepts; to infer rules and principles; and to relate and use previous experience to accomplish new learning tasks or solve novel problems.

Office of Accountability Research, Evaluation & Assessment 5 Test Security and Policies Requirements for Proctors Non-Disclosure Agreement Test Security and Training Proctors Requirements for Administering the CogAT7 Online Instructions for DataManager e-Learning for CogAT7 Test Administration Report (TAR) 3

Office of Accountability Research, Evaluation & Assessment 6 Requirements for Proctors Proctoring the Kindergarten Test – Proctors must review the Level 5/6 administration manual before testing students. Proctoring Grades 1 through 5 Tests – Proctors are required to view three DataManager e-Learning pre-recorded sessions: 1.Creating Testing Sessions – See handout for specific instructions 2.Proctoring Proctor - Led Sessions – See handout for specific instructions 3.Student Login – See handout for specific instructions  Documentation for completing all three sessions is required.

Office of Accountability Research, Evaluation & Assessment 7 Non-Disclosure Agreement Nondisclosure Agreement – Everyone with access to DataManager must complete the Nondisclosure Agreement. – Everyone with access to test items must sign the Nondisclosure Agreement. – Anyone who may come in content with or see test items, can be asked by a student about an item or handle test materials must sign a Nondisclosure Agreement.  A copy of the Nondisclosure Agreement is included in your packet.  The Nondisclosure Agreement is available on REA website:

Office of Accountability Research, Evaluation & Assessment 8 Test Security and Training Proctors School SAC Meeting You must – hold a training meeting for your proctors, – have them sign-in to prove they attended the meeting, – allow time for proctors to read and sign the non-disclosure agreement, – collect the non-disclosure agreements. Topics to Cover during your Training Session Proctors must read the directions and questions exactly as written in the administration manual. Proctors must be impartial observers during the test administration. Arrange the room so that the proctor can see the students’ screens; e.g., locate the test administrator’s computer in the back of room to enable the test administrator to see the students’ screens. Scratch paper must be collected from students before leaving the testing room. Place a “Testing – Do Not Disturb” sign on the door during testing. Arrange the room so that students will be separated from one another as much as the room allows. Check each student’s computer before testing to confirm the DataManager Log In page appears.

Office of Accountability Research, Evaluation & Assessment 9 Test Security and Training Proctors, cont. All Test Items are secure – Discussions of items are not allowed with students, parents and co-workers. – Test items and student tests are not allowed to be reviewed by teachers or building staff. – – Test items may not be reproduced in any form. – s or discussions in on-line social media are not allowed.

Office of Accountability Research, Evaluation & Assessment 10 Test Security and Training Proctors, cont. Materials Not Allowed During Testing All visual aids such as word walls, posters, graphics in the computer lab or where students will be testing must be covered or removed. – Cell phones, PDAs or translation devices may not be used. – Calculators and Dictionaries may not be used. Proctors are not permitted to drink and/or eat while testing students.

Office of Accountability Research, Evaluation & Assessment 11 Test Security and Training Proctors, cont. Paperwork to REA – Copy of Proctors Training Sign-in Sheet – Nondisclosure Agreement; one for every person having access to CogAT7 – Requirement for Administering the CogAT7 Online; one for every person administering to grades 1 through 5 – Copy of Test Administration Report (TAR)  Send paperwork through district school mail to the REA Testing Office, 360 Colborne

Office of Accountability Research, Evaluation & Assessment 12 Requirements for Administering the CogAT7 Online Requirements for Administering the CogAT7 Online form – Riverside DataManager e-Learning – Must complete three sessions – Must be completed and document returned to your SAC  A copy of the Requirements for Administering the CogAT7 Online form is included in your packet.  The Requirements for Administering the CogAT7 Online form is available on REA website:

Office of Accountability Research, Evaluation & Assessment 13 Instructions for DataManager e-Learning for CogAT7 Instructions for DataManager e-Learning – Requirement for Proctors – Volume required on computer or headphones – Complete either at school or home – Must be completed before accessing CogAT7 materials  A copy of the Instructions for DataManager e-Learning for CogAT7 is included in your packet.  The Instructions for DataManager e-Learning for CogAT7 is available on REA website:

Office of Accountability Research, Evaluation & Assessment 14 Test Administration Report (TAR) – Unusual or unexpected occurrence during testing – Student becomes upset – Student is administered the incorrect test level – Student refuses to take or complete the test – Interaction with a parent – Student is disruptive  A copy of the TAR is included in your packet.  The TAR is available on REA website:

Office of Accountability Research, Evaluation & Assessment 15 Roles and Responsibilities – SAC Paper Pencil Test for Kindergarten Inventory test materials immediately upon receipt Consolidates and requests additional materials needed for testing Request additional materials from Dr. Green Creates testing schedules Assures all students have a number 2 pencil with an eraser and a few extra on hand Assures each student has a test booklet and place marker Assures that student barcode labels are attached to test booklets correctly or student data is properly bubbled in on the back cover of the test booklet if label is not provided Distributes test booklets, administration manual and place markers One pair of scissors An 8.5 x 8.5 piece of paper for the proctor. Paper sample provided in your packet. All test materials are to be kept secure and confidential at all times 4

Office of Accountability Research, Evaluation & Assessment 16 Roles and Responsibilities – SAC, cont. Online Test for Grades 1 – 5 Assures students have a number 2 pencil and scratch paper Schedules and creates online test sessions Verifies all proctors have completed the required DataManager e-Learning sessions

Office of Accountability Research, Evaluation & Assessment 17 Test Administration Specific Grade Test Requirements Test Level and Mode Untimed Paper Tests – Kindergarten Timed On-line Tests – Grades 1-5 5

Office of Accountability Research, Evaluation & Assessment Specific Grade Test Requirements 18 Kindergarten - All Kindergarten students Grades 1, 3, 4 and 5 - Nominated students that have not been previously identified Grade 2 - Students that have not been previously identified

Office of Accountability Research, Evaluation & Assessment 19 Test Level and Mode Grade Test Level Mode KindergartenLevel 5/6Paper/Pencil 1Level 7Online 2Level 8Online 3Level 9Online 4Level 10Online 5Level 11Online  Proctors use their computer clock/timer to administer test levels 7 through 11.

Office of Accountability Research, Evaluation & Assessment 20 Untimed Paper Tests – Kindergarten TaskEstimated Completion Time (minutes) Levels 5/6 Subtest 1: Picture/Verbal Analogies Administer Practice Activities (optional)20 Distribute testing materials 5-7 Review directions and sample items5 Administer subtest15 Subtest 2: Number Analogies Administer Practice Activities (optional)20 Distribute testing materials 5-7 Review directions and sample items5 Administer subtest15 Subtest 3: Figure Matrices Administer Practice Activities (optional)20 Distribute testing materials 5-7 Review directions and sample items5 Administer subtest10  Level 5/6 is untimed  Only one subtest can be administered per day

Office of Accountability Research, Evaluation & Assessment 21 Timed On-line Test – Grades 1 & 2 TaskEstimated Completion Time (minutes) Levels 7 – 8 Complete the Getting Started tutorial5 Subtest 1: Picture/Verbal Analogies Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10 Subtest 2: Number Analogies Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10 Subtest 3: Figure Matrices Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10  Levels 7 and 8 are:  Timed  Proctor Led  Read aloud to students  The ten-minute time limit must be strictly enforced.  Test administration times cannot be adjusted.  Only one subtest can be administered at a time.

Office of Accountability Research, Evaluation & Assessment 22 Timed On-line Test – Grades TaskEstimated Completion Time (minutes) Levels 9 – 11 Complete the Getting Started tutorial5 Subtest 1: Picture/Verbal Analogies Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10 Subtest 2: Number Analogies Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10 Subtest 3: Figure Matrices Administration Practice Activities (optional)15 Log students in to DataManager5 Review directions and sample items5 Administer subtest10  Levels 9 through 11 are timed tests.  Begin Proctor Led, then students work independently.  The ten-minute time limit must be strictly enforced.  Test administration times cannot be adjusted.  Only one subtest can be administered at a time.

Office of Accountability Research, Evaluation & Assessment 23 Test Materials Receipt of Test Materials Testing Materials Inventory Form Additional Materials Request Form Barcode Labels for Kindergarten Supply List 6

Office of Accountability Research, Evaluation & Assessment 24 Receipt of Test Materials Kindergarten consumable test booklets, administration manuals, student and place markers will be distributed at the SAC training. School Packing List (white) - Use to inventory materials - Dr. Green if you are missing materials at Save your packing/inventory list.  Save your boxes for returning test booklets for scoring.

Office of Accountability Research, Evaluation & Assessment 25 Testing Materials Return Form – Complete the Testing Materials Return Form and place in box “1” – Keep a copy for yourself – Place the original Packing/Inventory Form from Riverside in box “1” – Keep a copy for yourself  The Testing Materials Return Form is included in your packet.  The Testing Materials Return Form is available on REA website:

Office of Accountability Research, Evaluation & Assessment 26 Request for Additional Testing Materials Additional Testing Materials – Additional testing materials are available for Level 5/6 only – Complete the Additional Testing Materials Form and to Dr. Green at  A copy of the Request for Additional Testing Materials is included in your packet.  The Request for Additional Testing Materials is available on REA website:

Office of Accountability Research, Evaluation & Assessment 27 Barcode Labels for Kindergarten Proctors must verify Pre-Id information prior to applying the labels to the test booklets. If the label is correct, place the label on the box on the back cover of the test booklet in the designated area. If the label is incorrect, securely dispose of the label and hand bubble the student information on the test booklet. If the label is incorrect or applied to a test book by error, mark an “X” on the front and back cover of the test booklet. - Place these test booklets in the shipping box so they cannot be used.  See the last page of this document for applying the barcode correctly.

Office of Accountability Research, Evaluation & Assessment 28 Supply List The following items must be available when testing begins: Directions for Administration - Copy of the Directions for Administration booklet. Test Booklets - One Level 5/6 test booklet for each student plus a copy for yourself. Pencils - Each student must have a sharpened No. 2 pencil with a good eraser. Have some extra pencils on hand. Place Markers - One place marker for each student and an extra marker for yourself. Paper and Scissors - An 8.5 x 8.5 square piece of paper and scissors are needed for the Paper Folding subtest (Subtest 8). Paper sample provided in your packet. OPTIONAL: Projector - If a projector is available, you may wish to project the practice questions onto a screen during the test administration so you can point to specific parts of the practice questions as you explain what to do. Included in your packet.

Office of Accountability Research, Evaluation & Assessment 29 Returning Test Materials Prepare Test Booklets for Scanning Organize Test Booklets for Shipment 7

Office of Accountability Research, Evaluation & Assessment 30 Prepare Test Booklets for Scanning  Accounting for the test booklet of every student tested is essential. Ensure all test booklets can be scanned. Verify each document appears as follows: – completed in a No. 2 pencil – in good physical condition – not torn, creased, or damaged – barcode labels are positioned correctly  See the last page of this document for applying the barcode correctly. Level 5/6

Office of Accountability Research, Evaluation & Assessment 31 Organize Test Booklets for Shipment Organize test booklets to be scanned – Completed the Grade/Class ID Sheet. (Follow the instructions on that identification sheet.) – Completed the Building ID Sheet. (Follow the instructions on that identification sheet.) – Place the completed Grade/Class ID Sheet on top of the stack of test booklets. – Place the Building ID Sheet on top of the completed Grade/Class ID Sheet. – Pack the documents in their original shipping boxes. – Temporarily tape boxes closed. – Deliver boxes to your school office for SMART Delivery.  All testing materials will be pick up on Wednesday, November 18, 2015.

Office of Accountability Research, Evaluation & Assessment 32 Contact Information Questions regarding administering the CogAT7 please contact: Robin Lane Office: Cell: Research, Evaluation & Assessment – (REA) Questions regarding CogAT7 test materials, scheduling and reporting please contact: Office: Cell: Talent Development & Acceleration Services – (TDAS) 8 TBD

Office of Accountability Research, Evaluation & Assessment 27 Instructions for Applying Barcode Labels 9