1. What is a CAT?
What is a CAT?

2. Introduction
Introduction

3. What is a CAT?
Students in your state will be taking the English Language Arts/literacy (ELA) and mathematics online assessments based on the Common Core State Standards.

4. COMPUTER ADAPTIVE TEST
What is a CAT?
COMPUTER ADAPTIVE TEST +
performance task
The ELA and mathematics online assessments include both a Computer Adaptive Test component and a performance task component.

5. COMPUTER ADAPTIVE TEST
What is a CAT?
COMPUTER ADAPTIVE TEST
Often referred to as C-A-T or a CAT
This Computer Adaptive Test is often referred to as C-A-T or a CAT.

6. The Computer Part of a CAT

7. What is a CAT?
COMPUTER
Two of the words used in “Computer Adaptive Test” are likely not new to you.

8. What is a CAT?
COMPUTER
More efficient and appropriate for students than a typical paper-and-pencil test
The word “COMPUTER” is important for a Computer Adaptive Test, because the computer makes this kind of test much more efficient and appropriate for students than a typical paper-and-pencil test.

9. What is a CAT?
COMPUTER
Allows students to have more engaging test questions from the real world
Using a computer allows students to have more engaging test questions from the real world.

10. What is a CAT? COMPUTER Items might include videos or audio,
PowerPoint slides, or
interactive test questions.
Items might include videos or audio, PowerPoint slides, or interactive test questions.

11. What is a CAT? COMPUTER allows students flexibility and accessibility
puts the student in control
gives access to helpful tools and resources
Computers also allow students more flexibility and accessibility during testing than taking paper-and-pencil tests. For example, when tests are delivered on computers, students may have the ability to control text size and audio volume. They may also have access to tools such as online calculators and glossaries.

12. What is a CAT? Can be found on you state’s assessment portal.
Usability, Accessibility, and
Accommodations Guidelines
Can be found on you state’s assessment portal.
* Contact your state education agency for information about state-specific implementation of the supports available for students.
For a full listing of the available universal tools, accommodations, and designated supports, please refer to the Usability, Accessibility, and Accommodations Guidelines found on your state’s assessment portal. Each student will have access to all universal tools, as well as many accommodations and designated supports that are usually given with other tests.

13. The Test Part of a CAT
The test part of a CAT

14. What is a CAT?
TEST
The online assessments are designed to assess how well a student has mastered the expectations of the Common Core State Standards in both English language arts/literacy or mathematics for his or her grade level.
The word, “TEST,” is certainly something you’re familiar with. The online assessments are designed to assess how well a student has mastered the expectations of the Common Core State Standards in both English language arts/literacy or mathematics for his or her grade level.

15. The Adaptive Part of a CAT

16. COMPUTER ADAPTIVE TEST
What is a CAT?
ADAPTIVE
COMPUTER ADAPTIVE TEST
The keyword in the phrase — COMPUTER ADAPTIVE TEST — is “ADAPTIVE”.

17. What is a CAT?
ADAPTIVE
In the adaptive portion of the online assessments, the questions (or items) are chosen for each student so that the test is neither too hard nor too easy. The first few questions will help determine a student’s difficulty level.
In the adaptive portion of the online assessments, the questions (often referred to as items) are chosen for each student so that the test is neither too hard nor too easy. The first few questions shown will be grade-level appropriate at a medium difficulty level. This will help the test determine a student’s difficulty level and adjust accordingly.

18. What is a CAT?
ADAPTIVE
While the CAT is adaptive, it operates from logical rules that can be inspected or examined, and that are known and published.
While the CAT is adaptive, it operates from logical rules that can be inspected or examined, and that are known and published.

19. COMPUTER ADAPTIVE TEST
What is a CAT?
COMPUTER ADAPTIVE TEST
Provides a unique and effective way to test what a student has learned
We have adapted our CAT to provide a unique and effective way to test what a student has learned.

20. COMPUTER ADAPTIVE TEST
What is a CAT?
COMPUTER ADAPTIVE TEST ? ? ? ? ? ? ?
ADAPTIVE is what makes the CAT different from other traditional tests by making the test unique for every student. The CAT assessments automatically adjust to fit the ability level demonstrated by a student. The computer looks at a student’s response to an item to see if it was answered correctly.

21. Copyright 2013 by Educational Testing Service. All rights reserved.
Then, along with the test’s blueprint requirements, the computer programming selects the next question. In this way, the computer ADAPTS as it gains information about the student and builds a custom-made test for each student as it moves along.
A student may or may not receive the same items as his or her friends. Each test is dynamically built to the ability level of the individual student.
In addition, the student’s score is intended to be more precise than a paper-and-pencil assessment could offer, since the assessment was tailored to the student’s ability.

22. How can a CAT do that?
How can a CAT do that?

23. What is a CAT? How can a CAT do that? Bank of Test Items
A Recommended Blueprint
Programming (or Algorithm)
Algorithm Constraints
HOW CAN A CAT DO THAT?
There are 4 CAT elements working simultaneously to make this happen:
1) Bank of Test Items
2) A Recommended Blueprint
3) Programming (or Algorithm) and
4) Algorithm Constraints

24. What is a CAT?
The first element is a large bank of field-tested items covering all areas the test is designed to assess. There are many items across all difficulty levels, including some that are more challenging and some that are less challenging. During the test, each item is selected based upon answers to previous items.

25. What is a CAT? ? ? ? ? ? ?
Smarter Balanced has created tens of thousands of items. These items are written and approved by many content experts and educators, including those who work with diverse student populations.

26. What is a CAT? ? ? ? ? ? ?
The items were field-tested, or tried out, by students. Following the Field Test administration, those items were reviewed again to make sure they worked as intended. The thousands of items that passed the reviews made it into the item bank. The CAT engine will select questions for the assessment from this approved bank of items.

27. How does it know which question to pick?
What is a CAT?
How does it know which question to pick?
"HOW DOES IT KNOW WHICH QUESTION TO PICK?" Well, the second element takes care of that.

28. What is a CAT? Test Blueprint
focuses the selection of questions from the test bank to the appropriate content so the structure of the test is similar for every student
selects the precise questions based on the individual student’s responses to previous questions in the test
The second element is the test blueprint.
The test blueprint is designed to focus on the selection of questions from the test bank and apply the appropriate content so the structure of the test is similar for every student.
For example, each student in grade three will receive a certain number of questions about multiplication and division. There are lots of multiplication and division questions in the item bank. The test blueprint selects the precise questions based on the individual student's responses to previous questions in the test.
This process allows questions to be administered in a logical way and keeps the student's experience controlled and appropriate for him or her.

29. What is a CAT? ELA, Item Code: 123456 Claim 1, Target 3
The third element is the programming language, or algorithms, that tell the computer how the test is to be administered.
Content and measurement experts for mathematics and ELA work together to give the computer programmers “guidelines” about how to select questions and what category of question to present. Then they create an algorithm—or a step-by-step approach—that tells the CAT what to do next based on each student’s answers provided and when to finish the test.

30. What is a CAT? Important Rules to make the test
Balance (Enough of the Concept?)
Question Type (Selected Response? Constructed Response?)
Reading Length (Short? Medium? Long?)
Difficulty (Appropriate for the Grade Level?)
The fourth element is the set of rules, or “constraints,” that need to be given to the algorithm.
Just as in paper-and-pencil tests, managing content, question types, reading passage length, and difficulty is extremely important in a CAT.
In the case of a CAT, experts construct tables of rules or constraints used by the algorithm to make sure that anything that must, or must not, occur in a particular test is controlled in the rules. The proper types of questions are presented, ensuring that the test adapts correctly to the student and his or her overall test experience.

31. How does a CAT work for the student?

32. What is a CAT? How will it work for me?
How will it work for the student?

33. How will it work for the student?
The test starts with an item from a pre-determined difficulty level. It may be based on average difficulty for the grade level being tested, or it may be based on information about the student from previous summative tests.
The test starts with an item from a pre-determined difficulty level. It is based on average difficulty for the grade level being tested, or it may be based on information known about the student from previous Smarter Balanced summative tests taken within the state. From here, the test can adjust up or down to match the student’s current individual level.

34. How will it work for the student?
Question Selection
The student receives questions based on his or her response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any student’s skills.
The student receives questions based on his or her response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any student’s skills.

35. How will it work for the student?
Questions will ADAPT
If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing.
If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing.

36. How will it work for the student?
Responses
Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.
Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.

37. How will it work for the student?
That's it!
A student’s score is based on the difficulty of the items that were right or wrong, not on the total number of correct answers.
Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.
A student’s score is based on the difficulty of the items that were right or wrong, not on the total number of correct answers.
Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.

38. CAT Review
CAT review

39. Let’s review the parts that make up a CAT —
CAT Defined
Introduction
Let’s review the parts that make up a CAT —
COMPUTER
ADAPTIVE
TEST
Computer
Adaptive
Test
Let’s review the parts that make up a CAT — Computer Adaptive Test.

40. The COMPUTER is important in CAT because
CAT Defined
The COMPUTER is important in CAT because
It makes the test more efficient and appropriate for every student;
It allows students more flexibility and accessibility during testing; and
It has the ability to include videos, audio, PowerPoint slides, and interactive test items.
Computer
Adaptive
Test
First is the “C” for COMPUTER. The COMPUTER is important in CAT because
It makes the test more efficient and appropriate for every student;
It allows students more flexibility and accessibility during testing; and
It has the ability to include videos, audio, PowerPoint slides, and interactive test items.

41. The ADAPTIVE part of the CAT makes the test unique for every student:
CAT Defined
The ADAPTIVE part of the CAT makes the test unique for every student:
It looks to see if the student response is correct.
It selects the next question to build a custom-made test for each student.
Computer
Adaptive
Test
Next is “A” for ADAPTIVE. The ADAPTIVE part of the CAT makes the test unique for every student:
It looks to see if the student response is correct
It selects the next question to build a custom-made test for each student.

42. English language arts/literacy (ELA) and mathematics.
CAT Defined
The online test is testing how well a student has mastered the expectations of the Common Core State Standards in
English language arts/literacy (ELA) and
mathematics.
The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the student’s proficiency.
Computer
Adaptive
Test
Last is “T” for Test. The online TEST is testing how well a student has mastered the expectations of the Common Core State Standards in
English language arts/literacy (ELA) and
mathematics.
The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the student’s proficiency.

43. Better Assessment Results

44. What is a CAT? How does a CAT provide better assessment results?
With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses.
“How does a CAT provide better assessment results?”
With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses. 

45. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a student’s actual knowledge and abilities.
It is ACCURATE. This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a student’s actual knowledge and abilities.

46. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Because the program knows which questions are harder and which are easier, the student will see items that are neither too easy nor too hard.
It is INDIVIDUALIZED. Because the program knows which questions are harder and which are easier, the student will see items that are neither too easy nor too hard.

47. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.
It is SECURE. Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.

48. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
It provides items in an order that best determines a student’s proficiency.
It is EFFICIENT. It provides items in an order that best determines a student’s proficiency.

49. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Many items are scored in real time by the computer. However, student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.
It delivers FAST RESULTS because many items are scored in real time by the computer. However, student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.

50. It delivers FAST RESULTS
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
The students’ testing experience will be their very own and will provide them with the chance to show what they know.
In summary: The students’ testing experience will be their very own and will provide them with the chance to show what they know.

51. What is a CAT?
Now you know!
Now you know more about the CAT.

52. For more information, please visit:
For more information, please visit your state’s assessment portal.