1. Reviewing, Revising and Writing Effective Social Studies Multiple-Choice Items 1 Writing and scoring test questions based on Ohio’s Academic Content Standards

2. Reviewing, Revising and Writing Effective Social Studies Multiple-Choice Items Learning Objective: To learn how to review, correct and write effective Social Studies multiple-choice items. 2 Writing and scoring test questions based on Ohio’s Academic Content Standards

3. Reviewing Social Studies Multiple-Choice Items Reviewing the Item 3 Writing and scoring test questions based on Ohio’s Academic Content Standards

4. Let’s review an item together and then I will hand out additional items that you can review in your groups. We will begin by reviewing a Grade 5 Social Studies item. 4 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

5. Standard: History Benchmark: Explain how new developments led to the growth of the United States. Indicator: Explain the importance of inventors such as the Wright Brothers, Charles Kettering, Garrett Morgan, Granville Woods and Thomas Edison. Key: B Who invented the traffic signal? A. Granville Woods B. Garrett Morgan C. Charles Kettering D. Thomas Edison 5 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

6. Let’s follow the list on your Multiple Choice Item Review Guidelines. Review Step 1: Is the item content correct, accurate, and realistic? 6 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

7. Review Step 2: Does the item match the standard, benchmark and indicator listed? 7 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

8. Review Step 3: Is the item fair and free from bias and sensitivity issues? 8 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

9. Review Step 4: Is the item written at or below the grade level of the students who will be taking the assessment? 9 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

10. Review Step 5: Does the item assess significant information? 10 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

11. Review Step 6: Is the item written in the passive voice? 11 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

12. Review Step 7: Is the item succinct, and does it contain only the needed information? 12 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

13. Reviewing the Stem 13 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Stems

14. Review Step 8: Does the item have a closed stem? 14 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Stems

15. Review Step 9: Does the item have a negative stem? 15 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Stems

16. Review Step 10: Does the item have a directed stem? 16 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Stems

17. Review Step 11: Does the stem contain unnecessary technical language? 17 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Stems

18. Reviewing the Options 18 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Options

19. Review Step 12: Are the options the same length or ordered according to length, alpha order, or in numeric order? 19 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Options

20. Review Step 13: Do the options avoid words such as “all” or “only”? 20 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Options

21. Review Step 14: Are the options grammatically parallel? 21 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Options

22. Review Step 15: Do the options avoid repeated information? 22 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Options

23. Reviewing the Key 23 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Keys

24. Review Step 16: Does the key answer the question posed in the prompt? 24 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Keys

25. Review Step 17: Is the key correct and the only correct option? 25 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Keys

26. Review Step 18: Does the key contain significant language from the prompt? 26 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Keys

27. Review Step 19: Is the key obvious because it is the only positively or negatively worded option? 27 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Keys

28. Reviewing the Distractors 28 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Distractors

29. Review Step 20: Are the distractors plausible but incorrect? 29 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Distractors

30. Review Step 21: Do the distractors present logical misunderstandings or misconceptions? 30 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Distractors

31. Review Step 22: Do the distractors contain opposing statements? 31 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Distractors

32. Review Step 23: Do the distractors avoid using the words “all of the above” or none of the above”? 32 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Distractors

33. As a result of our review, we now know that this item has several flaws. 33 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

34. ACTIVITY 7 Reviewing Items 34 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

35. 35 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items Turn to Activity 7 in your binder. In ACTIVITY 7, we will be reviewing Social Studies items in our small groups.

36. Please begin reviewing the items. Remember to go through all 23 steps to detect all the flaws in the items. 36 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

37. When you have finished your review, we will share each group’s review comments with its other groups. 37 Writing and scoring test questions based on Ohio’s Academic Content Standards Reviewing Social Studies Multiple-Choice Items

38. Let’s go back to the first item we reviewed together. If you remember, we listed the flaws on the flip chart. 38 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

39. Let’s fix the item together. Let’s look at each flaw we have listed on the flip chart and revise the item to eliminate the flaw. 39 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

40. ACTIVITY 8 Revising Items to Correct the Flaws 40 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

41. Go back to the items you reviewed in your groups. Now that you have determined the flaws in these items, work in your groups to correct them. Make sure that after you have corrected a flaw you check to see that you have not introduced any new flaws. If you need to check the accuracy of the content in your items, please feel free to use the computer to do an Internet search. 41 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

42. If you turn to Activity 8 in your binder, you will see blank item cards. Use these to rewrite the flawed items. 42 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

43. After we have finished this activity, each group will share its corrections with the other groups. 43 Writing and scoring test questions based on Ohio’s Academic Content Standards Revising Social Studies Multiple-Choice Items

44. Now let’s try writing our own item for the fifth grade. Let’s write a multiple-choice item for the following standard, benchmark and indicator. Standard: Government Benchmark: Give examples of documents that specify the structure of state and national governments in the United States and explain how these documents foster self-government in a democracy. Indicator: Explain the significance of the Declaration of Independence and the U.S. Constitution. 44 Writing and scoring test questions based on Ohio’s Academic Content Standards Writing Effective Social Studies Multiple-Choice Items

45. Can someone suggest a prompt? Let’s review the prompt and make sure it meets all our guidelines. Can someone suggest a key? Again, let’s review the key. Can someone suggest distractors? And let’s review them. 45 Writing and scoring test questions based on Ohio’s Academic Content Standards Writing Effective Social Studies Multiple-Choice Items

46. ACTIVITY 9 Writing Effective Multiple-Choice Items 46 Writing and scoring test questions based on Ohio’s Academic Content Standards Writing Effective Social Studies Multiple-Choice Items

47. Now we are going to write our own items. Please write a multiple-choice item to the standards, benchmarks and indicators listed in Activity 9 in your binder. 47 Writing and scoring test questions based on Ohio’s Academic Content Standards Writing Effective Social Studies Multiple-Choice Items

48. After you have completed this activity, we will share your group’s items with the other groups. The other groups will act as the reviewers of your group’s items and comment on them using the 23 guidelines we have been using. 48 Writing and scoring test questions based on Ohio’s Academic Content Standards Writing Effective Social Studies Multiple-Choice Items

49. Reviewing, Revising and Writing Effective Social Studies Multiple-Choice Items We hope you have enjoyed the day and that you are now more confident that you can write effective multiple-choice items for your classroom tests. 49 Writing and scoring test questions based on Ohio’s Academic Content Standards