1. OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

2. “To improve student achievement results, use data to focus on a few simple, specific goals.” Mike Schmoker Why analyze data?

3. Assessments: Classroom, School, District, State Compile Data Analysis, Interpretation and Dialogue Determine Aligned Resources Curriculum Design and Planning for New Learning and Re-Teaching Standards Classroom Implementation Standards Data Analysis Cycle Standards

4. Enhanced Class Score Report Page one is a welcome page. One item to note on this page is the web address for Ohio’s Instructional Management System (IMS): http://ims.ode.state.oh.us/ode/ims/ On this site you can access released test items, model lessons, research on social studies education and other resources.

5. See the bottom of page 1 for information on the SUCCESS web site. SUCCESS Web Site

6. Compare your class average with district and state averages. Ohio Achievement Test Results

7. Performance Levels View the percentage of students who achieved each performance level.

8. Standard Categories

14. On which standards were your students most successful? Least successful? On which standards does your class exceed the district or state average? Are those items clustered around a specific skill or content? On which standards does your class fall below the district or state average? Are those items clustered around a specific skill or content? Interpreting the Data

15. Consider the OAT data using three filters: What does this mean for Curriculum? Instruction? Assessment? Interpreting the Data

19. A.It demonstrated a need for a process for accepting territories into the union. B.Disputes between states could not be resolved without a national judiciary. C.It showed that farmers needed the right to vote in national elections. D.The lack of a national army showed the need for a stronger national government. Question 22, Grade 8 OAT in Social Studies, 2007 : Interpreting the Data 22. In what way did Shays’ Rebellion of 1786 lead to the formation of the United States Constitution?

20. Item 22 Commentary (edited): This multiple-choice question requires students to explain how Shays’ Rebellion helped lead to adoption of the United States Constitution. Option D is correct because Shays’ Rebellion exposed the need for a stronger national government. Under the Articles of Confederation the national government was very weak and the public began to question whether the government could handle the country’s problems without control over the economy or a national army. Shays’ Rebellion contributed to these concerns and citizens began to demand a change, leading to the 1787 Constitutional Convention. Interpreting the Data

21. Which benchmark is being assessed? How does this item test understanding of the benchmark? What is the cognitive level of this item? What can we learn from student performance on this item? Discussion Questions

22. How did your students fare with these items? Do they frequently write in the classroom? Are they expected to answer questions completely and to provide supporting details? Do they share examples of thorough responses? Constructed response items include both short answer and extended response. Though few in number, they have a significant impact on the total score. Constructed Response Items

23. Interpreting the Data

24. The British Parliament’s decision to tax the American colonists caused conflict between the colonies and Britain. Read the following quotations from a British newspaper and a Massachusetts colonist. “The Colonies were acquired with no other view than to be a convenience to us, and therefore it can never be imagined that we are to consult their interest.” —The London Chronicle, 1764 “If our trade be taxed, why not our lands, or produce... in short, everything we possess? They tax us without having legal representation.” —Samuel Adams, 1765 In your Answer Document, compare how these two authors differ in their opinions about taxing the colonies. (2 points) Interpreting the Data Question 21, Grade 8 OAT in Social Studies, 2007 :

25. Scoring Guidelines for Item 21 (Short Answer): Exemplar: The London Chronicle writer believes that the colonies should serve British interests and that there is no need to consult the colonists before taxing them or passing laws that affect them. Samuel Adams disagrees. He believes that the British do not have the right to tax the colonists because the colonists are not represented in Parliament. Other correct responses may include, but are not limited to: The British believe that they have the right to tax the colonists. The colonists believe that they must have representation in the British government before taxes are levied upon them. Interpreting the Data

26. Scoring Guidelines for Item 21 (Short Answer): Score Point Description 2 points: The response explains that Adams (or the colonists) and The London Chronicle writer (or the British) disagree over whether American interests need to be represented before Britain can tax the colonies. The response may imply the difference by accurately summarizing both views. 1 point: The response explains the point of view of EITHER the British OR the colonists regarding taxation. Interpreting the Data

27. Which benchmark is being assessed? How does this item test understanding of the benchmark? What is the cognitive level of this item? What can we learn from student performance on this item? Discussion Questions

28. Interpreting the Data

29. 40. One way United States citizens can participate in government is by voting. The right to participate in government through voting originated in which ancient civilization? A. Rome B. Egypt C. Greece D. Babylon Interpreting the Data Question 40, Grade 8 OAT in Social Studies, 2007 :

30. Interpreting the Data Item 4 Commentary (edited): This multiple-choice question requires students to show understanding of the historical origins of rights U.S. citizens have today by identifying which ancient civilization first developed a voting system. Option C, Greece, is correct because the ancient Greeks established the first known democracy, which allowed citizens to vote on all laws. Many governments today, including the United States, include the right to vote for all citizens, which can be traced to the ancient Greeks.

31. Which benchmark is being assessed? How does this item test understanding of the benchmark? What is the cognitive level of this item? What can we learn from student performance on this item? Discussion Questions

32. What would you suggest to the teacher of this class? Review alignment of lesson plans and assessments with the knowledge and skills outlined in the standards. Work with 6-8 teachers to plan together. Start by looking at how each grade contributes to understanding of the benchmarks. How can we make connections between grade levels? Review classroom resources and materials and identify gaps. Talk to the Media Specialist about supplemental texts, Web resources, or audio/visual materials. Review classroom assessments to ensure that they push students to explain their answers and make connections between ideas. Next Steps

33. “If we are not going to try to improve what we do, there is little sense in assessing it.” William Glasser

34. Resources Mertler, Craig A. Interpreting Standardized Test Scores, Strategies for Data-Driven Instructional Decision Making. Sage Publications, Inc. Thousand Oaks, 2007. Interpreting the Data