1. ACT Aspire ® Summative Data Interpretation Workshop for Administrators

2. Holly Fisackerly Principal Consultant Learning Management Team Phone: 319.333.9521 holly.fisackerly@act.org

3. Workshop Materials

4. Overarching Learning Goal Build a communication/action plan throughout the session. 1.Target audiences 2.Content to share –Details –Messages –Observations/Insights 3.Available resources

5. Workshop Objectives Assessment Literacy –Review the role of assessment in learning –Review test specifications and readiness benchmarks Data Interpretation –Locate key data components from ACT Aspire ® reports –Identify implications for curriculum, instruction, and intervention through data analysis Insights and Planning

6. Assessment Literacy ACT Aspire

7. Table Talk Brainstorming with your group, list as many uses of assessments that you can in the given time. Mark each with a (+) for positive uses or a (-) for negative uses.

8. Role of Assessment in Learning Summative: Assessments OF learning –Evidence of learning at a particular point in time –Valuable at conclusion of a segment of learning (e.g., unit, semester, year, course) Formative: Assessments FOR learning –Evidence of learning in progress to inform instruction and provide feedback –Valuable during a segment of learning

9. Think-Pair-Share Where do ACT Aspire Summative Assessments fit into the big picture of assessment in your school system?

10. Reflection and Action

11. ACT Aspire Item Types A pattern exists among the units digits of the powers of 7, as shown below. What is the units digit of 7 50 ? 7 0 =17 3 = 3437 6 =117,649 7 1 =77 4 =2,4017 7 =823,543 7 2 = 497 5 = 16,8077 8 = 5,764,801 (Note: The units digit of 2,401 is 1.) A.1 B.3 C.4 D.7 E.9 A pattern exists among the units digits of the powers of 7, as shown below. What is the units digit of 7 50 ? 7 0 =17 3 = 3437 6 =117,649 7 1 =77 4 =2,4017 7 =823,543 7 2 = 497 5 = 16,8077 8 = 5,764,801 (Note: The units digit of 2,401 is 1.) A.1 B.3 C.4 D.7 E.9 Source: ACT Aspire Grade 5 Mathematics Exemplar Item Liam is making chocolate chip cookies. The recipe calls for 1 cup of sugar for every 3 cups of flour. Liam has only 2 cups of flour. How much sugar should Liam use? Explain why your answer is correct. Liam is making chocolate chip cookies. The recipe calls for 1 cup of sugar for every 3 cups of flour. Liam has only 2 cups of flour. How much sugar should Liam use? Explain why your answer is correct. Source: ACT Aspire Grade 5 Mathematics Exemplar Item Multiple-Choice Technology- Enhanced Constructed-Response Mario and Jenna each drew a circle. Mario divided his circle in half. Jenna divided her circle into twice as many equal sections as Mario’s circle. Select the word below that names the fraction Jenna divided her circle into, and select all of the figures below that could represent Jenna’s circle. Mario and Jenna each drew a circle. Mario divided his circle in half. Jenna divided her circle into twice as many equal sections as Mario’s circle. Select the word below that names the fraction Jenna divided her circle into, and select all of the figures below that could represent Jenna’s circle. Source: ACT Aspire Grade 3-6 Mathematics Exemplar Item For paper administration, technology-enhanced items are replaced with additional multiple- choice items.

12. ACT Aspire: Reading Time Reporting Categories Item Types Passage Types Text Complexity Webb’s Depth of Knowledge (DOK) Levels Summative Overview Summative Overview

13. Reading: Items by Passage Type Passage Type Grades 3–5Grade 6–EHS Items Literary Narrative10–117 Informational: Social Science5–67 Informational: Natural Science5–67 Total20–2221

14. Reading: Text Complexity of Passages Text Complexity Grade Level 345678EHS Basic 321 Straightforward 12211 Somewhat challenging 12221 More challenging 11 Complex 1

15. Webb’s Depth of Knowledge Levels Level 1: Level 2: Level 3: Level 4: Recall Skill/Concept Strategic Thinking Extended Thinking 14 – 24% 38–62%

16. ACT Aspire: Mathematics Time Item Types Reporting Categories –Content Domains –Other Categories Webb’s Depth of Knowledge (DOK) Summative Overview Summative Overview

17. Mathematics: Reporting Categories Grades 3–5Grades 6–7Grade 8EHS Grade-Level Progress Foundation Modeling Justification and Explanation Numbers & Operations—Fractions Numbers & Operations in Base 10 Operations & Algebraic Thinking Geometry Measurement & Data The Number System Statistics & Probability Geometry Ratios & Proportional Relationships Expressions & Equations Number & Quantity Algebra Functions

18. Test Content Specifications and Flow Grade-Level Progress Modeling Justification and Explanation Foundation The ACT ®

19. Webb’s Depth of Knowledge Levels Level 1: Level 2: Level 3: Grade-Level Progress Level 1: 4 pts Level 2: 8 pts Level 3: 3 (+8) pts Foundation Level 2: 4 pts Level 3: 2 (+8) pts 21 (+16)=37 pts Recall 5 – 16% Skill/Concept 27–38% Strategic Thinking 51–62% Grades 3–5 Example MC/TE: 1 point each JE: 4 points each MC/TE: 1 point each JE: 4 points each

20. One-Minute Review Take one minute each to explain these two concepts to a partner. 1.Explain the Grade-Level Progress and Foundation reporting categories. 2.Explain why Foundation questions would have higher DOK levels.

21. College and Career Readiness ACT research has identified knowledge and skills that: colleges expect from incoming first-year students employers expect from employees entering the workforce The same level of academic achievement is needed for success in college or a meaningful career.

22. ACT Definition of College and Career Readiness College and Career Readiness is the level of preparation a student needs to be equipped to enroll and succeed—without remediation—in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.

23. ACT College Readiness Benchmarks TestCollege Course EnglishEnglish Composition18 MathCollege Algebra22 ReadingSocial Sciences22 ScienceBiology23 50% likelihood of achieving a B or higher 75% likelihood of achieving a C or higher in the corresponding credit-bearing college course

24. ACT Readiness Benchmarks Test 3rd4th5th6th7th8th Early HS 9th 10th English 413417419420421422 426428 18 Math 413416418420422425 428432 22 Reading 415417420421423424 425428 22 Science 418420422423425427 430432 23 Reporting Overview Reporting Overview

25. ACT Aspire Readiness Levels Reporting Overview Reporting Overview In the ACT Readiness Range Ready In the ACT Readiness Range Ready Below the ACT Readiness Range Close In Need of Support Below the ACT Readiness Range Close In Need of Support

26. One-Sentence Summary In one sentence, summarize what the ACT Readiness Benchmarks communicate about students’ college and career readiness.

27. Reflection and Action Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

28. Data Interpretation Interpreting and Using ACT Aspire Reports

29. Accessing ACT Aspire Reports www.actaspire.org “Test Coordinator” or “Administrator” access required to retrieve reports online.

30. Accessing ACT Aspire Reports Select Organization Select Summative Tests Select View Summative Reports Reporting Overview Reporting Overview

31. Downloadable vs. Online Reports Download Online Only Download Online Only …

32. Summative Reporting Overview Reporting Overview Reporting Overview

33. Report Types ReportISRGroupSchoolDistrict Current Progress Supplemental Scores Proficiency Summary Skill Proficiency *Subject Proficiency           

34. Data Interpretation Individual Student Reports

35. Accessing Individual Student Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Report 3 Report 4 4

36. Accessing Individual Student Reports Note you can access individual ISRs here.

37. Individual Student Report Current Progress Supplemental Score

38. Current Progress: Longitudinal Progress

39. Current Progress: Readiness Level

40. Current Progress: Predicted Path and Growth Growth information will be available on future summative score reports.

41. Current Progress: Skill Performance  X X

42. Additional Measures for Upper Grades Average ACT Aspire Composite Score Grades 8, 9, and 10 only English, reading, mathematics, and science Average ACT Aspire Composite Score Grades 8, 9, and 10 only English, reading, mathematics, and science Grades 9 and 10 Only Predicted Average ACT Composite Score Predicted Average ACT Subject Scores Grades 9 and 10 Only Predicted Average ACT Composite Score Predicted Average ACT Subject Scores

43. Supplemental Scores Report English Reading Writing English Reading Writing Math Science Math Science

44. Supplemental Scores: Progress with Text Complexity

45. Supplemental Scores: Progress toward Career Readiness (Grades 8 and EHS) English Reading Math Science English Reading Math Science

46. Rapid Response How have you used the ISR data so far?

47. Data Review: Individual Student Report Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

48. Break 15 Minutes Break 15 Minutes

49. Data Interpretation Group Reports

50. Accessing Dynamic Group Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Report 3 Report 4 4

51. Accessing Dynamic Group Reports 1 Select Students 1 Select Students 2 Or Filter 2 Or Filter 3 3

52. Proficiency Summary: Readiness Distribution

53. Student Proficiency Pathway

54. Growth Distribution Growth distribution information will be included on future summative score reports. Growth distribution information will be included on future summative score reports.

55. Skills Distribution

56. Data Review: Proficiency Summary Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

57. One Question What is one question teachers may have about the Proficiency Summary?

58. Sharing ACT Aspire Reports

59. Data Interpretation School/District Reports

60. Accessing District/School Reports

61. Current Progress One-year growth information will be available on future summative score reports

62. Rapid Response Make as many observations as you can about the data in three minutes. Locate the Current Progress report for one grade in your district or school.

63. Add a Question Write a question that each observation raises for you.

64. Subject Proficiency by School

65. Data Review: Current Progress Review the Current Progress reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Current Progress reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document.

66. Data Interpretation Skill and Subject Proficiency Reports

67. Accessing Skill and Subject Proficiency Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Group 3 Group 5 5 4 Report 4 Report

68. Skill Proficiency by Group

69. Skill Proficiency by Subject

70. Data Review: Skill/Subject Proficiency Review the Skill Proficiency reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Skill Proficiency reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document.

71. Data Exploration Time Return to any reports that needed more time Explore reports that sparked your interest Record your observations on the Insights and Planning document  Curriculum  Professional Development  Interventions

72. Action Planning Leading Improvement Using ACT Aspire

73. Assessment Literacy What insights did you develop about the role of ACT Aspire in your assessment program?

74. ACT Readiness Benchmarks What messages do you plan to share about how ACT Aspire scores connect to the idea of college and career readiness?

75. ACT Aspire Reports What are some major themes you observed across the reports you reviewed?

76. Check your email for a link to the evaluation. Please take a few minutes to complete it. © 2015 by ACT, Inc. All rights reserved.

77. Circle Reflection What is your biggest takeaway from today? What did you enjoy about today? How do you plan to use what you have learned? What is one of your next steps?

78. Check your email for a link to the evaluation. Please take a few minutes to complete it. Thank you for your time and all that you do for your students! © 2015 by ACT, Inc. All rights reserved.

79. Holly Fisackerly Principal Consultant Learning Management Team Phone: 319.333.9521 holly.fisackerly@act.org