ACT Aspire ® Summative Data Interpretation Workshop for Administrators

Holly Fisackerly Principal Consultant Learning Management Team Phone:

Workshop Materials

Overarching Learning Goal Build a communication/action plan throughout the session. 1.Target audiences 2.Content to share –Details –Messages –Observations/Insights 3.Available resources

Workshop Objectives Assessment Literacy –Review the role of assessment in learning –Review test specifications and readiness benchmarks Data Interpretation –Locate key data components from ACT Aspire ® reports –Identify implications for curriculum, instruction, and intervention through data analysis Insights and Planning

Assessment Literacy ACT Aspire

Table Talk Brainstorming with your group, list as many uses of assessments that you can in the given time. Mark each with a (+) for positive uses or a (-) for negative uses.

Role of Assessment in Learning Summative: Assessments OF learning –Evidence of learning at a particular point in time –Valuable at conclusion of a segment of learning (e.g., unit, semester, year, course) Formative: Assessments FOR learning –Evidence of learning in progress to inform instruction and provide feedback –Valuable during a segment of learning

Think-Pair-Share Where do ACT Aspire Summative Assessments fit into the big picture of assessment in your school system?

Reflection and Action

ACT Aspire Item Types A pattern exists among the units digits of the powers of 7, as shown below. What is the units digit of 7 50 ? 7 0 =17 3 = =117, =77 4 =2, =823, = = 16, = 5,764,801 (Note: The units digit of 2,401 is 1.) A.1 B.3 C.4 D.7 E.9 A pattern exists among the units digits of the powers of 7, as shown below. What is the units digit of 7 50 ? 7 0 =17 3 = =117, =77 4 =2, =823, = = 16, = 5,764,801 (Note: The units digit of 2,401 is 1.) A.1 B.3 C.4 D.7 E.9 Source: ACT Aspire Grade 5 Mathematics Exemplar Item Liam is making chocolate chip cookies. The recipe calls for 1 cup of sugar for every 3 cups of flour. Liam has only 2 cups of flour. How much sugar should Liam use? Explain why your answer is correct. Liam is making chocolate chip cookies. The recipe calls for 1 cup of sugar for every 3 cups of flour. Liam has only 2 cups of flour. How much sugar should Liam use? Explain why your answer is correct. Source: ACT Aspire Grade 5 Mathematics Exemplar Item Multiple-Choice Technology- Enhanced Constructed-Response Mario and Jenna each drew a circle. Mario divided his circle in half. Jenna divided her circle into twice as many equal sections as Mario’s circle. Select the word below that names the fraction Jenna divided her circle into, and select all of the figures below that could represent Jenna’s circle. Mario and Jenna each drew a circle. Mario divided his circle in half. Jenna divided her circle into twice as many equal sections as Mario’s circle. Select the word below that names the fraction Jenna divided her circle into, and select all of the figures below that could represent Jenna’s circle. Source: ACT Aspire Grade 3-6 Mathematics Exemplar Item For paper administration, technology-enhanced items are replaced with additional multiple- choice items.

ACT Aspire: Reading Time Reporting Categories Item Types Passage Types Text Complexity Webb’s Depth of Knowledge (DOK) Levels Summative Overview Summative Overview

Reading: Items by Passage Type Passage Type Grades 3–5Grade 6–EHS Items Literary Narrative10–117 Informational: Social Science5–67 Informational: Natural Science5–67 Total20–2221

Reading: Text Complexity of Passages Text Complexity Grade Level EHS Basic 321 Straightforward Somewhat challenging More challenging 11 Complex 1

Webb’s Depth of Knowledge Levels Level 1: Level 2: Level 3: Level 4: Recall Skill/Concept Strategic Thinking Extended Thinking 14 – 24% 38–62%

ACT Aspire: Mathematics Time Item Types Reporting Categories –Content Domains –Other Categories Webb’s Depth of Knowledge (DOK) Summative Overview Summative Overview

Mathematics: Reporting Categories Grades 3–5Grades 6–7Grade 8EHS Grade-Level Progress Foundation Modeling Justification and Explanation Numbers & Operations—Fractions Numbers & Operations in Base 10 Operations & Algebraic Thinking Geometry Measurement & Data The Number System Statistics & Probability Geometry Ratios & Proportional Relationships Expressions & Equations Number & Quantity Algebra Functions

Test Content Specifications and Flow Grade-Level Progress Modeling Justification and Explanation Foundation The ACT ®

Webb’s Depth of Knowledge Levels Level 1: Level 2: Level 3: Grade-Level Progress Level 1: 4 pts Level 2: 8 pts Level 3: 3 (+8) pts Foundation Level 2: 4 pts Level 3: 2 (+8) pts 21 (+16)=37 pts Recall 5 – 16% Skill/Concept 27–38% Strategic Thinking 51–62% Grades 3–5 Example MC/TE: 1 point each JE: 4 points each MC/TE: 1 point each JE: 4 points each

One-Minute Review Take one minute each to explain these two concepts to a partner. 1.Explain the Grade-Level Progress and Foundation reporting categories. 2.Explain why Foundation questions would have higher DOK levels.

College and Career Readiness ACT research has identified knowledge and skills that: colleges expect from incoming first-year students employers expect from employees entering the workforce The same level of academic achievement is needed for success in college or a meaningful career.

ACT Definition of College and Career Readiness College and Career Readiness is the level of preparation a student needs to be equipped to enroll and succeed—without remediation—in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.

ACT College Readiness Benchmarks TestCollege Course EnglishEnglish Composition18 MathCollege Algebra22 ReadingSocial Sciences22 ScienceBiology23 50% likelihood of achieving a B or higher 75% likelihood of achieving a C or higher in the corresponding credit-bearing college course

ACT Readiness Benchmarks Test 3rd4th5th6th7th8th Early HS 9th 10th English Math Reading Science Reporting Overview Reporting Overview

ACT Aspire Readiness Levels Reporting Overview Reporting Overview In the ACT Readiness Range Ready In the ACT Readiness Range Ready Below the ACT Readiness Range Close In Need of Support Below the ACT Readiness Range Close In Need of Support

One-Sentence Summary In one sentence, summarize what the ACT Readiness Benchmarks communicate about students’ college and career readiness.

Reflection and Action Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

Data Interpretation Interpreting and Using ACT Aspire Reports

Accessing ACT Aspire Reports “Test Coordinator” or “Administrator” access required to retrieve reports online.

Accessing ACT Aspire Reports Select Organization Select Summative Tests Select View Summative Reports Reporting Overview Reporting Overview

Downloadable vs. Online Reports Download Online Only Download Online Only …

Summative Reporting Overview Reporting Overview Reporting Overview

Report Types ReportISRGroupSchoolDistrict Current Progress Supplemental Scores Proficiency Summary Skill Proficiency *Subject Proficiency           

Data Interpretation Individual Student Reports

Accessing Individual Student Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Report 3 Report 4 4

Accessing Individual Student Reports Note you can access individual ISRs here.

Individual Student Report Current Progress Supplemental Score

Current Progress: Longitudinal Progress

Current Progress: Readiness Level

Current Progress: Predicted Path and Growth Growth information will be available on future summative score reports.

Current Progress: Skill Performance  X X

Additional Measures for Upper Grades Average ACT Aspire Composite Score Grades 8, 9, and 10 only English, reading, mathematics, and science Average ACT Aspire Composite Score Grades 8, 9, and 10 only English, reading, mathematics, and science Grades 9 and 10 Only Predicted Average ACT Composite Score Predicted Average ACT Subject Scores Grades 9 and 10 Only Predicted Average ACT Composite Score Predicted Average ACT Subject Scores

Supplemental Scores Report English Reading Writing English Reading Writing Math Science Math Science

Supplemental Scores: Progress with Text Complexity

Supplemental Scores: Progress toward Career Readiness (Grades 8 and EHS) English Reading Math Science English Reading Math Science

Rapid Response How have you used the ISR data so far?

Data Review: Individual Student Report Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

Break 15 Minutes Break 15 Minutes

Data Interpretation Group Reports

Accessing Dynamic Group Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Report 3 Report 4 4

Accessing Dynamic Group Reports 1 Select Students 1 Select Students 2 Or Filter 2 Or Filter 3 3

Proficiency Summary: Readiness Distribution

Student Proficiency Pathway

Growth Distribution Growth distribution information will be included on future summative score reports. Growth distribution information will be included on future summative score reports.

Skills Distribution

Data Review: Proficiency Summary Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Guiding Questions. Take a moment to record your thoughts on the Data Insights and Planning document.

One Question What is one question teachers may have about the Proficiency Summary?

Sharing ACT Aspire Reports

Data Interpretation School/District Reports

Accessing District/School Reports

Current Progress One-year growth information will be available on future summative score reports

Rapid Response Make as many observations as you can about the data in three minutes. Locate the Current Progress report for one grade in your district or school.

Add a Question Write a question that each observation raises for you.

Subject Proficiency by School

Data Review: Current Progress Review the Current Progress reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Current Progress reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document.

Data Interpretation Skill and Subject Proficiency Reports

Accessing Skill and Subject Proficiency Reports 1 Grade 1 Grade 2 Subject 2 Subject 3 Group 3 Group Report 4 Report

Skill Proficiency by Group

Skill Proficiency by Subject

Data Review: Skill/Subject Proficiency Review the Skill Proficiency reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document. Review the Skill Proficiency reports for each grade and subject tested. Take a moment to record your thoughts on the Data Insights and Planning document.

Data Exploration Time Return to any reports that needed more time Explore reports that sparked your interest Record your observations on the Insights and Planning document  Curriculum  Professional Development  Interventions

Action Planning Leading Improvement Using ACT Aspire

Assessment Literacy What insights did you develop about the role of ACT Aspire in your assessment program?

ACT Readiness Benchmarks What messages do you plan to share about how ACT Aspire scores connect to the idea of college and career readiness?

ACT Aspire Reports What are some major themes you observed across the reports you reviewed?

Check your for a link to the evaluation. Please take a few minutes to complete it. © 2015 by ACT, Inc. All rights reserved.

Circle Reflection What is your biggest takeaway from today? What did you enjoy about today? How do you plan to use what you have learned? What is one of your next steps?

Check your for a link to the evaluation. Please take a few minutes to complete it. Thank you for your time and all that you do for your students! © 2015 by ACT, Inc. All rights reserved.

Holly Fisackerly Principal Consultant Learning Management Team Phone: