Interpreting and Using ACT Aspire Summative Results Spring 2018 Test Administration Dr. Jorge Peña, Director of School Improvement and Accreditation

Workshop Objectives 8:30 - 9:10 Objective 1- Build assessment literacy: understand how results are reported 9:10 - 10:15 Objective 2- Analyze results by writing descriptive and specific statements 10:15 - 10:25 Break 10:25 - 11:30 Objective 3- Identify the skills that were the most challenging to students on the summative test

Prayer (Sign of the cross) Loving God, Our creator, our savior, our companion, bless this journey of a new school year that we undertake. Refresh our souls and renew our spirits as we embrace the beautiful ministry you have called us to. We welcome those who are new to our schools and ask that you strengthen them to share the wonderful gifts you have given them. Lord, make our hearts pure as we prepare for the return of students to our schools, and may you guide them to return with open hearts and minds eager to learn. We ask this through Christ our Lord. Amen. Prayer

Workshop Norms Take an inquiry stance. Ground statements in evidence. Assume positive intentions. Stick to protocol. Start and end on time. Be here now.

Check-in Activity: Expectations Find someone you do not know In one-minute, answer four questions: What is your name? What is the name of your school? What is your role? What do you hope to get out of today’s workshop? 0:39 0:38 0:40 0:42 0:43 0:37 0:41 0:35 0:31 0:30 0:32 0:33 0:44 0:34 0:36 0:46 0:54 0:53 0:55 0:56 0:58 0:57 0:52 0:51 0:47 0:29 0:48 0:49 0:50 0:45 0:28 0:08 0:07 0:09 0:10 0:12 0:11 0:06 0:05 End 2:00 0:01 0:02 0:04 0:03 0:13 0:14 0:23 0:22 0:24 0:25 0:27 0:26 0:21 0:20 0:16 0:15 0:17 0:18 0:19 0:59 1:01 1:41 1:40 1:42 1:43 1:45 1:44 1:39 1:38 1:33 1:32 1:34 1:35 1:37 1:36 1:46 1:47 1:56 1:55 1:57 1:58 2:00 1:59 1:54 1:53 1:49 1:48 1:50 1:51 1:52 1:31 1:30 1:10 1:09 1:11 1:12 1:14 1:13 1:08 1:07 1:03 1:02 1:04 1:05 1:06 1:15 1:16 1:25 1:24 1:26 1:27 1:29 1:28 1:23 1:22 1:18 1:17 1:19 1:20 1:21 1:00

Archdiocese of Chicago Academic Improvement Goals Reading and Math Student are to learn the Archdiocese of Chicago Curricular Benchmarks in English/language arts and math. As measured by meeting or exceeding ACT Aspire College Readiness Benchmarks: “ready” or “exceeding” Student growth from one year to the next is “high” or above the expected level of performance

Hopes & Fears Protocol What are your hopes about student performance on the ACT Aspire test from spring 2016 and 2017 to spring 2018? What are your fears about student performance on the ACT Aspire test? Pair Share

Understand how ACT Aspire results are reported: Assessment Report Scavenger Hunt Log into the ACT Aspire Portal and think about one grade-level to analyze. Identify one Educator report you have little to no familiarity with its contents. Complete the Assessment Report Scavenger Hunt for this report. You may work with a partner. Educator reports: Current Progress, Supplemental Scores, Subject Proficiency by Student, Skill Proficiency Report, Proficiency Summary

Generate the report

Complete the Assessment Report Scavenger Hunt Protocol using the Current Progress Report or another educator report

Workshop Objectives 8:30 - 9:10 Objective 1- Build assessment literacy: understand how results are reported 9:10 - 10:15 Objective 2- Analyze results by writing descriptive and specific statements 10:15 - 10:25 Break 10:25 - 11:30 Objective 3- Identify the skills that were the most challenging to students on the summative test

Objectivity/Specificity Matrix

Notice/Wonder Protocol Analyze the Current Progress report using the “I notice/I wonder” protocol Write specific and descriptive “I notice” statements Write specific and descriptive “I wonder” questions

Analyze these reports for a grade- level in this specific sequence: Report #1 Current Progress Report #2 Supplemental Scores Report #3 Subject Proficiency by Student Report #4 Skill Proficiency by Subject Report #5 Proficiency Summary by Subject

The Proficiency Summary report can only be generated for 30 students or less

What is the bar for meeting the standards? Access the ACT Aspire Readiness Level Ranges Access the ACT Aspire Performance Level Descriptors

Comparative Analysis Analyze the 2016 and 2017 results: same grade level and subject focus area What is the percent of students meeting benchmarks. What is the trend? Upward, downward,

Identify Intersections and Dissonances Work with a partner to discuss the following questions: What intersections are evident in the data? -Intersections: What dissonances arise from the data?

Break : 10 minutes 10:15 - 10:25

Workshop Objectives 8:30 - 9:10 Objective 1- Build assessment literacy: understand how results are reported 9:10 - 10:15 Objective 2- Analyze results by writing descriptive and specific statements 10:15 - 10:25 Break 10:25 - 11:30 Objective 3- Identify the skills that were the most challenging to students on the summative test

Assessments Measure Standards ACT Aspire measures the Archdiocese of Chicago Curricular Benchmarks Identify the lowest performing strand in your school’s focus area: reading, math, and science

Identify the Skills Students Found Most Challenging Access the AoC Curriculum Benchmark Reports Identify the skills for the lowest performing strand Identify which of these skills are Priority and Supporting

Debrief using SUMI Protocol [5 minutes] What Surprised you about analyzing the ACT Aspire results using this process? How would you Use this process at school? What is Marinating for you? What Impact might this analysis process have at your school?

Children who believe “smart” is something they can acquire perform significantly better “No matter what your ability is, effort is what ignites that ability and turns it into accomplishment.” - Dweck, Carol. (2006). Mindset: the new psychology of success. Page 41

Next steps Review next steps: Analyze student performance results on ACT Aspire in grades 3-8 with an emphasis on reading and math Replicate training with faculty at school Take an inquiry stance: email or call questions to Dr. Jorge Peña: jpena@archchicago.org/ 312-534-5289

Plus and Delta Protocol + Plus What worked well about this workshop? Pluses are specific and descriptive ∆ Delta What should change for the next workshop?

Thank you for all that you do on behalf of Catholic schools!!