Arizona EXPLORE Initiative WELCOME! 2012 Summit

Arizona EXPLORE Initiative Overview of the AZ EXPLORE Initiative Teena Olszewski, Director, Arizona GEAR UP

Arizona EXPLORE Initiative Governor’s College Access Challenge Grant (CACG) Early College and Career Readiness Initiative NAU Arizona GEAR UP  Early College & Career Awareness/Preparation  EXPLORE Partner Districts / Charters  8 th Grade Students/Families  EXPLORE Assessment Student Readiness Results / Interpretation Pre Education & Career Action Plan (“PreECAP”) “EXPLORE-Informed” HS Course Registration School & District Data Reports

Arizona EXPLORE Initiative Process  August – December  Outreach  Test Ordering  Pre Test Prep  Test Administration  January – June  Post test activities  Evaluation

Arizona EXPLORE Initiative Ann Connelly, EXPLORE Manager Goals, Objectives and Outcomes

Arizona EXPLORE Initiative Goals, Objectives and Outcomes Overarching Goal: To motivate more K-12 students to plan for, prepare for, and succeed in earning a bachelor’s degree.

Arizona EXPLORE Initiative FIVE OBJECTIVES

Arizona EXPLORE Initiative RESULTS: # of Schools 1. Increase the number of schools in Arizona that administer the EXPLORE

Arizona EXPLORE Initiative RESULTS: 2. Significantly increase the number of Arizona 8 th graders taking the EXPLORE assessment # of Students

Arizona EXPLORE Initiative 3. Ensure students completing the assessment receive: a) a copy of their score report; and b) a copy of the Using Your EXPLORE Results booklet RESULTS: 96% of students (29,257) received their score report & booklet

Arizona EXPLORE Initiative RESULTS: 93% of students (28,321) participated in a session 4.Ensure students completing the assessment participate in a one-on-one or group session on interpreting and applying their EXPLORE results to their future college and career plans

Arizona EXPLORE Initiative RESULTS: 87% of students (26,663) prepared a PreECAP 5. Ensure students completing the EXPLORE use the results to prepare a Pre Education Career Action Plan (PreECAP)

Arizona EXPLORE Initiative College and Career Readiness Stephanie Lewis, Director, West Region ACT

Arizona EXPLORE Initiative COLLEGE AND CAREER READINESS SYSTEM 8 th /9th Grade Score Scale: 1—25 8 th /9th Grade Score Scale: 1—25 10th Grade Score Scale: 1—32 10th Grade Score Scale: 1—32 11th–12th Grade Score Scale: 1—36 11th–12th Grade Score Scale: 1—36 Longitudinal Assessments 9th–12th Grade Instructional Improvement 9th–12th Grade Instructional Improvement College Readiness Instruction English, math, reading, science, optional writing Test (ACT only) Career and Educational Components The College Readiness System is a comprehensive program intended to help assist schools and districts in preparing every student for college and career. The system is a fully aligned curriculum and research-based solution. 14

Arizona EXPLORE Initiative ACT College Readiness Standards Serve as a direct link between what students have learned and what they are ready to learn. Help interpret the meaning of EXPLORE ®, PLAN and the ACT ® scores. Identify the knowledge and skills students are likely to demonstrate at various score ranges on each academic test.

Arizona EXPLORE Initiative 8 th & 9 th Grade EXPLORE 25 8 th & 9 th Grade EXPLORE 25 BENCHMARK SCORES

Arizona EXPLORE Initiative Define Knowledge and Skills College Readiness Benchmark Scores College Readiness Benchmark Score Test College Course(s)EXPLOREPLAN The ACT English English Composition13/ Math Algebra17/ Reading Social Sciences15/ Science Biology20/ The ACT Benchmark Score indicates a 50% chance of obtaining a “B” or a 75% chance of obtaining a “C” in corresponding credit- bearing college courses.

Arizona EXPLORE Initiative How are Benchmark Scores Established?

Arizona EXPLORE Initiative Arizona Results Stephanie Lewis, Director, Program Solutions, West Region ACT Barbara Soby, Assistant Director, NAU/Arizona GEAR UP

Arizona EXPLORE Initiative What it is… What it tells us… What can we do differently now that we know… Arizona’s Data …

Arizona EXPLORE Initiative EXPLORE provides two kinds of data:  ‘cognitive’  ‘non-cognitive’ EXPLORE data can be used at two levels:  for student improvement to respond to the needs, strengths and weaknesses of the students tested as 8 th graders in fall 2011 to improve their academic readiness.  for school improvement to improve curriculum and instruction, school culture, and the academic readiness of future students.

Arizona EXPLORE Initiative Cognitive Data

Arizona EXPLORE Initiative

Digging Deeper  Profile Summary Report – Table 1a  Item Response Summary Report

Arizona EXPLORE Initiative What can you learn from this data? Large numbers of students just met the Benchmark (could be in danger of slipping) or are “on the cusp” – just 1 or 2 points below benchmark. A small increase in score for each of these students will drastically improve your “percent at or above Benchmark.” BM=13 BM=17 BM=15 BM=20 TABLE 1a Profile Summary Report

Arizona EXPLORE Initiative What else can you learn from this data? Large numbers of students are well below the benchmark, especially in science. And many students are doing very well. What might you do in response?

Arizona EXPLORE Initiative Item Response Summary Report shows: % of students who selected correct answer % of students who selected each incorrect answer % who did not select an answer Reference Group Comparison Data

Arizona EXPLORE Initiative Can help you relate your students’ overall performance on EXPLORE to your local curriculum (strengths & weaknesses) Look for patterns Looking at incorrect responses can help you identify source of error High omit rates may indicate issues related to test-taking skills, generally

Arizona EXPLORE Initiative English

Arizona EXPLORE Initiative English Item #25: References passage in text: The released electrons in the exposed iron or steel, combine with oxygen in the presence of moisture in the air to form a new substance, rust. A. No Change B. steel combine, C. steel, combine, D. steel combine

Arizona EXPLORE Initiative Mathematics

Arizona EXPLORE Initiative Math Item #2: At a secondhand store, Bjorn purchased 3 shirts and 2 pair of jeans. The shirts cost $7.79 each and the jeans cost $10.37 per pair. What was the cost of this purchase, before taxes were added? F. $18.16 G. $20.74 H. $23.37 J. $44.11 K. $46.69

Arizona EXPLORE Initiative Math Item #28: Theresa has a 4-gallon water tank that has 2 ½ gallons of water in it. She then adds ¾ of a gallon of water to the tank. Among the following, which is the largest amount of water, in gallons, Theresa can still add to the tank without the water over flowing? F. 3/8 G. 1/2 H. 5/8 J. 7/8 K. 1

Arizona EXPLORE Initiative Math Item #30: During the recent mayoral election, an exit survey of voters in 3 precincts was taken to predict which of the 2 candidates would win. The results of the exit survey are shown below. Under the assumptions that the exit survey accurately predicted the winning candidate and a total of 10,000 voters voted for mayor, Candidate A was predicted to win by how many votes? F. 200 G. 660 H. 1,078 J. 1,122 K. 5,100 Candidate ACandidate BTotal Precinct Precinct Precinct Total1,1221,0782,200

Arizona EXPLORE Initiative Reading

Arizona EXPLORE Initiative Science

Arizona EXPLORE Initiative Statements that describe what students should know and be able to do... And statements that provide suggestions to progress to a higher level of achievement ACT Materials to Help Use The Data

Arizona EXPLORE Initiative Non Cognitive Data

Students Self- Reported - Expressed Need for Help

Arizona EXPLORE Initiative Can give insight into:  individual student’s experiences and  the general perception and experience of your student body New This Year Supplemental Local Questions

Arizona EXPLORE Initiative Supplemental Local Questions

Arizona EXPLORE Initiative School specific data will be most informative → page 9 of your Profile summary report 52 schools administered the supplemental questions 181 schools did not administer the supplemental questions Supplemental Local Questions

Arizona EXPLORE Initiative Supplemental Local Questions 1. Do you have a computer you can use at home? 55% - Yes 8% - No 37% - No response 2: Do you have internet access from your home? 54% - Yes 9% - No 37% - No response

Arizona EXPLORE Initiative Supplemental Local Questions 4. How many people do you know who have been to college? 6% - No one 20% people 13% - 4 – 6 people 6% - 7 – 10 people 20% - More than 10 people 37% - No response

Arizona EXPLORE Initiative Moving forward… Clearer Instructions to Test Supervisors / Administrators Changes to Supplemental Questions? Please use light blue 3x5 index card in folder for suggestions

Arizona EXPLORE Initiative Sharing Best Practices & Plans Natalie Nailor, Executive Director – Access ASU

Arizona EXPLORE Initiative  Using EXPLORE Data  Helping Parents and Students Understand and Use EXPLORE Results  PreECAPS  Transition to High Schools Sharing Best Practices:

Arizona EXPLORE Initiative Using the EXPLORE Data: Best Practices Roseyn Hood Secondary Education Specialist Chandler Unified School District

Arizona EXPLORE Initiative Helping Parents and Students Understand and Use EXPLORE Results: Best Practices Joe O’Reilly, PhD Executive Director of Student Achievement & Support Mesa Public Schools

Arizona EXPLORE Initiative PreECAPS: Best Practices Robert Hagstrom, Ph.D. Director of Research and Analysis, Flagstaff Unified School District

Arizona EXPLORE Initiative Transition to High Schools: Best Practices Dr. Heather Cruz Deputy Superintendent Peoria Unified School District

Arizona EXPLORE Initiative We believe the greatest benefit from using the EXPLORE results was (or will be)… Please use the pink 3x5 index card Open Discussion

Arizona EXPLORE Initiative One thing I would do differently next time is… Please use the purple 3x5 index card Open Discussion

Arizona EXPLORE Initiative Open Discussion One thing GEAR UP and/or ACT should do differently to improve the process is… Please use the yellow 3x5 index card

Arizona EXPLORE Initiative Open Discussion We would describe the value of the EXPLORE testing (for promoting college and career readiness in our school) as… Please use the green 3x5 index card

Arizona EXPLORE Initiative Next Steps: EXPLORE Middle Grade Initiative

Arizona EXPLORE Initiative Timeline & Process  August 1, 2012: Commitment/Order Forms Due  October 2012: Test Administration/ Webinar  October 2012: Distribution of Planning Guides and PreECAPS  October 15 – November 7, 2012: EXPLORE Testing Window  Dec. 2012: Score Reports from ACT/ Webinar for repeat participants  Early January 2013: Regional Workshops/Trainings  January 2013 – April 2013: Post-Assessment Activities  May 2013: District Reports to NAU  June 2013: EXPLORE SUMMIT