Utilizing Student Academic Behavior Data to Improve Student Success Kira J. Holt Principal Consultant, ACT ©2012 by ACT, Inc. All rights reserved.

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

ACT’s M I S S I O N Helping people achieve education and workplace success ACT’s V A L U E S Excellence Diversity Leadership Empowerment Learning Sustainability

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

The College and Career Readiness Challenge On the one hand, as reported in Ready for College and Ready for Work: Same or Different (2006), college and career readiness skills have converged. On the other hand, in 2012 only 25% of graduating seniors who completed the ACT met all four of ACT’s College and Career Readiness Benchmarks.

ACT’s College Readiness Benchmarks The ACT Benchmark Score indicated a 50% chance of obtaining a “B” or a 75% chance of obtaining a “C” in corresponding credit-bearing college courses. College Readiness Benchmark Score Test College CourseEXPLORE (8/9)PLAN The ACT English English Comp.13/ Math Algebra17 / Reading Social Sciences15/ Science Biology20/202124

MEASURING STUDENT PROGRESS TOWARD READINESS IMPROVING COURSE RIGOR SUPPORTING SOLUTIONS PLANNING SCHOOL IMPROVEMENT EXPLORE 8th and 9th grade curriculum-based educational and career planning program PLAN 10th grade curriculum-based educational and career planning program The ACT 11th and 12th grade curriculum- based assessment for learning outcomes ENGAGE Middle and high school assessment that measures all factors of academic success QualityCore Research-driven solutions for strengthening curriculum CoreWork Diagnostics Online service to diagnose and improve content and practice areas Core Practice Audit Framework for evaluating current practices ACT’s College and Career Readiness System

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

Why Measure Academic Behaviors? Identify at-risk students early Diagnose student strengths and needs Identify appropriate interventions Assess the effectiveness of interventions

What the Research Says… “current research across disciplines shows that non- academic aspects of school are also significant contributors to both school and student success.” (Page 2)

“While assessments of academic achievement provide early indication of risk, academic behaviors are also important for persistence and success.” (Page 1) What the Research Says…

“As a leading indicator, aggregate academic behavior assessment results help educators know that their programs are on the path to success long before improvements in lagging indicators, such as academic readiness or graduation rates, can be documented.” Enhancing College and Career Readiness and Success: The Role of Academic Behaviors, p.12

Research Summary Student Academic Success School Connectedness Student Academic Achievement Student Academic Behaviors

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

What is ENGAGE? measures behaviors and non-cognitive attributes related to academic success and persistence helps educators evaluate students’ self- reported psychosocial attributes, determine their levels of academic risk, and identify interventions to help them succeed

What Does ENGAGE Measure ? DomainENGAGE Grades 6-9ENGAGE Grades Motivation (Getting work done)  Academic Discipline  Commitment to School  Optimism  Academic Discipline  General Determination  Goal Striving  Commitment to College  Communication Skills  Study Skills Social Engagement (Getting along)  Family Attitude toward Education  Family Involvement  Relationships w/ School Personnel  School Safety Climate  Social Activity  Social Connection Self-Regulation (Keeping your cool)  Managing Feelings  Thinking Before Acting  Orderly Conduct  Academic Self-Confidence  Steadiness

What Does ENGAGE Measure? Motivation Definition: personal characteristics that help students succeed academically by focusing and maintaining energies on goal-directed activities Grades 6-9 Examples: Academic Discipline, Commitment to School, and Optimism Grades Examples: Academic Discipline, Commitment to College, Study Skills, Etc.

What Does Engage Measure? Social Engagement Definition: includes interpersonal factors that influence students’ successful integration into their environment Grades 6-9 Examples: Family Attitudes toward Education, Family Involvement, Relationships with School Personnel, and School Safety Climate Grades Examples: Social Activity and Social Connection

What Does ENGAGE MEASURE? SELF REGULATION Definition: includes cognitive and affective processes used to monitor, regulate, and control behavior related to learning Grades 6-9 Examples: Managing Feelings, Orderly Conduct, Thinking Before Acting Grades Examples: Academic Self-Confidence and Steadiness

Percentage of students accurately identified as having a 9 th -grade GPA < 2.0 Selection MethodHit Rate Random24% EXPLORE Composite only69% ENGAGE Grades 6-9 only80% EXPLORE & ENGAGE83% ©2012 by ACT, Inc. All rights reserved.

Percentages of Students Accurately Identified for Dropping Out Selection MethodHit Rate Random17% EXPLORE Composite only37% ENGAGE Grades 6-9 Grad. Index only 42% EXPLORE & ENGAGE Grad. Index52% ©2012 by ACT, Inc. All rights reserved.

What the Research Says about ENGAGE ©2012 by ACT, Inc. All rights reserved.

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

Create Local Items: Reserve the computer lab and ensue the Internet Explorer is 8 or above. Chrome, Firefox, and Safari are viable alternatives. Make sure spam filters do not block s from Administer ENGAGE which takes approximately 30 minutes, but it is an untimed inventory. Complete the inventory in one sitting: students may take a break if necessary. Administering ENGAGE ENGAGE Login Page

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

Two Reports for Each Student Student Report Advisor Report An Aggregate School Report A School Roster Report Utilizing ENGAGE Results: Report Types

Utilizing ENGAGE Results: Accessing Reports ENGAGE Login Page

Profile of scores Success Indices (only on Advisor & Roster Reports) Interpretive feedback, sorted from strengths to needs Sample ENGAGE Advisor Report ©2012 by ACT, Inc. All rights reserved.

What do my scores mean? What actions should I consider? A message for parents

Utilizing ENGAGE Results: The Big Picture

Utilizing ENGAGE Results: The Roster Report Student IDLast NameGrade LevelPrior grades Academic Success Index Percentile Graduation Index Percentile Academic Discipline Percentile Commitment to School Percentile Family Attitude toward Education Percentile 12345Sample 19th gradeBelow D's Sample 29th gradeMostly C's Sample 39th gradeMostly C's Sample 49th gradeMostly B's Sample 59th gradeMostly C's Sample 69th gradeMostly A's Sample 79th gradeMostly A's Sample 89th gradeMostly C's Sample 99th gradeMostly C's Sample 109th gradeMostly C's Sample 119th gradeMostly C's Sample 129th gradeMostly A's Sample 139th gradeMostly C's Sample 149th gradeMostly B's Sample 159th gradeMostly C's Sample 169th gradeMostly B's Sample 179th gradeMostly B's Sample 189th gradeMostly A's Sample 199th gradeMostly C's Sample 209th gradeBelow D's Sample 219th gradeMostly B's Sample 229th gradeMostly B's Sample 23Mostly B's Sample 24Mostly B's Sample 259th gradeMostly C's Sample 269th gradeMostly B's Sample 279th gradeMostly B's Sample 289th gradeMostly B's Sample 299th gradeMostly C's Sample 308th gradeMostly C's Sample 319th gradeMostly A's Sample 329th grade Sample 339th gradeMostly C's

Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

ENGAGE Resources

ENGAGE provides an innovative, easy-to-use, low stress, high impact method of Identifying at-risk students; justifying individual and school/district wide interventions; and helping all students reach their full academic potential and schools achieve their mission. In sum...

Thank you for your time. Kira J. Holt Principal Consultant, Southwest Region ACT, Inc. P: