Evaluation: Help on the Road to Accomplishing the Mission Kelly Sparks June 21, 2010

Learning Point Associates Our Vision We envision an education system that works for all learners. Our Mission We deliver knowledge, strategies, and results so educators will make research-based decisions that produce sustained improvements throughout the education system.

Other Terms for Evaluation Measuring outcomes Data analysis Performance management Performance improvement Accountability Using data to make informed decisions

The Power of Data Examine trends to see what’s working Drill-down to student groups to identify targeted areas for program delivery Develop strategies for continuous improvement Prove programs work (validation) Stop doing what isn’t working Ensure you are serving students to be successful

College and Career Continuum Elementary School Transition to Middle/High School High School Transition to College College Transition to Employment Employment

College and Career Data Elements School Transcript Data and Program Data What do we know about our students during high school? Are they prepared for college and career? Senior Exit Questionnaire What do students plan to do after high school graduation and how many take the needed steps to get to college? College Enrollment Data Which students actually enroll and persist in college?

College and Career Data Elements IPEDS Data and Barron’s Ratings What are the characteristics of the colleges where students enroll? Employment Data Which students actually work, what are their wages, and in what industries do they work? FAFSA Data Which seniors complete their FAFSA and when do they complete it?

College and Career Data Elements Freshmen Transition Questionnaire What issues affect students’ transition to high school and what are their postsecondary aspirations? Career Exploration Data Which students are completing college and career planning activities that prepare them for life after high school?

Which Data Element Matters Most? Depends on who is asking the question Must be tied to a framework Must be tied to an intervention Things to remember: Measure what you can change Focus on a few data points at a time Focus on progress

The Chicago College and Career Framework

The Chicago Framework Awareness – Readiness – Access– Success College and Career Specialists & Coaches Counseling GEAR UP AVID Career and Technical Education Direct support to schools Connect to Postsec. Initiatives Counselor Collaboration Student Engagement Parent Support Teacher Development Rigorous Coursework Writing/ Inquiry/ Collaboration/ Reading Organization/ Self Advocacy Technical Skill Advanced Academics Work Readiness Postsecondary Education Personal/ Social Development Academic Development Career Development Research and Data Strategy

Chicago: Driving Data at All Levels Curricular and Programmatic Supports Integrated School Support Model Research and Data Strategy AVID Integrated school teams College and career cultures Data-driven decisions DCCP supports catered to student needs Integrated partnerships Student Outcome Tracking Data tools Data- Driven Strategies CTE Coaches and Specialists SCHOOLS Improved Student Outcomes GEAR UP Counseling Awareness, Readiness, Access Strategies Partnerships

Examples of Other Frameworks

Overall School Success 12 Main Elements Lead to Student Achievement Mission, Vision, and Values Organizational Structures School-Level Supports Instructional Leadership Support for Teaching and Learning Student Achievement Planned Curriculum Instruction Assessment Enacted Curriculum Instruction Assessment District-Level Supports Strategic Planning Performance and Accountability Human Resources Allocation of Financial Resources District Governance District-Level Supports Instructional Leadership Support for Teaching and Learning

Career and Technical Education PROGRAM INPUTS Student enrollment Certified teachers Externally validated curriculum and third party skill assessments Infrastructure, supplies, and materials College and career coaches Professional development for principals, teachers, counselors, and coaches Postsecondary articulation Business partnerships STUDENT OUTPUTS Program retention and completion Skill attainment Certification and licensure College planning activities Career awareness and exploration activities College credit earned in high school Work experience Concrete postsecondary plans STUDENT OUTCOMES High school graduation Postsecondary education enrollment and completion (certificate, associate's, bachelor's) Employment and earnings

The Power of Technology The Power of Data + The Power of Technology

Using Data to Drive Success Students enroll in college = Increased college enrollment by 2.5% in 2008 to 52.5% Data – Why it’s important / How we will use this info What we will track, and what we need their help in tracking / collecting for us throughout the school year, and when Maybe lay the context as we’ve done this in Postsecondary, now need to do it in CTE – one of the benefits of the merger 17

College Enrollment Report

Using Data to Drive Success Students enroll in college = Increased college enrollment by 2.5% in 2008 to 52.5% Seniors complete the FAFSA before enrolling in college = Check that students complete their FAFSA 74.1% in 2008—almost 10% increase from 2007 Data – Why it’s important / How we will use this info What we will track, and what we need their help in tracking / collecting for us throughout the school year, and when Maybe lay the context as we’ve done this in Postsecondary, now need to do it in CTE – one of the benefits of the merger 19

FAFSA Completion Report

Using Data to Drive Success Students enroll in college = Increased college enrollment by 2.5% in 2008 to 52.5% Seniors complete the FAFSA before enrolling in college = Check that students complete their FAFSA 74.1% in 2008—almost 10% increase from 2007 Data – Why it’s important / How we will use this info What we will track, and what we need their help in tracking / collecting for us throughout the school year, and when Maybe lay the context as we’ve done this in Postsecondary, now need to do it in CTE – one of the benefits of the merger Seniors complete FAFSA early in calendar year = Check weekly that students complete their FAFSA 47.5% by March in 2008—12% increase from March 2007 21

FAFSA Tracking System

Closing Thoughts Don’t measure just to measure Identify what is important Stay focused Embrace what the data says and be prepared to act Clearly tie data to solutions Have the right people in the conversation Measure early and often Always be thinking about the next step

Kelly Sparks P: 312-283-2309 > F: 312-288-7601 E-Mail: kelly.sparks@learningpt.org 20 N. Wacker Dr. Suite 1231 Chicago, IL 60610 General Information: 800-356-2735