Dr. Beth Bean Director of Research and Information Colorado Department of Higher Education Ryan Allred Senior Data Systems Engineer Colorado Department of Higher Education & Colorado GEAR UP NCCEP Capacity Building Workshop February 5, 2013 Making Data Work for You: A Colorado Story

Agenda Overview Data Tracking Data in Formative Decisions Data in GEAR UP Decisions Best Practices, Overview Best Practices, GEAR UP 2 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

3 Image from: colorado.com State Capitol

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Beth Bean last Saturday

HIGHER EDUCATION OVERVIEW The State of Colorado 5 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

We Are Here Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

About Colorado 5.1 million - Population (July 2011, Dept of Local Affairs) 4.2 Million in Front Range (Pueblo to Ft. Collins) 2 million Households (Census 2010) 854,265 – K-12 students 432,500 – Postsecondary students Website: Colorado.gov Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

About Colorado Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Demographics Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Source: 2010 Census -

Colorado Job Demographics Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Source: 2010 Census -

The Colorado Paradox & Promise – Close the Achievement Gaps – Halve the Drop Out Rate – Double the number of Certificates & Degrees – Increase Student and Family awareness of Career Pathways. Colorado Department of Higher Education NCCEP Capacity Building Workshop - February 5, 2013

Minding the Colorado Gap – Ethnicity/Race Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

The Colorado Gap - Income Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Percentage of Jobs in 2018 that Will Require a Postsecondary Education, by State Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

B.C. – Be ClosedA.D. – Access to Data Big Data: The shifting paradigm……. DATA Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Our Mission Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Research Mission: Inclusive Integration Governance – Data Advisory Group – Transparency – Participation – Collaboration Inclusion – Private Degree granting Institutions – Area Vocational Schools Integration – P20 – K12 Data Alignment position – CO Dept. of Education Data Agreement – CO Dept. Labor and Employment Data Agreement

Data Life Cycle Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Statewide Longitudinal Data Systems National Center for Education Statistics (NCES), specifically Institute of Education Sciences (IES). Grants – four rounds of ARRA funding 41 states to date Aid state education agencies to develop and implement longitudinal data systems Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

COLORADO SLDS/RISE o Capture o Link o Provide Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Postsecondary Student B.A. English 3.04GPA 2 semesters of remediation in Math Average per Year $4,623 Financial Aid Transferred from Community College 23 year old Hispanic Male 153 hours to graduate 1110 on SAT Concurrent Enrolled in HS Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

K-12 and Postsecondary Link Cherry Creek H.S. College Student 600 Science CSAP Score FRL 5 years 11 th Grade ACT 3.44 GPA ESL Cherry Creek Middle School Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, K-12 Student

K-12: Postsecondary: Employed Teacher College Student Teacher School of Employment Employment Duration Salary Subject Area Teaching In-state or out- of state prior experience Technical Assessments Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, K-12 Student

The P-20 Future……….. K-12 Student College Student Employee Area of Employment Salary Data Employment Duration Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

P-20 Educator Future…………… K-12 Student College Student Teacher K-12 Student Linked to Specific Teacher Teachers’ Student’s CSAP Scores and all K-12 data Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

District at a Glance Search Tool Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, District at a Glance Search Tool

Data Links (Legislative Action) 2002 – required longitudinal analysis of the CSAP test, creating the SASID (CRS ) every postsecondary institution in Colorado must provide each enrolled student with a unique identifier (CRS 23‐5‐127.4) 2008 – unified data protocols, open data sharing between state agencies (HB ) Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Kenosha Pass, Jefferson County

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Hanging Lake, Glenwood Canyon, CO; 7,040 feet above sea level

DATA TRACKING Data Flow from GEAR UP to the Governor 30 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

Data? Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

DATAINFORMATION Raw input Qualitative or quantitative attributes Not significant alone Observations and recordings done to obtain data Derived from Data Information is a concept Significant alone Analysis done to obtain information Data versus Information Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Aggregated Reporting, High Level System and Trend Analysis Examples: IPEDS, National Comparisons Aggregated Reporting, High Level System and Trend Analysis Examples: IPEDS, National Comparisons Systems Integration, Reports & Analysis, Systems Policy Examples: Statewide Graduation Rates, Dropout, Retention, Matriculation Systems Integration, Reports & Analysis, Systems Policy Examples: Statewide Graduation Rates, Dropout, Retention, Matriculation Unit Record Student Data, Point on Entry Examples: Demographic, Academic, Services Unit Record Student Data, Point on Entry Examples: Demographic, Academic, Services Downstream Data Flow – State View Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Data Information Compliance

Downstream Data Flow – State View (Non-GEAR UP Students) Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, High School School District CO Dept of Education State Agencies CO Dept of Higher Ed Legislature/ Governor Federal (IPEDS) Data Information Compliance IHE (College) NSC

Downstream Data Flow – State View (GEAR UP Students) Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, High School School District CO Dept of Education State Agencies CO Dept of Higher Ed Legislature/ Governor Federal (IPEDS) IHE (College) Colorado GEAR UP Data Information Compliance NSC

Downstream Data Flow – State View (Links) Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, High School School District CO Dept of Education State Agencies CO Dept of Higher Ed Legislature/ Governor Federal (IPEDS) IHE (College) Data Information Compliance K-12 Student IDSSN NSC Student Names Colorado GEAR UP

MORE DATA TRACKING Colorado Data 37 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

Colorado GEAR UP (GU3) Data Type# Regions8 All Schools33 High Schools15 Middle Schools18 Source: Colorado GEAR UP Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data Type# Students Total Students3,833 GU 2 ( Grant) th -12 th Grade450 College Level410 GU 3 ( Grant)2,973 8 th Grade1,404 9 th Grade1,569 Source: Colorado GEAR UP Student Database Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Colorado GEAR UP

K-12 Environment Data Type# School Districts178 All Schools2,209 Public Schools1,816 (82.2%) Non-Public Schools393 (17.8%) Source: Colorado Department of Education, 2011 October Count School Counts - Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

K-12 Populations Data Type# Students Total Students (Oct 2011)854,265 Grades ,233 (28.5%) FRL Students339,688 (41.3%) Home Based Students6,067 (0.7%) Dual/Concurrent (AY 10-11)20,773 (8.5% of grades 9-12) Colorado GEAR UP3,833 Source: Colorado Department of Education, 2011 October Count School Counts Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Postsecondary Environment Data Type#4-Year2-Year or lessApprox. # Students All Colleges ,500 Public Colleges ,000 Area Technical331,500 Private Accredited & Religious Exempt ,000 Private Occupational335 35,000 Source: Colorado Department of Higher Education Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Postsecondary Data Collection Data Type# Records# Institutions Enrollment12,455,62433; All Publics, Private Non-Profits Degrees Awarded846,77935; All Publics, Private Non-Profits Financial Aid3,921,12159; All Publics, Privates participating in state financial aid Applicant/Assessment1,831,60332; All Publics, Private Non-Profits Educator Preparation146,94420; Participating Educator Preparation institutions Remedial Course438,01723; Participating institutions Source: Colorado Department of Higher Education, SURDS Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Opportunities Data Friendly Environment – Data Driven Leadership – Legislative Support – Grant Funded Support – Eager Research Community Links and Relationships are established – MOU – SLDS Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Opportunities Postsecondary outcomes LINKED to K-12 performance Labor and Employment Outcomes Educator (and Educator Programs) Effectiveness Pre-Collegiate Program Effectiveness National enrollment and transfer studies (NSC) Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Challenges Data Quality - Linking and Sharing – CGU Grads, CDE Graduate Data MOU in “FERPA Purgatory” Burden vs. Benefit vs. Security Uncollected data attributes Reducing Overlap in collections Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Mile High Skyline, at dawn

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Aspen, CO

DATA IN FORMATIVE DECISIONS Policies and Legislation 50 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

Data in Formative Decisions Data = information & information = power Share data National reporting IPEDS/NCES State and Federal Mandates Internal and external reporting To inform and change policy To aid in P-20 understanding Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data Sharing Colorado Department of Education School Districts Other state agencies Institutions, Researchers, Graduate Students Share aggregate data daily/publicly – i3: Searches, Downloads, Reports Sharing potential and practice increasing Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data in Legislative Decisions Concurrent Enrollment – ASCENT – K12 and HE collaboration, fiscal backing Reverse Transfer – Credit Where It’s Due – Large pilot currently launched – Grant funded SASID Linkage (K-12 to Postsecondary link) – Proposed 2013 legislation Performance Funding – Indicators Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data in Policy Decisions Remedial Assessment – Revisions by statue – Only Complete College America Grantees to do statewide revisions – K-12 accountability measure Admission Index/Cut Score – Revisions by statue – K-12 and HE Alignment Retention and Transfer Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data into Research into Practice Workforce Needs Price Sensitivity Educator Preparation and Effectiveness Workforce Linkage, Economic Success Measures Project (ESM) GED study Online/Traditional Science courses tracking Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Hiking Pikes Peak: Summit is 14,114 feet above sea level

DATA IN GEARUP DECISIONS Administration, Management, Services 57 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

58

Research Converting Data to Information 1) Use data to analyze current situation 2) Make informed, supported decisions Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data in GEAR UP Administration Service Data  Informs Student Contact Hours Missing Service Data  Advisor Management Remediation Progress, Achievement  Informs Need for Interventions College GPA, Attendance  Inform need for College Services Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data Analyzing GEAR UP Decisions GU2 (Cycle ) Dual Courses & CLEP Tests  Transcripted Hours  On-Track to Graduate Cohorts, Year-by-Year Tracking  College Matriculation Rates  College Persistence  Success Rates Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Data Influences GEAR UP Decisions GU3 ( ) State Remedial Rates, GU2 Students  Need for Remedial Intervention  GU3 Early Assessment and Enrollment Remedial Progress Tracking  Informs effective methods  Identifies advisors/students needing extra attention Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Research GU2 ( ) First Graduating Cohort in May % - On-Time Graduation (of Active 9 th -12 th ) – 72 % Statewide Rate 84 % - College Going Rate (of HS Graduates) – 46% Statewide Rate (to Public Colleges) 81 % - Year 1 College Persistence 69 % - On Track To Graduate – 44 % Statewide Rate Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Source: Colorado GEAR UP - Improving Academic Achievement: A Report on Colorado GEAR UP II At- Risk Student Outcomes, August 2012

Ongoing Research Further 2011 Graduates Analysis – Combining efforts Colorado GEAR UP Colorado Department of Higher Education Colorado Department of Education National Research Institutions – Harvard University – Stanford University – University of Colorado – University of Michigan – Vanderbilt University Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Ongoing Research Further 2011 Graduates Analysis – In depth analysis of statewide dataset of high school students going to college, progress and outcomes – Ranging concentrations of study Dual/Concurrent Enrollment Remedial Trends, Progress and Outcomes Effects of CLEP Testing Financial Aid Cost-Benefit Analysis Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Salida, CO

BEST PRACTICES, OVERVIEW What we got right 67 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

What We Have Learned Data Drives Legislation, Policies, Decisions – Remedial Report Early Remediation – Progress & Outcomes Transcript Framework – Financial Aid Allocations to colleges Funding Models, Performance Funding Data Limitations – The philosophical chicken and the egg Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

What We Have Learned Relationships – Department of Education – Local Education Agencies (LEA) Denver Public Schools Remedial Project Make Data Available – Available data leads to more discussion, progress, and change – Corrections to data and data collection – Transparency Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

What We Have Learned Data Sharing – No one knows what they want in the beginning – Open communication leads to clear message – Ask questions about data and what is being delivered, assumptions lead to errors – Collaborative Governance Think Long Term – Baby steps are great, Redoing work is not Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, Denver Broncos

BEST PRACTICES, COLORADO GEAR UP Building on Success 73 Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

What Have We Learned (GU) Customize Data System – Flexible, customized data system offers ability to track exactly what you need College Portfolio example Requires technical staff Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

College Portfolio Examples Online SurveySpecific Curriculum Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

What Have We Learned (GU) Be a Data Collection Overachiever – More detail on student and services gives you the ability to review actions and make corrections Service Categories example – Review data constantly, navigate accordingly Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Service Category Example Federal APR Categories (12) College visit/College student shadowing Computer Assisted Lab Counseling/advising/academic planning/career counseling Cultural events Educational field trips Family events Job site visit/job shadowing Mentoring Other Summer programs Tutoring/Homework assistance/Academic enrichment Workshops Colorado GEAR UP Expansion (31) ACADEMIC - Academic Intervention ACADEMIC - Academic Planning ACADEMIC - Credit Recovery ACADEMIC - Remediation Lang Arts ACADEMIC - Remediation Math ACADEMIC - Tutoring/Homework CAREER - Career Workshop CAREER - Field Trip CAREER - Internship CAREER - Job Shadowing COLLEGE - COF COLLEGE - College Applications COLLEGE - College Course COLLEGE - College Essay COLLEGE - College Readiness COLLEGE - College Visits COLLEGE - Financial Aid COLLEGE - Research COLLEGE - Scholarships COLLEGE - Testing and Assessments EXTRACURRICULAR - Community Service EXTRACURRICULAR - Cultural Events EXTRACURRICULAR - Summer Programs MENTORING PARENT - College Prep PARENT - Family Event PARENT - Field Trip PARENT - Home Visits PARENT - Telephone/Mail/ SURVEY - Parent SURVEY - Student Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

What Have We Learned (GU) Relationships – Vital to efficient data collection, don’t key enter data that exists with a partner Link or Share – Challenging the status quo can lead to hard conflict, then roadblocks Find benefit to partner, students and overall Communicate message Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

“Principal” Lessons Learned Upcoming book, to be published in 2013 – “Get Your Ass to College: How One School Closed the Achievement Gap” – By Dr. Scott Mendelsberg, Executive Director of Colorado GEAR UP, former principal of Abraham Lincoln High School This book describes the galvanizing program Lincoln called College Now that changed the school and forced the State of Colorado to change the way it viewed education. How this program increased the college matriculation rate from 17% to 73% in one year. The Colorado State Governor, the Denver Mayor, state senators and congressmen, future U.S. Senators and Congressmen and U.S. Presidential cabinet members are all involved in one way or the other, plus the President of the United States. Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,

Visit Us – DHE & CGU Please visit our website. Data and reporting is only valuable if it is used Questions and comments? Thank you! Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5,