District & Community Organizations: A Data-Driven Partnership November 9, 2017 Maren Henderson, Evaluation Specialist Accountability, Innovation, and Research

Context 36,000 students 66 schools Highly segregated city 36% African American 34% White 18% Hispanic/Latinx 6% Asian 3% American Indian 66 schools Highly segregated city Significant achievement gap Over 300 community partners Active philanthropic and business community MCA Reading Growth Z-Scores by Neighborhood Percent of Students Identifying as White by Neighborhood

Challenges to Address Data Privacy Staff Capacity/Frequency of Data Requests Limited Formative Use of Data Interpretations of Impact Concerns about Program Quality

Community Partnership Evaluation Program

Theory of Change Access to data Support interpreting and using data Stronger relationship with district Improved programming for youth Improve data sharing with MPS community partners. Align community partner services to MPS strategic plan and goals. Increase the capacity of community partners to utilize evaluation for program improvement.

Access to Data Compliant & Streamlined Roster Collection Biannual Aggregate Reports Data Dashboard

Biannual Aggregate Reports Created using R and R Markdown Data Includes: Demographics Service Status Achievement Outcomes* Test Scores (Proficiency and Growth) School Performance Engagement* Attendance Behavior *Fall Reports contain prior year/baseline data

http://insights.mpls.k12.mn.us/SchoolBoardPortal /cpoost.html Data Dashboard http://insights.mpls.k12.mn.us/SchoolBoardPortal /cpoost.html What types of programs do MPS students participate in? Does program access vary by school or neighborhood? Which students are being served by programs? Who is not being served? Are there significant overlaps in program participation?

Support Interpreting and Using Data Evaluation Capacity Building Workshops Collective Impact Network Support

Evaluation Capacity Building Monthly, now quarterly Examples of Topics: Logic Model Theory of Change Coding Qualitative Data Excel Youth Participatory Evaluation

Collective Impact Network Support College Access Network Ongoing Data Pulls Duplication Recruitment FAFSA and College Application Status End of Year Summary Numbers served; eligible students not served Participant Outcomes Adding to Predictive Modeling in 2018

Stronger Relationship with District Technical Assistance Evaluation Capacity Building Workshops

Improved Programs for Youth (Long-Term Impact) District Indicators: Enhanced understanding of impact of out-of-school time and/or community partner offered programs on school district outcomes Increased ability to understand individual partner impact

Improved Programs for Youth (Long-Term Impact) Partner Indicators: Increased ability to understand program impact Easier and consistent access to data Enhanced capacity to support formative and summative evaluative practices

Improved Programs for Youth (Long-Term Impact) Funder Indicators: Enhanced understanding of collective impact of out-of-school time and/or community partner offered programs on school district outcomes Increased ability to understand individual partner impact, when applicable Gaining confidence in program’s continuous quality improvement efforts

Key Factors to Successful Partnership Focus on Evaluation Use Focus on Mutually Beneficial Efforts Sustained Investment Cross-Sector Collaboration

Questions? Comments? Maren.Henderson@mpls.k12.mn.us