Implementation Evaluation of the Early Childhood Peer Learning and Action Network (EC PLAN) Technical Assistance Program Presentation By: Sara Lackey – University of Maryland School of Public Policy

Goal of EC PLAN To increase the Promise Zones’ ability to track and monitor short and long early childhood development goals term goals.

Purpose of the Implementation Evaluation To understand how this technical assistance model: Assists Promise Zones with goal development Assists Promise Zones with tracking and measuring goals Could be adapted to other topic areas

Methodology Measurement Instruments: Sample: Surveys Interviews Sample: Program participants from the 10 participating Promise Zones Program participants consisted of a variety of childhood development policy makers and Promise Zone leaders Tools Used for the Development of Evaluation Measures: EC PLAN Charter 6 Month Half Way Point Evaluation Webinar Content Curriculum Logic Model (created by evaluator)

Methodology: Survey Sample Sample Size: 43 Response Rate: 11 Promise Zone Survey Respondents Camden 3 Choctaw Indy East Kentucky Highlands 2 Los Angeles 1 Pine Ridge Sacramento San Antonio South Carolina St. Louis

Methodology: Informal Conversation Sample Sample Size: 10 Response Rate: 7 Promise Zone Representative’s Role in the Promise Zone Camden Born to Read Manager Choctaw No representative agreed to participate Indy East Promise Zone Director Kentucky Highlands Early Childhood Director Los Angeles Pine Ridge Sacramento San Antonio Director of Operations, Eastside Promise Neighborhood South Carolina St. Louis Education Liaison to the County Executive

EC PLAN Program Activities & Elements Program Elements Webinars Action Periods Peer Connections Access to Federal Experts Content Structure

EC PLAN Program Activities Findings: Utilized EC PLAN Program Activities and Quality of Program Elements EC PLAN Program Activities Program Elements Webinars Action Periods Peer Connections Access to Federal Experts Content Structure

Developed EC Goals Prior to EC PLAN Findings: Promise Zones Were in Various Stages of Early Childhood Goal Development Promise Zone Developed EC Goals Prior to EC PLAN Camden yes Indy East Kentucky Highlands Los Angeles no San Antonio South Carolina St. Louis Promise Zone’s with pre- established goals thought the program was too basic Promise Zone’s without pre- established goals thought the program was too advanced

Findings: Participants With Various Positions Perceived EC PLAN Differently Promise Zone Developed EC Goals Prior to EC PLAN Camden Born to Read Manager Indy East Indy East Promise Zone Director Kentucky Highlands Early Childhood Director (of the Kentucky Highlands Promise Zone) Los Angeles Los Angeles Promise Zone Director San Antonio Director of Operations, Eastside Promise Neighborhood South Carolina South Carolina Promise Zone Director St. Louis Education Liaison to the County Executive Early childhood community partners thought they were alone in the program Promise Zone directors thought they were inappropriate program participants

Findings: Demographic Discrepancies Goal Development Discrepancies Program Participant Promise Zone’s with pre-established goals thought the program was too basic Promise Zone’s without pre-established goals thought the program was too advanced Early childhood community partners thought they were alone in the program Promise Zone directors thought they were inappropriate program participants Everyone thought the program was not appropriate for them THUS

Findings: A Good Program with Insufficient Participant Participation Nobody thought they were the target program participant. Everyone thought the structure of the program was good

How to Improve EC PLAN Improve Sustain Remove Learning outcomes Community participation Versatility Sustain Webinars Peer Dialogue Action Periods Access to Federal Experts Remove Adjustments to EC PLAN should focus on improvements

Questions?