1. Features of High Quality Pre-K Programs and Systems: Taking Stock and Growing the Evidence Base
A Forum at the Center for Improving Research Evidence (CIRE)
Washington, DC
October 6, 2016
Kimberly Boller • Jennifer Brooks • Anne Kaiser
Ann Person • Shannon Rudisill • Louisa Tarullo

2. Ann Person, CIRE director
Welcome
Ann Person, CIRE director

3. About CIRE
Build capacity to understand and use evidence
Plan rigorous and relevant evaluations
Strengthen research methods and standards

4. Overview and Introductions
Louisa Tarullo, Mathematica

5. Today’s Speakers Kim Boller, Mathematica
Jennifer Brooks, Bill & Melinda Gates Foundation
Anne Kaiser, Maryland House of Delegates
Shannon Rudisill, Administration for Children & Families

6. Early Learning National Strategy
Jennifer Brooks,
Bill & Melinda Gates Foundation

7. Early Learning National Strategy
Jennifer Brooks, PhD, Senior Program Officer
© Bill & Melinda Gates Foundation

8. EARLY LEARNING STRATEGY THEORY OF CHANGE
Initiative #1: Exemplars
Target states
Head Start
Washington state
Increased uptake and implementation of essential elements
Quality early learning environments
Kindergarten readiness
Effective teaching
Strong early learning leaders
Initiative #2: Workforce
Teachers and leaders
Supporting dual language learners
Articulated competencies and improved higher ed offerings in early education
Trained and supported teachers
Improved 3rd grade outcomes
Initiative #3: Innovation
Tools and technology to catalyze even greater gains
VISION: By 2030, all young children in the United States will have access to high quality, effective and affordable preschool education, with highest priority placed on serving low-income and children of color.

9. ESSENTIAL ELEMENTS FOR EXEMPLAR PRE-K
ENABLING ENVIRONMENT
Creates the conditions for the development
of high-quality programs
Public and political will
Strong leadership
PROGRAM POLICIES
Ensure great teachers, leaders and curriculum
PROGRAM PRACTICES
Lead to continuous improvement
Teacher education and compensation
Class size
Adult/child ratio
Full day
Early learning standards
Proven curriculum implemented with fidelity
Dual language learners support
Support for students with special needs
Integrated system of curriculum, teaching and assessment
Quality teacher-child interactions focused on learning
Formative assessments used to inform teaching
Professional development system that is comprehensive and connected
Data-driven decision making at every level (teaching, PD, program policy)
© Bill & Melinda Gates Foundation

10. Evidence-Based Innovation and Improvement
Kim Boller, Mathematica

11. What Works Clearinghouse
What evidence-based solutions exist in pre-K? What do we do in the absence of evidence?
What Works Clearinghouse
25 pre-K (ages 3-5) interventions/practices with studies that met standards (16 have positive impacts)
Alternatives include evidence-based innovation and improvement
Collaborative approach adapts Institute for Healthcare Improvement methods (Plan, Do, Study, Act)
Draws from the National Implementation Research Network’s Active Implementation Framework

12. Evidence-Based Innovation and Improvement: The Fresno Language Project Kimberly Boller Mathematica Policy Research Early Learning Lab Christine Sciarrino Early Learning Lab
Center for Improving Research Evidence Forum Mathematica Policy Research October 6, 2016 Washington, DC

13. The Early Learning Lab
Catalyzes innovation and learning to support great teaching and caregiving for all young children 
Uses approaches from manufacturing, behavioral health, and rapid cycle evaluation
Works collaboratively with program leaders, teachers, intervention developers, experts, families, and others in implementation teams to put new/improved interventions into the pre-K pipeline

14. The Starting Smart and Strong Initiative Developing Scalable Solutions
10-year Packard school readiness initiative
Fresno, Oakland, and Santa Clara
The Lab’s role
Co-design of district-led innovation/improvement
Support for implementation
Facilitation of ongoing learning

15. Fresno Language Project
Fresno Unified School District identified 4th grade English proficiency and home language development as issues for improvement
No evidence-based intervention in pre-K settings available to meet district needs
Lab co-facilitated development of logic model, expert input, innovation development, plan for small- scale implementation, coaching, data planning 
launch of learning collaborative using more formal learning and scaling approach

16. Early Learning Lab’s District-led Collaborative
PROJECT CYCLE 1
(Daily & Weekly Feedback Loop)
PROJECT CYCLE 2
(Daily & Weekly Feedback Loop)
PROJECT CYCLE 3
(Daily & Weekly Feedback Loop)
Implementation Team
Local Project Practitioners
Plan Do
Study
Act
Plan Do
Study
Act
Plan Do
Study
Act
The Lab/Early Learning Director/
Technical Assistant
Learning & Scaling Collaborative
Implementation Team
Learning & Scaling Meeting
Learning & Scaling Meeting
Program Evaluators
District/Community Leaders
Fall
Winter
Spring

17. Co-created, Evidence-informed Approaches
Highly engaging for teachers and community partners
Potential for better fit and take up by users
Synthesizes knowledge and learning from the field, providing tools and building networks for engagement and learning
Data-driven
Requires evaluation once solutions are solidified
Enriches intervention pipeline
Variation on a number of existing efforts

18. Administration for Children & Families
Discussant
Shannon Rudisill
Administration for Children & Families

19. Maryland House of Delegates
Discussant
Anne Kaiser
Maryland House of Delegates

20. Webinar audience: Submit questions through Q&A widget
Kim Boller, Mathematica
Jennifer Brooks, Bill & Melinda Gates Foundation
Anne Kaiser, Maryland House of Delegates
Shannon Rudisill, Administration for Children & Families
Webinar audience: Submit questions through Q&A widget

21. For More Information
Mathematica’s Center for Improving Research Evidence
Ann Person, Director