1. DR-K12 PI Meeting Building the Knowledge Base of Teacher Learning in STEM Education A Framework and Suite of Adaptable Instruments for Examining Fidelity of Implementation Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago November 9th, 2009

2. Why measure Fidelity of Implementation (FOI)? Determine if programs are effective Determine which parts of programs are effective Determine why and under what conditions parts of programs are effective

3. Challenge s Instruments that could be used across multiple programs A suite of instruments that could be used alone or in combination depending on resources and goals Provide detailed and specific information about FOI

4. FOI The extent to which an enacted program is consistent with the intended program model Critical Components The elements of a program model that are essential to its implementation FOI Operationalized The extent to which the critical components of a program are present when the program is enacted Definitions

5. FOI Framework

6. FOI Framework and Critical Components

7. Instruments Teacher Questionnaire Teacher Instructional Observation Protocol Teacher Interview Protocol Teacher Instructional Log Teacher Attitude Questionnaire School Leader Questionnaire School Leader Interview Protocol School-wide Observation Protocol

8. Programs Science and Technology for Children FOSS SEPUP IES Everyday Mathematics Science Companion

9. Categories of Differentiation Mathematics And Science Science Only Mathematics Only Program Specific FOI Framework and Differentiation

10. Categories of Differentiation Common Program A Program B Program C Impact of a single program Compare two or more programs Compare programs to “business as usual” Compare two versions of a program Uses of the Framework and Measures Developers U.S. Satellite, Inc. – additional elements Trailblazers – look at a critical component in more depth Evaluators School–based change model – Lindblom High School Programmatic model – E2SP

11. Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago jcentury@uchicago.edu www.researcherswithoutborders.org/projects/enactment FOI Supplement Work Researchers Without Borders Resources FAQs; Research; Tools and Instruments Learning Webinars; Collaboration Community Development Ning (researcherswithoutborders.ning.com); In-Person Meeting