DR-K12 PI Meeting Building the Knowledge Base of Teacher Learning in STEM Education A Framework and Suite of Adaptable Instruments for Examining Fidelity of Implementation Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago November 9th, 2009
Why measure Fidelity of Implementation (FOI)? Determine if programs are effective Determine which parts of programs are effective Determine why and under what conditions parts of programs are effective
Challenge s Instruments that could be used across multiple programs A suite of instruments that could be used alone or in combination depending on resources and goals Provide detailed and specific information about FOI
FOI The extent to which an enacted program is consistent with the intended program model Critical Components The elements of a program model that are essential to its implementation FOI Operationalized The extent to which the critical components of a program are present when the program is enacted Definitions
FOI Framework
FOI Framework and Critical Components
Instruments Teacher Questionnaire Teacher Instructional Observation Protocol Teacher Interview Protocol Teacher Instructional Log Teacher Attitude Questionnaire School Leader Questionnaire School Leader Interview Protocol School-wide Observation Protocol
Programs Science and Technology for Children FOSS SEPUP IES Everyday Mathematics Science Companion
Categories of Differentiation Mathematics And Science Science Only Mathematics Only Program Specific FOI Framework and Differentiation
Categories of Differentiation Common Program A Program B Program C Impact of a single program Compare two or more programs Compare programs to “business as usual” Compare two versions of a program Uses of the Framework and Measures Developers U.S. Satellite, Inc. – additional elements Trailblazers – look at a critical component in more depth Evaluators School–based change model – Lindblom High School Programmatic model – E2SP
Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago FOI Supplement Work Researchers Without Borders Resources FAQs; Research; Tools and Instruments Learning Webinars; Collaboration Community Development Ning (researcherswithoutborders.ning.com); In-Person Meeting