DR-K12 PI Meeting Building the Knowledge Base of Teacher Learning in STEM Education A Framework and Suite of Adaptable Instruments for Examining Fidelity.

Slides:



Advertisements
Similar presentations
Progress Towards Reading Success: The Reading First Evaluation Prepared by: Amy Kemp, Ph.D. Research Associate and Patricia A. Muller, Ph.D. Associate.
Advertisements

Professional Learning Communities Connecting the Initiatives
Implementation of the PA Core Standards. Effective Communication Guiding Principle 1 Design and establish systems of effective communication among stakeholders.
Research and Impact The WaterBotics ® evaluation and research studies include two synergistic, but distinct, domains: educational impact and scale-up/sustainability.
Collaborative Evaluation Communities in Urban Schools.
Powerful Teaching and Learning Duane Baker. Goal Explore the research behind Powerful Teaching and Learning™ and practice using the STAR Classroom Observation.
Elementary Literacy Audit Kindergarten – 5th Grade
2011 – 2012 Phase I. WELCOME! Guest Presenter: Kristy Casiello
© 2014, Florida Department of Education. All Rights Reserved. Defining STEM Elements of STEM Schools Dr. JP Keener.
Program Ownership Inspires Self-Reflection Kirk Minnick, TxCETP Evaluator Kit Price Blount, TxCETP PD Teacher Prep PI Meeting Alexandria, VA March 14,
Examining Coaching in Elementary (K-8) Mathematics Classrooms ECEMC An NSF Discovery and Research Grant DRK-12.
Iowa Core Alignment of Instructional Content to the Iowa Core Sue Updegraff Keystone AEA.
National Center on Response to Intervention Developed by the National Center on Response to Intervention and RMC Research RTI Integrity Framework: A Tool.
Gifted Program Review Spring Process  In February 2013 a team of 41 individuals met to develop questions: parent, teachers, psychologists and administrators.
Title I Needs Assessment/ Program Evaluation Title I Technical Assistance & Networking Session October 5, 2010.
Identifying critical components To answer “What is the status of implementation of each STEM school’s model and to what extent does the model reflect the.
Report to the Board of Education October 15, 2007.
An Overview of the New HCPSS Teacher Evaluation Process School-based Professional Learning Module Spring 2013 This presentation contains copyrighted material.
Curriculum Renewal: Fidelity of Implementation WERA/OSPI State Assessment Conference— Seattle Airport Hilton December 4, 2008 Peter Hendrickson, Ph.D.
DeAnn Huinker & Kevin McLeod University of Wisconsin-Milwaukee Designing High Quality Professional Development Knowledge, Management, & Dissemination Conference.
1. 2 Why is the Core important? To set high expectations –for all students –for educators To attend to the learning needs of students To break through.
Designing Survey Instrument to Evaluate Implementation of Complex Health Interventions: Lessons Learned Eunice Chong Adrienne Alayli-Goebbels Lori Webel-Edgar.
COMMUNITY OF PRACTICE SESSION STEM Education: Communication Tools and Collaboration Opportunities May 20, /20/11Superintendents Community of Practice.
Kirby School District 140 Everyday Mathematics (EM) and Science Program Research and Evaluation of Mathematics and Science Implementation.
Oregon State Board of Education January 19, 2012.
V Implementing and Sustaining Effective Programs and Services that Promote the Social-Emotional Development of Young Children Part I Karen Blase, Barbara.
Improving Implementation Research Methods for Behavioral and Social Science Working Meeting Measuring Enactment of Innovations and the Factors that Affect.
Examining the Induction of Middle School Mathematics Teachers Kristin L. McGraner Research Associate Peabody College, Vanderbilt University Supported by.
INNOVATIONS IN EDUCATION MEASUREMENTS AND SCOPE Presented By G.GOUTHAMAN PG TEACHER /TECHNICAL SUPPORT GROUP. RMSA, TIRUVARUR.
Inspire the learner; ignite the potential! Welcome! Forest Lake Area School District Staff District In-Service Tuesday, August 26, 2003.
DASA Policy and Practice Conference June 24, 2015.
Scientific Validation Of A Set Of Instruments Measuring Fidelity Of Implementation (FOI) Of Reform-based Science And Mathematics Instructional Materials.
Committee on the Assessment of K-12 Science Proficiency Board on Testing and Assessment and Board on Science Education National Academy of Sciences.
Critical Elements Effective teaching Alignment of curriculum and instruction to standards Instructional program coherence Fidelity of implementation Evaluation.
Council for Exceptional Children/Division of Early Childhood Conference October 2010 Kim Carlson, Asst. Director/619 Coordinator Ohio Department of Education.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
Laying the Foundation for Scaling Up During Development.
A state-wide effort to improve teaching and learning to ensure that all Iowa students engage in a rigorous & relevant curriculum. The Core Curriculum.
Plenary Session 7: Technologies and Principles of Learning in Support of Teaching Delwyn L. Harnisch University of Nebraska, Lincoln.
Math and Science Partnership Program Approaches to State Longitudinal Evaluation March 21, 2011 San Francisco MSP Regional Meeting Patty O’Driscoll Public.
Welcome. MTSS S ESSION 2 I MPLEMENTATION G UIDES Clare-Gladwin RESD January 9, 2014.
Practical Definition of Terms Output Targets What do we want to achieve? Deliverables What do we get? Output Targets – To improve the public speaking skills.
Community Planning Training 5- Community Planning Training 5-1.
Ohio Department of Education March 2011 Ohio Educator Evaluation Systems.
Toni Strieker, Jim Wright, Susan Stockdale Kennesaw State University October 3, 2011.
Researchers Without Borders Webinar 4 A Framework and Suite of Instruments for Examining Fidelity of Implementation Jeanne Century Center for Elementary.
Tuning Indiana: Education. Originally focused on: Elementary education Math education Special education.
MSP Program Evaluation Carol L. Fletcher, Ph.D. TRC Project Director Meetings 1/27/09 and 2/5/09 Carol L. Fletcher, Ph.D. TRC Project Director Meetings.
The Ohio STEM Learning Network: A Study of Factors Affecting Implementation Spread and Sustainability.
Implementing & Evaluating a School RTI Framework Shawna Moran, EII, ODE Odyssey - August 2013.
AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.
Dimensions of Success for STEM Learning (DOS): Observation Tool for Assessing STEM Learning in Out-of-School Time Settings 4H Webinar June 16, 2009.
Quantitative Data Collection Techniques In contrast to qualitative data quantitative data are numerical. Counted, calculated tallied and rated. Also ratings.
Literacy Coach Training Day 1 August 19, Outcomes Teachers will be able to: Understand their role as skillful collaborators in school settings.
Standard Five Teachers reflect on their practice..
Slide 1 Mosby items and derived items © 2006, 2002 by Mosby, Inc. DATA-COLLECTION METHODS Chapter 14.
Jeanne Century CEMSE, University of Chicago NRC Committee on Integrated STEM January 10, 2012 Defining iSTEM.
Aligning Teacher Effectiveness to the Common Core Standards March 7, 2013 Sandra Alberti Student Achievement Partners.
ACS WASC/CDE Visiting Committee Final Presentation Panorama High School March
CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.
Tier 1 Positive Behavior Support Response to Intervention for Behavior Faculty Overview.
MSP Summary of First Year Annual Report FY 2004 Projects.
Preparing Facilitators to Use and Adapt Video-Based Professional Development Materials with Fidelity Nanette Seago WestEd, Redwood City, CA Karen Koellner.
Melanie Taylor Horizon Research, Inc.
مدیریت استراتژیک منابع انسانی پیشرفته
Developing 21st Century Classrooms: Connecting the Dots IV
Measuring Teachers’ Fidelity of Implementation
K–8 Session 1: Exploring the Critical Areas
Fidelity of Implementation in Scaling-up Highly Rated Science Curriculum Units for Diverse Populations Carol O’Donnell and Sharon Lynch The George Washington.
Considering Fidelity as an Element Within Scale Up Initiatives Validation of a Multi-Phase Scale Up Design for a Knowledge-Based Intervention in Science.
Presentation transcript:

DR-K12 PI Meeting Building the Knowledge Base of Teacher Learning in STEM Education A Framework and Suite of Adaptable Instruments for Examining Fidelity of Implementation Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago November 9th, 2009

Why measure Fidelity of Implementation (FOI)? Determine if programs are effective Determine which parts of programs are effective Determine why and under what conditions parts of programs are effective

Challenge s Instruments that could be used across multiple programs A suite of instruments that could be used alone or in combination depending on resources and goals Provide detailed and specific information about FOI

FOI The extent to which an enacted program is consistent with the intended program model Critical Components The elements of a program model that are essential to its implementation FOI Operationalized The extent to which the critical components of a program are present when the program is enacted Definitions

FOI Framework

FOI Framework and Critical Components

Instruments Teacher Questionnaire Teacher Instructional Observation Protocol Teacher Interview Protocol Teacher Instructional Log Teacher Attitude Questionnaire School Leader Questionnaire School Leader Interview Protocol School-wide Observation Protocol

Programs Science and Technology for Children FOSS SEPUP IES Everyday Mathematics Science Companion

Categories of Differentiation Mathematics And Science Science Only Mathematics Only Program Specific FOI Framework and Differentiation

Categories of Differentiation Common Program A Program B Program C Impact of a single program Compare two or more programs Compare programs to “business as usual” Compare two versions of a program Uses of the Framework and Measures Developers U.S. Satellite, Inc. – additional elements Trailblazers – look at a critical component in more depth Evaluators School–based change model – Lindblom High School Programmatic model – E2SP

Jeanne Century Center for Elementary Mathematics and Science Education University of Chicago FOI Supplement Work Researchers Without Borders Resources FAQs; Research; Tools and Instruments Learning Webinars; Collaboration Community Development Ning (researcherswithoutborders.ning.com); In-Person Meeting