AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.

Slides:



Advertisements
Similar presentations
Professional Development Supporting Teachers in Developing Technology Pedagogical Content Knowledge (TPCK) Abstract Research is needed to identify and.
Advertisements

Providing On-going Support for STEM Teachers Joan D. Pasley Horizon Research, Inc.
Assessing Science PCK of Technology Educators Tyler S. Love.
Designs to Estimate Impacts of MSP Projects with Confidence. Ellen Bobronnikov March 29, 2010.
ESTEEMS (ESTablishing Excellence in Education of Mathematics and Science) Project Overview and Evaluation Dr. Deborah H. Cook, Director, NJ SSI MSP Regional.
Building the Continuum: Beginning Teacher Research Julie Luft Arizona State University.
IV Ca MSP: The Next Frontier in Professional Development Thursday, February 14, 2008 San Francisco, CA.
Formative and Summative Evaluations
PISA Partnership to Improve Student Achievement through Real World Learning in Engineering, Science, Mathematics and Technology.
What is program success? Wendy Tackett, Ph.D., Evaluator Valerie L. Mills, Project Director Adele Sobania, STEM Oakland Schools MSP, Michigan.
Evaluation 101 Everything You Need to Know to Get Started Evaluating Informal Science Education Media Everything You Need to Know to Get Started Evaluating.
What We Know About Effective Professional Development: Implications for State MSPs Part 2 Iris R. Weiss June 11, 2008.
IES e-PATT Grant e-PATT: Parents and Teachers Together.
COPYRIGHT WESTED, 2010 Calipers II: Using Simulations to Assess Complex Science Learning Diagnostic Assessments Panel DRK-12 PI Meeting - Dec 1–3, 2010.
(MSP) 2 : Minority Student Pipeline, Math Science Partnership Strengthening the Early-College Minority Student Pipeline in Science with a Multi-Faceted.
1 Developing an Evaluation Plan _____________________ The Mathematically- Connected Communities MSP Developed for the February, MSP Conference Dr.
Project P.O.S.T. Preparing Outstanding Science Teachers A Partnership of GCS & UNCG A Partnership of GCS & UNCG.
Professional Development Activity Log: Comparing Teacher Log and Survey Approaches to Evaluating Professional Development AERA Annual Meeting Montreal,
Math Liaison Meeting September 2014 Presenter: Simi Minhas, Math Achievement Coach Network 204.
Math Science Partnership Excellence In Mathematics Lanakila Elementary School Honolulu, HI.
PSSA Science Fall 2008 Sunny Minelli Weiland What do you know about Science Assessment Anchors and Assessment? What are your pressing questions? Questions.
Measuring Changes in Teachers’ Science Content Knowledge Dr. Anne D’Agostino Compass Consulting Group, LLC.
Establishing a Culture of Mathematics Learning in Urban Schools Syracuse City School District / Syracuse University Partnership Beyond Access to Math Achievement.
MSP PROJECT EVALUATION Lessons Learned Margaret Phelps & Kenneth W. Hunter, Sr. January 8, 2008 Millard Oakley STEM Center.
Frances Lawrenz and The Noyce evaluation team University of Minnesota 1 Acknowledgement: This project was funded by National Science Foundation (Grant#REC )
Professional Development Activity Log: A New Approach to Design, Measurement, Data Collection, and Analysis AERA Annual Meeting San Diego April 13, 2004.
Project Director – Dr. Mark Lung Dept of Natural & Environmental Sciences Western State College of Colorado Project Evaluator – Dr. Dave Shannon Educational.
Scientific Validation Of A Set Of Instruments Measuring Fidelity Of Implementation (FOI) Of Reform-based Science And Mathematics Instructional Materials.
E.N.V.I.S.I.O.N.S. Educational Network Venture into Science/Math Instruction, Outreach, and North Carolina Standards Ken Reddic, Grant Director Michael.
Ensuring that Professional Development Leads to Improved Mathematics Teaching & Learning Kristen Malzahn Horizon Research, Inc. TDG Leadership Seminar.
1 PD3 P rofessional D evelopment D ecisions Using D ata.
Mathematics and Science Partnerships: Summary of the Performance Period 2008 Annual Reports U.S. Department of Education.
Lessons Learned about Going to Scale with Effective Professional Development Iris R. Weiss Horizon Research, Inc. February 2011.
Math and Science Partnership Program Approaches to State Longitudinal Evaluation March 21, 2011 San Francisco MSP Regional Meeting Patty O’Driscoll Public.
PRIMES Partnerships and Research Investigations with Mathematicians, Engineers, and Scientists Professional Development Model MSP Regional Meeting February.
WORKING TOGETHER TO IMPROVE SCIENCE EDUCATION PRESENTED BY GIBSON & ASSOCIATES A CALIFORNIA MATH AND SCIENCE PARTNERSHIP RESEARCH GRANT WISE II Evaluation.
Research and Evaluation Team Lines of Work Andy Porter, Director Building a Partnership – Susan Millar District Case Studies – William Clune Targeted Studies.
Evaluation of the Noyce Teacher Scholarship Program 2010 NSF Noyce Conference Abt Associates Inc. July 9, 2010.
Local Evaluation Overview and Preliminary Findings Diane Schilder, EdD.
The Evaluation of Mathematics and Science Partnerships Program A Quasi Experimental Design Study Abdallah Bendada, Title II Director
Introduction to Surveys of Enacted Curriculum Presentation: Introduce SEC to Educators [Enter place and date]
Mathematics and Science Partnerships: Summary of the Performance Period 2008 Annual Reports U.S. Department of Education.
South Jersey Math/Science Partnership at Rowan University Dr. Eric Milou Dr. Jill Perry SJMP.
Passport to Science MSP Science Program Indianapolis Public Schools.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
Education Performance Measures Session. Session Overview Combination of presentation and interactive components Time at the end of the session for Q&A.
MSP Program Evaluation Carol L. Fletcher, Ph.D. TRC Project Director Meetings 1/27/09 and 2/5/09 Carol L. Fletcher, Ph.D. TRC Project Director Meetings.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Mathematics Performance Tasks Applying a Program Logic Model to a Professional Development Series California Educational Research Association December.
Project Evaluation for MSP Targeted Partnerships Eric R. Banilower Horizon Research, Inc.
COLLEGE OF EDUCATION & HUMAN DEVELOPMENT Measuring Teacher Science Knowledge Tom Tretter University of Louisville
MSP Regional Meeting February 13-15, 2008 Calli Holaway-Johnson, Ph.D. Charles Stegman, Ph.D. National Office for Research on Measurement and Evaluation.
Educational Psychology Jeanne Ormrod Eighth Edition © 2014, 2011, 2008, 2006, 2003 Pearson Education, Inc. All rights reserved. Developing Learners.
Student Growth Developing Quality Growth Goals STEPS Teacher Professional Growth & Effectiveness System (TPGES)
CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.
MSP Summary of First Year Annual Report FY 2004 Projects.
MSP Evaluation in the Far North Evaluator Collaboration Evaluation Design Action Research Studies.
Preparing to Facilitate Mathematics Professional Development: Aiming for Alignment Between the Program and the Facilitator Nanette Seago Karen Koellner.
Preparing Facilitators to Use and Adapt Video-Based Professional Development Materials with Fidelity Nanette Seago WestEd, Redwood City, CA Karen Koellner.
Research and Evaluation
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Interview Responses: Job Satisfaction
Assessments for Monitoring and Improving the Quality of Education
Melanie Taylor Horizon Research, Inc.
Governor’s Teacher Network
Teaching and Educational Psychology
Project: Assessing Teacher Learning About Science Teaching (ATLAST)
Information July 15, 2015.
distinct characteristics and properties
Evaluating the relationship between intensity of teacher professional development and student achievement in a Northern New Mexico inquiry-based science.
Presentation transcript:

AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.

MSP Theory of Action (Big Picture)

AIM: K–8 Science AIM is an NSF-funded MSP RETA AIM has the opportunity to develop instruments and collect data that no single MSP project has the resources to do.

Study Component 1

Study Component 2

Topics 1. Force and Motion 2. Populations and Ecosystems (i.e., Interdependence) 3. Climate and Weather 4. Evolution and Diversity 5. Forms of Energy 6. Properties of and Changes in Matter

Instruments Professional Development

PD-Provider Log Capture what teachers experience in PD. PD providers complete a log at the end of each day of PD. 15 minutes or fewer to complete. Honorarium of $15 per completed log

PD Observations HRI will observe a sample of PD sessions.

Teacher Tracking System In addition to knowing what happens in PD, AIM needs to know which teachers attended each session.

Teacher and Student Assessments Each assessment will take about 30 minutes to administer (all multiple choice). All teacher assessment items are set in the context of work that teachers do, e.g., using content knowledge to analyze student thinking.

Instruments Classroom Practice

1. Teacher questionnaire Instructional practices Beliefs about effective instruction Teacher efficacy Contextual factors that affect science instruction 2. Classroom observations Only for a subset of teachers

Timeline Teacher assessments for Force and Motion; Populations and Ecosystems by summer Student assessments for these two topics ready for use in the academic year. Data collection will begin in summer 2010.

Timeline Assessments for other topics will be ready the following year. We anticipate data collection continuing through at least the academic year.

Re-Cap: Two Main Components 1. Relationship between PD and teacher knowledge. 2. Relationships among teacher knowledge, beliefs, classroom practice, and student learning. Projects can participate in either or both components for one or more topics.

What’s Required to Participate Component 1:  Complete PD-provider logs  Submit teacher tracking data  Administer content assessment to teachers pre- and post-PD  Allow PD to be observed

What’s Required to Participate Component 2:  Administer content assessment to teachers prior to their teaching of the unit on targeted topic If teacher is participating in Component 1, the post-PD assessment may be used  Administer student content assessment at the beginning and end of unit on targeted topic  Administer teacher questionnaire Teachers complete while students are doing their post- test

What Do Projects Gain by Participating? Opportunity to contribute to knowledge generation that will help the field in the future. Additional data for project-specific studies:  PD-provider log data;  Teacher assessment data;  Teacher questionnaire data; and  Student assessment data.

We are looking for a set of projects that vary in their approaches to professional development and that have different school contexts. We will try to include as many projects as possible in the study, but need to make sure we get the right mix.

How to Contact Us If you might be interested in participating: How to contact AIM:

Also of Possible Interest MSP-KMD has also developed a series of “knowledge reviews” that share research findings and practice-based insights:  Deepening teacher content knowledge  Preparing and deploying teacher leaders  Involving STEM faculty

Also of Possible Interest MSP-KMD has developed a searchable, on- line, database with information about instruments used to assess teacher content knowledge (mathematics and science, K–12).

Can Search By: Content area Grade levels Nature of instrument, e.g.,  Any multiple-choice/constructed response assessments  Assessments that include a scale score with information about reliability and validity  Interview protocols  Observation protocols

The database currently contains summaries of 113 instruments, about 40 more to be added shortly.

These resources are located at:

Disclaimer The instructional practices and assessments discussed or shown in this presentation are not intended as an endorsement by the U. S. Department of Education.