Electronic Quality of Inquiry Protocol (EQUIP): Assessing the Quality of Inquiry- Based Instructional Practice ASTE 2009 Jeff C. Marshall.

Slides:



Advertisements
Similar presentations
By: Edith Leticia Cerda
Advertisements

Performance Assessment
The Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI): A Cross-Cultural Validation Anita Welch, Claudette Peterson, Chris Ray,
Action Research Project By Sohayla M. Lajevardi 2013.
Jeff C. Marshall, PhD Clemson University ASTE Paper Presentation January, 2011.
Materials Support Assessment Professional Development Community/ Administrative Involvement Curriculum Materials Science: It’s Elementary Bringing science.
MEASURING TEACHING PRACTICE Tony Milanowski & Allan Odden SMHC District Reform Network March 2009.
Marzano Causal Teacher Evaluation Model
RESA Standards 2015 Revised Standards for District and School Effectiveness.
Instrument Development for a Study Comparing Two Versions of Inquiry Science Professional Development Paul R. Brandon Alice K. H. Taum University of Hawai‘i.
National Science Standards  Teachers of science plan an inquiry-based science program for their students.
Comparing the Effects of Two Versions of Professional Development on Science Curriculum Implementation and Scaling-Up Session
Copyright © 2012 Assessment and Accountability Comprehensive Center & North Central Comprehensive Center at McRel.
1 Welcome back!. Vision for Science Teaching and Learning 2 View free PDF from The National Academies Press at *Will also be posted.
Chapter 10 Assessing Active Science Learning. How to Read This Chapter Assessment is presented from three contexts: the classroom context, assessment.
Complete Project Template “Here’s my Title!” School: Grade/Grade Band: Time Frame: Team Members/Content Areas:
Construct Validity of Classroom Observations: Items, Factors, Raters, and Achievement Lee Branum-Martin, Coleen D. Carlson, Angelia Durand, Christopher.
Information on New Regents Examinations for SCDN Presentation September 19, 2007 Steven Katz, Director Candace Shyer, Bureau Chief Office of Standards,
Evaluating Student Growth Looking at student works samples to evaluate for both CCSS- Math Content and Standards for Mathematical Practice.
Conducting a Needs Assessment By: Josh Dill & Shannon Tracy.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
NYSS AAPT/APS Spring 2004 Symposium The Reformed Teaching Observation Protocol (RTOP) in Physics Classes Daniel MacIsaac & Kathleen Falconer SUNY-Buffalo.
Project Director – Dr. Mark Lung Dept of Natural & Environmental Sciences Western State College of Colorado Project Evaluator – Dr. Dave Shannon Educational.
E.N.V.I.S.I.O.N.S. Educational Network Venture into Science/Math Instruction, Outreach, and North Carolina Standards Ken Reddic, Grant Director Michael.
Factor validation of the Consideration of Future Consequences Scale: An Assessment and Review Tom R. EikebrokkEllen K. NyhusUniversity of Agder.
TEA Science Workshop #1 September 27, 2012 Kim Lott Utah State University.
The Use of Distance Learning Technology by Business Educators for Credentialing and Instruction Christal C. Pritchett, Ed.D. NABTE Research Session Anaheim,
TOWARD A VALIDATED MEASURE OF TEACHER/COACH ROLE CONFLICT Thomas J. Templin Purdue University Department of Health and Kinesiology Chantal Levesque-Bristol.
Jeff C. Marshall, PhD Clemson University Noyce Conference, 2012.
LANSING, MI APRIL 11, 2011 Title IIA(3) Technical Assistance #2.
Characterizing Noyce Scholars Physics Classrooms Using RTO P Joseph L. Zawicki, Kathleen Falconer, Dan MacIsaac, Catherine Lange, Griffin Harmon SUNYBuffalo.
The Creation, Validation, and Reliability Associated with the EQUIP: A Measure of Inquiry- Based Instruction Jeff C. Marshall Clemson University NARST.
Inquiring Minds Want to Grow: Building Intentional Practice Jeff C. Marshall Clemson University NSTA Presentation March, 2010.
Four Steps for Improving Inquiry- Based Teaching and Learning Jeff C. Marshall Clemson University 2009 NSTA Presentation.
ASSESSMENT LITERACY PROJECT Kansas State Department of Education Introduction and Overview Welcome !
South Jersey Math/Science Partnership at Rowan University Dr. Eric Milou Dr. Jill Perry SJMP.
University of Colorado, Boulder
FIRST II: A Model for Facilitating Change Diane Ebert-May 1 Jan Hodder 2 Debra Linton 3 1 Department of Plant Biology, Michigan State University 2 Oregon.
111 MakingConnections Focus on Assessment. 222 Facilitator/s: Date:
CJT 765: Structural Equation Modeling Class 8: Confirmatory Factory Analysis.
ASTE Session: EQUIPping Teachers to Achieve Meaningful Inquiry- based Teaching and Learning Jeff C. Marshall Clemson University 2010 NSTA Presentation.
Mathematics Performance Tasks Applying a Program Logic Model to a Professional Development Series California Educational Research Association December.
University of Alberta Fall 2013 The Reformed Teaching Observation Protocol (RTOP) Kathleen Falconer SUNY-Buffalo State College.
AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.
Dissemination within and between Institutions Faculty Need to Change Workshops Team Structure Faculty Recognition and Rewards Abstract Faculty Institutes.
FA#1 - Science Class Observation & Analysis - Overview—  In this field assignment you will be observing a science class conducted by your field teacher.
This video is for UNC Charlotte faculty developing a response form as part of the content validity protocol. The response form is what expert reviewers.
Rubrics, and Validity, and Reliability: Oh My! Pre Conference Session The Committee on Preparation and Professional Accountability AACTE Annual Meeting.
Evidence… Policy Institutional Support and Facilitation Need to Change Learning and Implementing New Practices Facilitating the Learning and Implementation.
Why a writing plan? Consistency among k-12 writing instruction Need to address state expectations for writing Data indicated very few students were exceeding.
Northwest Evaluation Association – Measure of Academic Progress.
 Rubrics promote student performance and encourage reflective teaching practices (Beeth et al.,2001; Luft, 1998)  Consistent rubric use in the classroom.
4:00 – 4:05pm Welcome and Introductions 4:05 – 4:20pm Ice Breaker 4:20-4:30 pm Norms 4:30 – 5:00pm Journaling 5:00 – 5:30 pm Enquiry activity stations.
Sampling of Topics for this Semester Do you believe that………..?
CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.
“Peer Teaching Observations: Building Learning Communities” David A. Yopp Associate Professor of Mathematics Education Department of Mathematics & Department.
CAEP Standard 4 Program Impact Case Study
Jeff Marshall Clemson University SC2 Conference—Nov
The RTOP and its Role Improving Physics Teaching
Reliability and validity of the BREQ-2 for measuring high school students’ motivation for physical education Stuart Forsyth¹, David Rowe¹, and Nanette.
Melanie Taylor Horizon Research, Inc.
Shudong Wang NWEA Liru Zhang Delaware Department of Education
Dr. Chin and Dr. Nettelhorst Winter 2018
Measuring Teaching Practices
Measuring Teachers’ Fidelity of Implementation
Maureen Capone, RDH, MS Farmingdale State College
Confirmatory Factor Analysis
Dept. of Science & Technology Education
Project: Assessing Teacher Learning About Science Teaching (ATLAST)
CSIP/Landtrust
Presentation transcript:

Electronic Quality of Inquiry Protocol (EQUIP): Assessing the Quality of Inquiry- Based Instructional Practice ASTE 2009 Jeff C. Marshall

Status of Inquiry-Based Instruction Teachers know it is important Some try However, many find it difficult to implement PD facilitators need formative guide Teachers need way to self-monitor performance

Need The Call: Inquiry should be a central tenet of sound instructional practice (AAAS, 1993, 1998; Bransford, Brown, & Cocking, 2000; Llewellyn, 2002; NCTM, 1991, 2000; NRC, 1996, 2000). Teacher Perceptions: Teachers believe that they are spending 38.7% of their time on inquiry-based instruction (Marshall, Horton, Igo, and Switzer, In Press). Teacher Ideals: Teachers see that they should ideally be devoting about 57.3% of their time leading inquiry based instruction (Marshall, Horton, Igo, and Switzer, In Press). Overall Quality: The perception is high yet the quality is low—inquiry is often mistaken for activities (Moscovici & Holdlund-Nelson, 1998).

Some Other Protocols Inside the Classroom Observational Protocol (Horizon Research, 2002) Reformed Teaching Observation Protocol, R- TOP (Sawada et al., 2000) Science Management Observation Protocol, SMOP, (Sampson, 2004) Science Teacher Inquiry Protocol, STIR (Beerer & Bodzin, 2003)

Development of EQUIP Protocol Began with variation of R-TOP and Inside the Classroom Field Tested Moved away from Likert Scale to Descriptive Rubric Tested Reliability (Inter-rater and Item) Field Tested Conducted Confirmatory Factor Analysis Field Testing Current Version

Reliability and Validity Face Validity—seven member team Internal Consistency—n = 102 (  -value ranged from before CFA to after) Inter-rater reliability—16 paired observations (Cohen’s  scores ranged from ) Content Validity (see paper) Construct Validity—CFA run (  2/ /df  2 indicates reasonable fit (Kline, 2005), RMSEA of.1 is on the threshold of reasonable fit (Browne & Cudeck, 1993), SRMR.90 is considered a good fit (Hu & Bentler, 1999) )

Confirmatory Factor Analysis Began with 3 factors (instruction, curriculum, & ecology) with 26 total indicators CFA showed 4 factors (19 total indicators) loaded better (instruction, discourse, assessment, & curriculum)

Sample to Illustrate Time Usage Factors

Sample of Instructional Factors Associated with Inquiry-Based Instruction

Sample of Discourse Factors Associated with Inquiry-Based Instruction

Sample of Assessment Factors Associated with Inquiry-Based Instruction

Sample of Curriculum Factors Associated with Inquiry-Based Instruction

EQUIP Summary Reliable and valid measure Valuable measure of inquiry-based instruction –Instruction –Discourse –Assessment –Curriculum Useful for practitioners, PD facilitators, and in- service preparation

More Information Jeff C. Marshall Website: