COLLEGE OF EDUCATION & HUMAN DEVELOPMENT Measuring Teacher Science Knowledge Tom Tretter University of Louisville

Slides:

Advertisements

Similar presentations

Computer-Based Performance Assessments from NAEP and ETS and their relationship to the NGSS Aaron Rogat Educational Testing Service.

Advertisements

Tools for Schools: Developing End- of-Course Assessments Statewide Scott Cook, ISAT Coordinator Rob Sauer, Deputy Superintendent of Innovation and Choice.

SECONDARY ASSESSMENT Middle School  Acuity Predictive  SMART Goal Assessment  Common Assessment  SRI ( Communication Arts)  STAR Math.

CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction California Educational Research Association (CERA) December.

ESTEEMS (ESTablishing Excellence in Education of Mathematics and Science) Project Overview and Evaluation Dr. Deborah H. Cook, Director, NJ SSI MSP Regional.

A Presentation of the New Hampshire State Task Force on Mathematics Instruction Report to the State Board of Education, March 2012 Patty Ewen (603)

Brian Roget – Assistant Director Assessment Development and Construction Mathematics and Science Office of Curriculum and Assessment October 12, 2011.

Honors Level Course Implementation Guide Science.

Learning Goals, Scales and Learning Activities

Jefferson County Public Schools University of Louisville.

Proposal Writing.

Assessment Literacy Series

Standards Aligned System April 21, 2011 – In-Service.

Next Generation Science Standards Update Cheryl Kleckner Education Specialist.

Supporting the CCSS in the Science Classroom through the Science and Engineering Practices of the Next Generation Science Standards (NGSS) John Spiegel.

1 Developing an Evaluation Plan _____________________ The Mathematically- Connected Communities MSP Developed for the February, MSP Conference Dr.

Project P.O.S.T. Preparing Outstanding Science Teachers A Partnership of GCS & UNCG A Partnership of GCS & UNCG.

Department of Physical Sciences School of Science and Technology B.S. in Chemistry Education CIP CODE: PROGRAM CODE: Program Quality Improvement.

Experiences and requirements in teacher professional development: Understanding teacher change Sylvia Linan-Thompson, Ph.D. The University of Texas at.

“Teaching Electricity and Circuits Through Inquiry” Shawna Young EdTech Leaders Online.

IB Exam Review: Paper 1 and Paper 2. PAPER 1 Test Day Specifics Paper 1 is worth 40% of your total IB Grade. Paper 1 is 1 ½ hours long Paper 1 is divided.

MULTIPLE MEASURES What are they… Why are they… What do we do… How will we know… Dr. Scott P. Myers KLFA Wednesday, August 28, 2013.

Cutler Middle School February 4, 2014 Cutler Middle School February 4, 2014.

PSSA Science Fall 2008 Sunny Minelli Weiland What do you know about Science Assessment Anchors and Assessment? What are your pressing questions? Questions.

Measuring Changes in Teachers’ Science Content Knowledge Dr. Anne D’Agostino Compass Consulting Group, LLC.

Looking Beneath the Surface What we can learn from the Minnesota TIMSS Science Results William H. Schmidt Michigan State University.

Reaching for Excellence in Middle and High School Science Teaching Partnership Cooperative Partners Tennessee Department of Education College of Arts and.

An Introduction to Florida’s new K-12 Science Standards Bringing K-12 Science Education into the 21st Century.

Establishing a Culture of Mathematics Learning in Urban Schools Syracuse City School District / Syracuse University Partnership Beyond Access to Math Achievement.

Connecticut State Department of Education Bureau of Curriculum & Instruction CONNECTING WITH THE NEW CORE SCIENCE CURRICULUM FRAMEWORK CORE SCIENCE CURRICULUM.

THE DRAGON CONNECTION March Who are we?  Jefferson City Schools  Small, rural school district 60 miles north of Atlanta, 18 miles north of the.

The Science Content, Conceptual Change, and Collaboration (SC4) Mathematics and Science Partnership - Maine U.S. Department of Education MSP Regional Meeting.

Longitudinal Study to Measure Effects of MSP Professional Development on Improving Math and Science Instruction.

U.S. Department of Education Mathematics and Science Partnerships: FY 2005 Summary.

Chapter 8 Assessing Active Science Learning

November 2006 Copyright © 2006 Mississippi Department of Education 1 Where are We? Where do we want to be?

Welcome to Project PRIME/AFA Day 1 – Project Overview December 14, 2011.

Mid-State Mathematics Partnership Excellence in Teaching and Learning in Middle Schools Dovie Kimmins, Ed.D. E. Ray Phillips, Ph.D. Tennessee Mathematics,

W HAT IS A C URRICULUM T OPIC S TUDY ? Acronym CTS Process used to inform you before you plan an actual unit/lesson or syllabus. Process used to help plan.

STUDENT GROWTH UPDATE LEARNING GOALS FOR TODAY - Teachers will be able to clearly delineate between the 4 levels of expectations on student.

1. An Overview of the Standards for School Mathematics? 2.

Oregon’s Core Standards and Assessment Standards & Assessment Task Force March 20, 2008.

PRIMES Partnerships and Research Investigations with Mathematicians, Engineers, and Scientists Professional Development Model MSP Regional Meeting February.

Arkansas Capacity Building Science Partnership Grant: Beyond Traditional Professional Development Models 2008 Math Science Partnership Regional Conference.

Heather Click-Cuellar KSDE Science Consultant Kansas Science Update KSDE Fall Assessment Conference.

Race to the Top General Assessment Session Atlanta, Georgia November 17, 2009 Louis M. (Lou) Fabrizio, Ph.D. Director of Accountability Policy & Communications.

Race to the Top Assessment Program: Public Hearing on High School Assessments November 13, 2009 Boston, MA Presenter: Lauress L. Wise, HumRRO Aab-sad-nov08item09.

Common Core Standards English Language Arts 1. Overview of the Initiative o State-led and developed Common Core Standards for K-12 in English Language.

South Jersey Math/Science Partnership at Rowan University Dr. Eric Milou Dr. Jill Perry SJMP.

ANALYSIS AND ATTRIBUTES OF APPROPRIATE ASSESSMENTS Coastal Carolina University.

Race to the Top Assessment Program: Public Hearing on Common Assessments January 20, 2010 Washington, DC Presenter: Lauress L. Wise, HumRRO Aab-sad-nov08item09.

Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.

MSP Program Evaluation Carol L. Fletcher, Ph.D. TRC Project Director Meetings 1/27/09 and 2/5/09 Carol L. Fletcher, Ph.D. TRC Project Director Meetings.

AIM: K–8 Science Iris Weiss Eric Banilower Horizon Research, Inc.

+ Using Simulations to Engage Students in Inquiry on Tough Concepts Candy Ellard and Elyse Zimmer UTeach Natural Sciences Program University of Texas at.

SIP Learning Goals and Assessment AUGUST, Step 0 Learning Goal/ Pre-Assessment.

CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction Riverside COE November 21, 2014 Gina Koency Senior Assessment.

1 Teacher Evaluation Institute July 23, 2013 Roanoke Virginia Department of Education Division of Teacher Education and Licensure.

Next Generation Iowa Assessments.  Overview of the Iowa Assessments ◦ Purpose of Forms E/F and Alignment Considerations ◦ Next Generation Iowa Assessments.

CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.

Terra Nova By Tammy Stegman, Robyn Ourada, Sandy Perry, & Kim Cotton.

2011 Science ISAT Grades 4 and 7.

Next Generation Iowa Assessments

Preliminary Data Analyses

Evaluation of An Urban Natural Science Initiative

2011 Science ISAT Grades 4 and 7.

Melanie Taylor Horizon Research, Inc.

Brian Gong Center for Assessment

Assessment Literacy: Test Purpose and Use

Alignment of curriculum, instruction and classroom assessments

Presentation transcript:

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT Measuring Teacher Science Knowledge Tom Tretter University of Louisville

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT DTAMS STRUCTURE BREADTH (Physical Sci. example)  Matter  Motion & Forces  Energy  STS DEPTH  Declarative  Inquiry  Schematic  Pedagogical Diagnostic Teacher Assessments in Mathematics & Science (DTAMS) Available for Physical, Life, Earth Science

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT DTAMS CHARACTERISTICS  Targets middle school teacher knowledge (multiple choice & open response formats)  Samples across a broad spectrum of content within a domain (e.g. physical)  Validity: Based on synthesis of content from NSES, Benchmarks, TIMSS, NAEP, NSTA  Validity: Items reviewed by national sample of scientists, teachers, science educators  Reliability: Cronbach alpha > 0.81 (n=1790)  An assessment option for teacher science knowledge available on the MSP reporting site

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT EXAMPLE ASSESSMENT USE  Spans spectrum of physics topics  Focuses on deep conceptual understanding of underlying principles  Content organized around applications to how things work  Incorporates appropriate pedagogical techniques as mode of content delivery Physics for Teachers: How Things Work

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT EXAMPLE ASSESSMENT USE Subscale (pts. possible) Pre Post Total (35)18.63 (4.76)27.3 (6.34) *** Depth of Knowledge Subscales Declarative (5)3.70 (0.95)3.96 (1.16) Inquiry (5)3.26 (0.94)2.85 (1.38) Schematic (15)8.15 (2.46)12.1 (2.85) *** Pedagogical (10)3.52 (2.08)8.37 (1.86) *** Breadth of Knowledge Subscales Matter (6)4.11 (1.09)4.78 (1.25) * Motion & Forces (6)3.89 (0.97)4.44 (1.37) Energy (13)7.11 (2.19)9.70 (2.60) *** STS (5)2.33 (1.30)3.70 (1.27) *** Note. Data are mean (standard deviation) of the various subscales, but subscales cannot be directly compared because the total points vary across subscales. *p<.05. **p<.01. *** p<.001. Results - Growth in Physical Science Scores (n=27)

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT POSSIBLE REASONS FOR POSITIVE RESULTS  Sustained involvement (45 contact hours over course of a semester)  Alignment of PD approach with assessment foci (broad coverage, conceptual understanding, pedagogy)  Importance of assessment to teachers (part of final exam grade)

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT LIMITATIONS  Sampling of content is limited  Targets middle school teacher knowledge  Open response introduces some score variability

COLLEGE OF EDUCATION & HUMAN DEVELOPMENT DISCLAIMER The instructional practices and assessments discussed or shown in this presentation are not intended as an endorsement by the U.S. Department of Education.