An Analysis of NYS Regents Physics Exam Issues J. Zawicki Science Education, BSC STANYS DAL, Physics Mentor.

Slides:

Advertisements

Similar presentations

Modified Achievement Tests for Students with Disabilities: Basic Psychometrics and Group Analyses Ryan J. Kettler Vanderbilt University CCSSO’s National.

Advertisements

First Administration: June 3, 2014 Presented by Brenna Farrell, RCSD.

A Step by Step Guide for Teachers Information from the WSWHE BOCES Assessment Development Workshop Presented August 23, 2012 by Katie Jones and Christine.

1 Performance of English Language Learners on the 2008 Grades 3-8 ELA Tests David Abrams Assistant Commissioner for Standards, Assessment, and Reporting.

1 Academic Performance of English Language Learners on Grades 3-8 ELA Tests (2007 to 2009) David Abrams Assistant Commissioner Office of Standards, Assessment.

OVERVIEW OF NEW YORK STATE SOCIAL STUDIES ASSESSMENTS  Grade 5 Elementary-Level Social Studies Test – administered in November each year  Grade 8 Intermediate-Level.

A controversy in PISA and other large- scale assessments: the trade-off between model fit, invariance and validity David Andrich CEM: 30 years of Evidence.

Faculty Research & Creativity Forum October 30, 2008 D. MacIsaac, Physics J. Zawicki, Earth Sciences and Science Education L. Gomez, Physics SUNY Buffalo.

NYS Assessment Updates & Processes for New Social Studies Regents Exams September 18, 2014 Candace Shyer Assistant Commissioner for Assessment, Standards.

Distributed Scoring of Regents Exams: NYC 2012 Pilots.

New York State Physical Setting: Physics A Review of the June 2006 Exam NYS AAPT Fall Meeting Binghamton, NY J. Zawicki SUNY Buffalo State College T. Johnson.

NSF-Noyce Scholars Partnership of Western NY New Jersey Science Convention, Somerset, New Jersey 06 October 2005 Joseph Zawicki, Department of Earth Science.

What’s left to be done before June! What we need to know! What we already know! 1.

Objective Exam Score Distribution. Item Difficulty Power Item

Assessing the Assessments: Physics An Initial Analysis of the June 2003 NYS Regents Physics Exam J. Zawicki, SUNY Buffalo State College M. Jabot, SUNY.

Analyzing A Discourse-Rich Physics Teaching Sample Video to Inform Your Own Physics Teaching Practice Dan MacIsaac, Ph.D. SUNY- Buffalo State College Dept.

Introduction to the Social Studies Frameworks For O/N BOCES Curriculum Council.

New York State K-12 Social Studies Update Dr. John B. King, Jr. New York State Commissioner of Education President of the University of the State of New.

Up-Date on Science and SS February 2015 Faculty Meeting.

Advanced Placement World History Exploring key themes of world history, including interaction with the environment, cultures, state-building, economic.

Creating a Movement Creating a Movement. Secondary Mathematics News and Next Steps Staff Development Day March 18, 2011.

NYS Middle Level Liaisons Network As representatives of statewide middle level education, our purpose is to advocate for middle level needs, inform SED.

Information on New Regents Examinations for SCDN Presentation September 19, 2007 Steven Katz, Director Candace Shyer, Bureau Chief Office of Standards,

New York State Education Department Understanding The Process: Science Assessments and the New York State Learning Standards.

1 New York State Assessment Transition Plan ELA & Math Revised October 20, New ELA assessments in grades 9 and 10 will begin during the

Webcast April 22, Felicia Cumings Smith Associate Commissioner.

Lansing Central School District District Assessment Results Presentation January 24, 2011 Dr. Stephen L. Grimm, Superintendent District Leadership Team.

WNYPTA - Western New York Physics Teachers Alliance Over 20 Years of Grass-Roots Professional Development Joseph L. Zawicki, Kathleen A. Falconer, David.

Welcome Parents! Ms. Bridget Anderson, Personal Project Coordinator Ms. Kathleen Westrich, MYP Coordinator Mrs. Carol Stein, IB Coordinator Mr. Mike Roemer,

Computation-based versus concept-based test questions: High school teachers’ perceptions Computation-based versus concept-based test questions: High school.

Presentation to the Committee on Teacher Education iRubric January 21, 2010.

City Manager’s Office Approval of Public Monument Policy City Council August 31, 2015 Item 20.

Fall Testing Update David Abrams Assistant Commissioner for Standards, Assessment, & Reporting Middle Level Liaisons & Support Schools Network November.

NYSS AAPT/APS Spring 2004 Symposium The Reformed Teaching Observation Protocol (RTOP) in Physics Classes Daniel MacIsaac & Kathleen Falconer SUNY-Buffalo.

Overview of Step 3: Conceptual Unit Design and Step: 5 Common Formative Assessments April 6, Steve Vaerst & Kathleen Wilson.

DT249/DT249P Induction Evening for new Students September 11 th 2014.

Joseph L. Zawicki 1, Kathleen Falconer 2 and Dan MacIsaac 3 1 Department of Earth Sciences and Science Education, Buffalo State College, Buffalo, New York.

Review and Validation of ISAT Performance Levels for 2006 and Beyond MetriTech, Inc. Champaign, IL MetriTech, Inc. Champaign, IL.

September SCDN: “Making it Up” Introductions.

June  – Last Year  ELA (UPK-9 th Grade)  Mathematics (5 th – Algebra)  – This Year  ELA (10 th Grade)  Mathematics (UPK-4.

August 23, 2011 The Academic Assessment Plan: Improving Student Learning at NWOSU.

InTeGrate Assessment David Steer, University of Akron Ellen Iverson, Carleton College May 2012.

Convergent and Discriminant Validity. The Convergent Principle Measures of constructs that are related to each other should be strongly correlated.

Classroom Diagnostic Tools. Pre-Formative Assessment of Current CDT Knowledge.

Characterizing Noyce Scholars Physics Classrooms Using RTO P Joseph L. Zawicki, Kathleen Falconer, Dan MacIsaac, Catherine Lange, Griffin Harmon SUNYBuffalo.

CF04: Using Assessment Data to Inform Instruction at the Buffalo State College Summer Physics Teachers’ Academy Kathleen Falconer, Department of Elementary.

WNYPTA - Western New York Physics Teachers Alliance Over 20 Years of Grass-Roots Professional Development Joseph L. Zawicki, Kathleen A. Falconer, David.

Using RTOP to Mentor Pre-service and Alternative Certification Candidates Kathleen A. Falconer, Joseph L. Zawicki, Luanna Gomez, Dan MacIsaac, Lowell Sylwester,

NYS Regents Strategies AIM: How do we improve our NYS Global History and Geography Regents Scores? Do Now: Name 2 things you can do to improve your NYS.

The 8 th grade Regents Earth Science Program St. Martin de Porres School.

English Language. Paper 1: Reading (20%) 1hr30mins Part A: Compulsory (middle) Part B: Choose ONE Section 1 (easy) – 1 text Section 2 (difficult) – 2.

Using Formative Assessments to Improve Instruction Part II Angela Stockman Erie 1 BOCES

Statewide Networks of Middle Level Education Liaisons and Support Schools Friday, May 19, :30 a.m. – 9:45 a.m. The New York State Education Department.

L ESSONS FROM THE J UNE 2009 NYS R EGENTS P HYSICS E XAMINATION – N OTES FOR THE C LASSROOM NYSS AAPT Fall Conference Syracuse, New York – October 17,

NEWARK CENTRAL SCHOOL DISTRICT NEWARK CENTRAL SCHOOL DISTRICT Board of Education Regents Exam Results August 7, 2013.

1 Changes to NYS Grades 3 – 8 Assessments. In 2010, NYS Raised the Bar for Proficiency ELA Level 2Level 3 Grade

A Presentation to the USDOE January 13, 2010 Mary Ann Snider Chief of Educator Excellence and Instructional Effectiveness Race to the Top- Assessment Programs.

Dan Thompson Oklahoma State University Center for Health Science Evaluating Assessments: Utilizing ExamSoft’s item-analysis to better understand student.

PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,

The Relationship Between Conceptual Learning and Teacher Self-Reflection Kathleen Falconer Dept of Elementary Education and Reading, SUNY- Buffalo State.

Student Achievement, Data Trends, and Next Steps David Abrams Assistant Commissioner for Standards, Assessment and Reporting Staff/Curriculum Development.

PSYCH 550 Week 1 Individual Learning Paper To purchase this material link 550/PSYCH-550-Week-1-Individual-Learning-

PSYCH 555 Week 1 Individual Social Psychology Paper Check this A+ tutorial guideline at 555-Week-1-Individual-Social-Psychology-Paper.

Presented to the Board of Education September 23, 2014

The RTOP and its Role Improving Physics Teaching

Assessment in Science Rodney Doran, SUNY Buffalo, Emeritus

Assistant Commissioner Office of Standards, Assessment and Reporting

ELPA Standard Setting Validation February 27th, 2007

Smarter Balanced Scoring (AKA the “Marble Slides”)

Testing Program Update October 5, 2011

Presentation transcript:

An Analysis of NYS Regents Physics Exam Issues J. Zawicki Science Education, BSC STANYS DAL, Physics Mentor

9/25/03 NYS Regents Physics -- Zawicki 2 Additional Researchers Michael Jabot, SUNY Fredonia Kathleen Falconer, SUNY BSC Dan MacIsaac, SUNY BSC David Henry, SUNY BSC Rita Fischer, Elba Central School

9/25/03 NYS Regents Physics -- Zawicki 3 Presentation Overview Issues from the field Exam findings Issues and events Future directions…

9/25/03 NYS Regents Physics -- Zawicki 4 Issues From the Field What are issue(s) are uppermost in your mind at this time?

9/25/03 NYS Regents Physics -- Zawicki 5 Exam Findings Call for student papers, STANYS, NYS Section AAPT >2000 student papers were submitted Results from across NYS

9/25/03 NYS Regents Physics -- Zawicki 6 Initial Distribution of Papers

9/25/03 NYS Regents Physics -- Zawicki 7 Rasch Analysis Parts A and B-1; B-2 and C presented together Concepts – Difficulty – how well did the students do? – Discrimination – how well did an item distinguish between high and low performing students? – Rasch transformation – log transformation

9/25/03 NYS Regents Physics -- Zawicki 8

9/25/03 NYS Regents Physics -- Zawicki 9 “Easy” Items – A, B-1 ItemKeyR1R2R3R4%CNDE Q Q Q Q Q

9/25/03 NYS Regents Physics -- Zawicki 10

9/25/03 NYS Regents Physics -- Zawicki 11

9/25/03 NYS Regents Physics -- Zawicki 12

9/25/03 NYS Regents Physics -- Zawicki 13

9/25/03 NYS Regents Physics -- Zawicki 14 “Difficult” Items – A, B-1 ItemKeyR1R2R3R4%CNDE Q Q Q Q Q

9/25/03 NYS Regents Physics -- Zawicki 15

9/25/03 NYS Regents Physics -- Zawicki 16

9/25/03 NYS Regents Physics -- Zawicki 17

9/25/03 NYS Regents Physics -- Zawicki 18

9/25/03 NYS Regents Physics -- Zawicki 19 “Easy Items” B-2, C ItemKeyR0R1R2%CNDE Q Q Q Q Q

9/25/03 NYS Regents Physics -- Zawicki 20

9/25/03 NYS Regents Physics -- Zawicki 21

9/25/03 NYS Regents Physics -- Zawicki 22

9/25/03 NYS Regents Physics -- Zawicki 23

9/25/03 NYS Regents Physics -- Zawicki 24 “Difficult” Items B-2, C ItemKeyR0R1R2%CNDE Q Q Q Q Q

9/25/03 NYS Regents Physics -- Zawicki 25

9/25/03 NYS Regents Physics -- Zawicki 26

9/25/03 NYS Regents Physics -- Zawicki 27

9/25/03 NYS Regents Physics -- Zawicki 28 Reading Level McLaughlin-SMOG Additional Analysis Pending

9/25/03 NYS Regents Physics -- Zawicki 29 Initial Analysis, Reading Levels Exam AdministrationGrade Equivalent June th June th (Low) June th (High) June th

9/25/03 NYS Regents Physics -- Zawicki 30 Conceptual Level Modification of Bloom – Knowing – Using 1 – Using 2 – Integrating

9/25/03 NYS Regents Physics -- Zawicki 31 Exam Conceptual Level Exam AdministrationConceptual Level June June June June

9/25/03 NYS Regents Physics -- Zawicki 32 Exam Format ExamAdministrationMCWP June January June January June August January June

9/25/03 NYS Regents Physics -- Zawicki 33 AP Correlation Approximately 0.69 Precise value varied from year to year

9/25/03 NYS Regents Physics -- Zawicki 34 NYS Physics/AP B

9/25/03 NYS Regents Physics -- Zawicki 35 Listserv Comments Latency -- Incomplete/unfinished tests Power Tests – assessments where time does not play a significant role in the score

9/25/03 NYS Regents Physics -- Zawicki 36 Issues Impact of Scaled Scoring on student scores in the standards-based exams Direction of future exams

9/25/03 NYS Regents Physics -- Zawicki 37 Sessions NYSUT Session with Commissioner Mills Science Education Consortium – August Regents Session – September Senate Hearings NYS AAPT Meeting (SUNY Binghamton) Physics Summit (Albany Area)

9/25/03 NYS Regents Physics -- Zawicki 38 Additional Directions? Where do we go from here?