Michael Luke 609-984-9637.

Slides:



Advertisements
Similar presentations
Amelia Courts, WESTELL Putting it All Together WV Department of Education.
Advertisements

Tennessee English Language Placement Assessment (TELPA)
Parent Information Night: Grades 6, 7 & 8 Mathematics.
New MATH ISAT and the Illinois Assessment Framework September 2005 Joan Barrett Madison County ROE
December ELA Test Split into 3 books Administered across 3 days Day 2 will consist of one book with both multiple-choice and constructed response.
Benchmark Assessment Item Bank Test Chairpersons Orientation Meeting October 8, 2007 Miami-Dade County Public Schools Best Practices When Constructing.
How Do My Students Compare? Exploring National Assessment Tools Crystal Walcott Indiana University Purdue University Columbus Doris J. Mohr University.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
ELA and Writing Assessment: Impact on Transitioning to CCSS South Carolina Department of Education Office of Assessment.
Using Growth Models for Accountability Pete Goldschmidt, Ph.D. Assistant Professor California State University Northridge Senior Researcher National Center.
Reliability and Linking of Assessments. Figure 1 Differences Between Percentages Proficient or Above on State Assessments and on NAEP: Grade 8 Mathematics,
The State of the State TOTOM Conference September 10, 2010 Jim Leigh Office of Assessment and Information Services Oregon Department of Education.
 Raw data is generated by the process of collecting information  From 20-question survey of 100 people, for example, 2000 ‘bits’ of information are.
1 Focusing on the FCAT/FCAT 2.0 Test-Taking Strategies Grades 3-5 Nancy E. Brito, Department of Assessment , PX47521.
School Performance Score Elementary School - October 2013 i LEAP Grade 3 LEAP Grade 4 Assessment Points * 150Advanced 125Mastery 100Basic 0Approaching.
PSSA: Pennsylvania System of Schools Assessment Robert Valeria.
Information on New Regents Examinations for SCDN Presentation September 19, 2007 Steven Katz, Director Candace Shyer, Bureau Chief Office of Standards,
High School Proficiency Assessment (HSPA) Department of Education Office of Evaluation and Assessment.
Math Math Test Format Number of Multiple Choice Items per Student (1 point each) Number of Open- Ended Items per Student (4 points each) Grade.
Mathematics Indicators and Goals. Math Tier II Indicator Indicator 1.8: All junior high students will meet or exceed standards and be identified as proficient.
FCAT 2.0 and End-of-Course Assessments 1 Kris Ellington Deputy Commissioner Division of Accountability, Research and Measurement 850/
1 Focusing on the FCAT Test-Taking Strategies Grades 3-5 Nancy E. Brito, Department of Assessment , PX47521 Information.
When is the test? Why do students take the test?
Setting Performance Standards for the Hawaii State Alternate Assessments: Reading, Mathematics, and Science Presentation for the Hawaii State Board of.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
WELCOME TO PARK VIEW MIDDLE SCHOOL NECAP REPORT NIGHT.
Washington Educational Research Association Conference Washington Educational Research Association Conference Kelly Neely Reading Assessment Specialist.
Project 2 CCSSM Interpretation Guide Common Core Leadership in Mathematics Project University of Wisconsin-Milwaukee Summer Institute 2011.
Measures of Student Learning/ Common Exam Update WS/FCS Board of Education November 13, 2012.
NJ ASK Information Evening April 14, 2011 James Johnson Elementary School.
Fall 2007 MEAP Reporting 2007 OEAA Conference Jim Griffiths – Manager, Assessment Administration & Reporting Sue Peterman - Department Analyst, MEAP.
New Developments in NYS Assessments. What is new? Required use of Standardized Scannable Answer Sheets for all Regents Exams starting in June 2012 Beginning.
Using Common Core State Standards of Seventh Grade Mathematics in the Application of NXT LEGO® Robotics for CReSIS Middle School Students.
Montgomery County ESC Phase II: SLO Training.  In order to show growth you need to have a consistent framework between the pre- and post-assessments.
LEAP - SCIENCE.
What is the HSPA???. HSPA - Overview The HSPA is the High School Proficiency Assessment that is given to juniors in New Jersey’s public schools. States.
Instructional Support Modules In Reading How to Score Assessments and How to Use Assessment to Improve Student Learning.
Alternate Proficiency Assessment Erin Lichtenwalner.
3 rd and 4 th Grade Level Meeting April 13, 2010 Technology Lab Camden Street School: Preparing for NJ ASK 2010.
All states must assess Mathematics and Reading in grades 3 through 8 Item formats: Multiple Choice (MC), Short Response (SR), Extended Response (ER) Four.
Mini-Project #2 Quality Criteria Review of an Assessment Rhonda Martin.
Educator Effectiveness Summit School District’s Recommendation for the School Year.
The ACE Strategy Week 2: Administer and Evaluate Pre-test Cluster Cycle 2 Goal: By the end of the cycle, 78% of students in grades 3-5 will increase their.
Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Pennsylvania State Assessments 2013 Tom Corbett, Governor ▪
Testing methods that require students to create and answer or develop a product that demonstrates knowledge or skills.
Assessment Update Wood Acres Elementary February 7, 2006 KPJ 2006.
Added Value Assessment Overview National 4 Lifeskills.
ISAT ISAT READING TEST SESSIONS Session 1  6 Short Passages (literary, informational, poems)  30 Multiple-Choice Questions all Multiple.
PSSA Testing Information Highlights from the PSSA Assessments for 2011 Highlights from the PSSA Assessments for 2011.
Evaluation Results MRI’s Evaluation Activities: Surveys Teacher Beliefs and Practices (pre/post) Annual Participant Questionnaire Data Collection.
1 Changes to NYS Grades 3 – 8 Assessments. In 2010, NYS Raised the Bar for Proficiency ELA Level 2Level 3 Grade
ELA teachers PD may 12, 2010 Jorge Garcia (this slide added for topic data– not part of presentation)
1.  Developed to meet the criteria set by the Learning Community and OPS Assessment Steering Committee  Developed as a measure to monitor student progress.
 The Common Core State Standards (CCSS) will be assessed in the spring of 2014 for Grades 3 through 5:
ELEMENTARY REPORT CARD CHANGES Beginning in the School Year.
Review of Cut Scores and Conversion Tables (Angoff Method)
 Assessment and Score Reporting for SPRING 2014 will be aligned exclusively to the Common Core State Standards for Mathematics (CCSSM) (corestandards.org).
Characteristics of HSAP Standards based Standards based 62 Multiple Choice items (1 point each for a total of 62 points) 62 Multiple Choice items (1 point.
Developmentally Appropriate Practices. Five Guidelines For Developmentally Appropriate Practices.
How the CAP Science and Social Studies Tests Measure Student Growth.
1. 2 National Assessment of Educational Progress (NAEP) Survey of academic achievement for the nation and the states Assesses various subjects at grades.
New Developments in NYS Assessments
It Begins With How The CAP Tests Were Designed
Questions Tool and Constructed Response Items
EL (English Language) Students and WIDA Standards
Tuesday, November 13, 2012 Michael Elder & Math Leaders
Office of Education Improvement and Innovation
Goals, Sources of Evidence, Rubrics
Alignment of curriculum, instruction and classroom assessments
Testing Schedule.
Presentation transcript:

Michael Luke

Basic Definitions Test Design 2010 Item Alignment Calculator Usage Item Review (Subjective), Field Testing, Rangefinding (Rubric Development), and Item Review (Objective) Raw Cuts 2008/2009 Results 2008/2009 Questions

Basic Definitions MC- multiple choice item, 0/1, 1.5 minutes response time SCR- short constructed response item, 0/1, 2 minutes response time ECR- extended constructed response item, 0/1/2/3, 10 minutes Standards, cluster, strand, cumulative progress indicator (cpi)- see sample item #1

Test Design Grades 6, 7, & 8 Test Part of 6Number of Items, Timing Part 110 SCR, 20 minutes Part 28 MC, 1 ECR 22 minutes Part 38 MC, 1 ECR 22 minutes Part 410 MC, 1 ECR 25 minutes Part 510 MC, 1 ECR 25 minutes Part 66 MC, 1 ECR 19 minutes

Test Design Comparison SCR 8/10 MC 45 ECR 4 10 SCR MC 42 ECR 5

Test Design Grades 6, 7 & 8 Test Length: Grades 6 and 7- day 1 64 minutes, day 2 69 minutes; or Grade minutes (+5) Each assessment contains embedded field test items- 49 operational score points (last year 50, 52)

Item Alignment 2010 Previously, items representing 12/13 raw score points were aligned to each cluster For 2010, raw score points per cluster are proportional to the number of “bold” CPI’s in the Areas of Focus documents m

Item Alignment 2010 Points by ClusterGrade 6Grade 7Grade

Calculator Usage 2009 v Grade 6, Part 1 (SCR items) only was noncalculator Grades 7 and 8, entire assessment was calculator active Grades 6, 7, and 8, Parts 1, 2, and 3 are noncalculator 23 raw points from noncalculator items (47%) 26 raw points from calculator active items (53%) See memos

Item/Form Development Item Review (Subjective) Field Testing Rangefinding (Scoring) Item Review (Objective) Statistics Review

Form Construction Form is then constructed using item statistics, making sure aligned items meet required Cluster Representation (see earlier slide), and Item Type counts (see earlier slide). Items of various difficulties are used; however, attempt is made to replicate overall form difficulty of previous year.

Raw Cuts 2008/2009 Teacher Panel Established Using Bookmark Method Summer 2008) Grade2008-P(200)2009-P2008-AP(250)2009-AP 6 (out of 50) (out of 52) (out of 52)

Results 2008/2009 (Percents of Student Results in Categories) GradeProficient 2008 Proficient 2009 Advanced Proficient 2008 Advanced Proficient

Results 2008/2009 Sums of Categories (P+AP Percentages) Grade

Testing Misconceptions On the sixth grade 2008 ASK four of the five easiest points to accumulate are the first point in an ECR item (scaffolding) and the two toughest points to accumulate were from MC items.

New Eighth Grade Reference Sheet for 2010 See 8/ref/math/G8MathRef09.pdf

Questions?