Michael Luke
Basic Definitions Test Design 2010 Item Alignment Calculator Usage Item Review (Subjective), Field Testing, Rangefinding (Rubric Development), and Item Review (Objective) Raw Cuts 2008/2009 Results 2008/2009 Questions
Basic Definitions MC- multiple choice item, 0/1, 1.5 minutes response time SCR- short constructed response item, 0/1, 2 minutes response time ECR- extended constructed response item, 0/1/2/3, 10 minutes Standards, cluster, strand, cumulative progress indicator (cpi)- see sample item #1
Test Design Grades 6, 7, & 8 Test Part of 6Number of Items, Timing Part 110 SCR, 20 minutes Part 28 MC, 1 ECR 22 minutes Part 38 MC, 1 ECR 22 minutes Part 410 MC, 1 ECR 25 minutes Part 510 MC, 1 ECR 25 minutes Part 66 MC, 1 ECR 19 minutes
Test Design Comparison SCR 8/10 MC 45 ECR 4 10 SCR MC 42 ECR 5
Test Design Grades 6, 7 & 8 Test Length: Grades 6 and 7- day 1 64 minutes, day 2 69 minutes; or Grade minutes (+5) Each assessment contains embedded field test items- 49 operational score points (last year 50, 52)
Item Alignment 2010 Previously, items representing 12/13 raw score points were aligned to each cluster For 2010, raw score points per cluster are proportional to the number of “bold” CPI’s in the Areas of Focus documents m
Item Alignment 2010 Points by ClusterGrade 6Grade 7Grade
Calculator Usage 2009 v Grade 6, Part 1 (SCR items) only was noncalculator Grades 7 and 8, entire assessment was calculator active Grades 6, 7, and 8, Parts 1, 2, and 3 are noncalculator 23 raw points from noncalculator items (47%) 26 raw points from calculator active items (53%) See memos
Item/Form Development Item Review (Subjective) Field Testing Rangefinding (Scoring) Item Review (Objective) Statistics Review
Form Construction Form is then constructed using item statistics, making sure aligned items meet required Cluster Representation (see earlier slide), and Item Type counts (see earlier slide). Items of various difficulties are used; however, attempt is made to replicate overall form difficulty of previous year.
Raw Cuts 2008/2009 Teacher Panel Established Using Bookmark Method Summer 2008) Grade2008-P(200)2009-P2008-AP(250)2009-AP 6 (out of 50) (out of 52) (out of 52)
Results 2008/2009 (Percents of Student Results in Categories) GradeProficient 2008 Proficient 2009 Advanced Proficient 2008 Advanced Proficient
Results 2008/2009 Sums of Categories (P+AP Percentages) Grade
Testing Misconceptions On the sixth grade 2008 ASK four of the five easiest points to accumulate are the first point in an ECR item (scaffolding) and the two toughest points to accumulate were from MC items.
New Eighth Grade Reference Sheet for 2010 See 8/ref/math/G8MathRef09.pdf
Questions?