1. 2 0 0 5 Michelle K. Hosp Laura Sáenz July 8, 2005 Summer Institute: Introduction to CBM in Reading

2. 2 Overview Overview of CBM in Reading Step 1: How to Place Students in a Reading CBM Task Step 2: How to Identify the Level of Material for Monitoring Progress Step 3: How To Administer and Score Reading Probes Step 4: How to Use Data to Describe Student Strengths and Weaknesses

3. 3 Distinguishing Features of Curriculum-Based Measurement Every assessment samples the same, relatively broad range of skills and is of equivalent difficulty Methods for sampling curriculum and for administering/scoring assessments are prescriptive Those methods are based on reliability, validity, and treatment utility studies

4. 4 Distinguishing Features of Curriculum-Based Measurement The CBM score can be viewed as a performance indicator, representing global competence in the target domain Relies on repeated performance sampling Displays time-series data in graphic form Incorporates qualitative descriptions of student performance

5. 5 Distinguishing Features of Curriculum-Based Measurement Yields Information About –Academic standing as well as growth –Global competence as well as skill- by-skill Mastery Can Answer Questions About –Interindividual difference –Intraindividual improvement –How to strengthen programs

6. 6 CBM in Reading Not interested in making kids read faster Interested in kids becoming better readers The CBM score is an overall indicator of reading competence Students who score high on CBM –Are better decoders –Are better at sight vocabulary –Are better comprehenders Correlates highly with other global measures of reading (e.g. high stakes testing; commercially available tests; teacher made tests)

7. 7 CBM Reading Tasks Kindergarten: Letter-sound fluency Grade 1: Word-identification fluency Grades 2-3: Passage reading fluency Grades 4-6: Maze fluency

8. 8 Kindergarten Letter-Sound Fluency Teacher: Say the sound that goes with each letter. Time: 1 minute p U z u y i t R e w O a s d f v g j S h k m n b V Y E i c x …

9. 9 Kindergarten Letter-Sound Fluency Alternate-passage stability (3 weeks):.92 -.94 Criterion validity with WRMT:.58 -.71 Predictive Validity with CBM (Fall 1 to Spring 1):.68 Predictive Validity with CBM (Fall K to Spring 1):.54 Predictive Validity with TerraNova (Fall 1 to Spring 1):.53 Predictive Validity with TerraNova (Fall K to Spring 1):.43

10. 10 Grade 1 Word-Identification Fluency two for come because last from... Teacher: Read these words. Time: 1 minute.

11. 11 Grade 1 Word-Identification Fluency Alternate-passage stability (3 weeks):.97 Concurrent Validity: –WRMT- WID:.77 (Fall) -.82 (spring) –CBM- PRF:.93 (spring) –CRAB- Comprehension:.73 (spring) Predictive Validity: Between.63 -.80 from fall to spring on: –WRMT- WID –CBM- PRF –CRAB- Comprehension

12. 12 Grades 2-3: Passage Reading Fluency Number of words read aloud correctly in 1 minute on end-of- year passages

13. 13 CBM passage for Correct Words Per Minute Jason Fry ran home from school. He had to pack his clothes. He was going to the beach. He packed a swimsuit and shorts. He packed tennis shoes and his toys. The Fry family was going to the beach in Florida. The next morning Jason woke up early. He helped Mom and Dad pack the car, and his sister, Lonnie, helped too. Mom and Dad sat in the front seat. They had maps of the beach. Jason sat in the middle seat with his dog, Ruffie. Lonnie sat in the back and played with her toys. They had to drive for a long time. Jason looked out the window. He saw farms with animals. Many farms had cows and pigs but some farms had horses. He saw a boy riding a horse. Jason wanted to ride a horse, too. He saw rows of corn growing in the fields. Then Jason saw rows of trees. They were orange trees. He sniffed their yummy smell. Lonnie said she could not wait to taste one. Dad stopped at a fruit market by the side of the road. He bought them each an orange.

14. 14 Grades 2-3: Passage Reading Fluency Alternate-passage stability (3 weeks):.92 Criterion validity with WRMT:.70 -.89 Predictive validity with CBM (22-30 weeks):.72 -.86 Predictive validity with TerraNova (22-30 weeks):.65 -.72

15. 15 Grades 4-6: Maze Fluency Number of words replaced correctly in 2.5 minutes on end-of-year passages from which every 7th word has been deleted and replaced with 3 choices

16. 16 Computer Maze

17. 17 Grades 4-6: Maze Fluency Alternate-passage stability (3 weeks):.94 Criterion validity with WRMT:.71 -.93 Predictive Validity with CBM (22-30 weeks):.70 -.84 Predictive Validity with TerraNova (22-30 weeks):.67 -.74

18. 18 CBM Reading Benchmarks K: 40 letter sounds per min 1: 50 words correct from list per min 2: 75 words correct from text per min 3: 100 words correct from text per min 4: 20 replacements to text per 2.5 min 5: 25 replacements to text per 2.5 min 6: 30 replacements to text per 2.5 min

19. 19 CBM Reading Risk Indicators 1: < 15 words in lists/min 2: < 15 words in text/min 3: < 50 words in text/min 4: < 70 words in text/min 5-7: < 15 maze replacements/2.5 min

20. 20 Minimum Assessment Schedule At or above benchmark: 3 times/year Below benchmark: monthly or weekly

21. 21 Step 1: How to Place Students in a Reading CBM Task At Kindergarten –Letter Sound Fluency At Grade 1 –Word Identification Fluency At Grades 2-3 –Passage Reading Fluency At Grades 4-6 –Maze Fluency

22. 22 Step 2: How to Identify the Level of Material for Monitoring Progress Generally, students use the CBM materials prepared for their grade level However, some students may need to read from a different grade level if they are well below grade-level expectations

23. 23 Step 2: How to Identify the Level of Material for Monitoring Progress To find the appropriate CBM level: –Determine grade level text for student –Administer 3 CBM Passage Reading Fluency passages If student reads 10-50 words correct in 1 minute but with less than 85-90% accuracy, move to next lower CBM level If student reads more than 50 words correct in 1 minute, move to the highest level of text where he/she reads between 10-50 words correct

24. 24 Step 3: How To Administer and Score Reading Probes Students read letters, isolated words or passages for 1 minute Student reads out loud while teacher marks student errors The number of letters or words correct is calculated and graphed on student graph Four CBM reading tasks are considered

25. 25 CBM Letter Sound Fluency (LSF) For kindergarten students Student presented with page of 26 random letters on LSF Student Copy Student reads the letter sounds for 1 minute Teacher marks errors on LSF Teacher Score Sheet

26. 26 CBM Letter Sound Fluency (LSF) Student copy of LSF Letters in the box are practice

27. 27 CBM Letter Sound Fluency (LSF) LSF Teacher Score Sheet Errors are marked with a slash (/) Score is adjusted if student completes in less than 1 minute

28. 28 CBM Letter Sound Fluency (LSF) Only short vowel sounds are correct. If the student answers correctly, immediately point to the next letter on the student’s copy.

29. 29 CBM Letter Sound Fluency (LSF) If the student does not respond after 3 seconds, point to the next letter. Do not correct errors.

30. 30 CBM Letter Sound Fluency (LSF) Mark errors on teacher’s score sheet. At 1 minute, circle the last letter the child attempts.

31. 31 CBM Letter Sound Fluency (LSF) Abby’s CBM LSF Errors are marked with a slash (/) Last sound (/r/) is circled 23 sounds attempted 5 incorrect Abby’s score = 18

32. 32 CBM Letter Sound Fluency (LSF) Let’s practice. This is the Teacher Score Sheet.

33. 33 CBM Letter Sound Fluency (LSF) Let’s practice. This is the Student copy.

34. 34 What if a student finishes in less than 1 minute? Record the number of seconds it took the student to read Count the number of words the student read correctly (number of words read correctly/ number of seconds it took to read) x 60 = estimated number of words read correctly in 1 minute

35. 35 Example for Prorating Score Example: The student finished reading the list of 50 words in just 54 seconds and got 44 words correct. (44/54) x 60 =.815 x 60 = 48.9; We estimate that the student would have read approximately 49 words correctly in 1 minute had we provided more words and timed the student for 1 minute.

36. 36 CBM Word Identification Fluency (WIF) For first-grade students Student presented with a list of 50 words Student reads words for 1 minute Teacher marks errors on WIF Score Sheet

37. 37 CBM Word Identification Fluency (WIF) CBM WIF Student list

38. 38 CBM Word Identification Fluency (WIF) WIF Teacher Score Sheet Words read correctly marked as ‘1’ Words read incorrectly marked as ‘0’

39. 39 CBM Word Identification Fluency (WIF) If the student hesitates, prompt her to move to the next word after 2 seconds. If the student is sounding out a word, prompt him to move to the next word after 5 seconds.

40. 40 CBM Word Identification Fluency (WIF) Do not correct errors. Mark errors on score sheet.

41. 41 CBM Word Identification Fluency (WIF) At 1 minute, circle the last word the student reads. If the student finishes in less than 1 minute, note the number of seconds it took to complete the word list. See administration and scoring guide for information on adjusting scores.

42. 42 CBM Word Identification Fluency (WIF) Shameka’s CBM WIF Correct words marked as ‘1’ Incorrect words marked as ‘0’ Last word read (car) is circled Shameka’s score = 29

43. 43 CBM Word Identification Fluency (WIF) Let’s practice. This is the Teacher Score Sheet.

44. 44 CBM Word Identification Fluency (WIF) Let’s practice. This is the Student list.

45. 45 CBM Passage Reading Fluency (PRF) For students in grades 2-8 Student reads grade-appropriate passage for 1 minute from PRF Student copy Teacher marks errors on PRF Teacher copy

46. 46 CBM Passage Reading Fluency (PRF) PRF Student copy

47. 47 CBM Passage Reading Fluency (PRF) PRF Teacher copy Numbers along margin allow for easy calculation of words attempted

48. 48 CBM Passage Reading Fluency (PRF) Scoring guidelines: –Repetitions, self-corrections, insertions, and dialectical differences are all scored as CORRECT –Mispronunciations, word substitutions, omitted words, hesitations (word not said within 3 seconds), and reversals are all scored as ERRORS

49. 49 CBM Passage Reading Fluency (PRF) Additional scoring guidelines: –A skipped line is counted as 1 error –Every word but 1 of the words is subtracted from the total number of words attempted

50. 50 CBM Passage Reading Fluency (PRF) Reggie’s CBM PRF Words read incorrectly marked with a slash (/) Lines omitted marked with a horizontal line Last word read in 1 minute marked with a slash

51. 51 CBM Passage Reading Fluency (PRF) 136 words attempted in 1 minute 14 of 15 words omitted in 4 th line subtracted from 136 (136 – 14 = 122) 1 omission error and 8 reading errors subtracted from 122 (122 – 9 = 113) Reggie’s score = 113

52. 52 CBM Passage Reading Fluency (PRF)- Practice

53. 53 PRF Practice Scoring - 7 71 64 WRC

54. 54 CBM Maze Fluency For students in grades 1-6, typically 4-6 Administered to a group of students at one time Students read passage and circle correct word for each blank Tests lasts for 2.5 minutes Teacher grades each test later

55. 55 CBM Maze Fluency Maze Student copy Students receive 1 point for each correct answer Scoring is discontinued if 3 consecutive errors are made

56. 56 CBM Maze Fluency Juan’s CBM Maze 10 correct answers before he made 3 consecutive mistakes Juan’s score = 10

57. 57 CBM Maze Fluency Let’s practice. This is the first page of the CBM Maze test, “Summer Camp.”

58. 58 CBM Maze Fluency

59. 59 Ambitious Goals By Grade End-of-Year Benchmarking For typically developing students, a table of benchmarks can be used to find CBM end-of- year performance goal GradeBenchmark Kindergarten40 letter sounds per minute (CBM LSF) 1 st Grade50 words correct per minute (CBM WIF) 2 nd Grade75 words correct per minute (CBM PRF) 3 rd Grade100 words correct per minute (CBM PRF) 4 th Grade20 correct replacements per 2.5 minutes (CBM Maze) 5 th Grade25 correct replacements per 2.5 minutes (CBM Maze) 6 th Grade30 correct replacements per 2.5 minutes (CBM Maze)

60. 60 Ambitious Goals By Grade National Norms For typically developing students, a table of average rates of weekly increase can be used to find end- of-year performance goal Grade PRF Norms Maze Norms 1 st Grade2.000.40 2 nd Grade1.500.40 3 rd Grade1.000.40 4 th Grade0.900.40 5 th Grade0.500.40 6 th Grade0.300.40 1 st GradeWIF1.75

61. 61 Step 4: How to Use Data to Describe Student Strengths and Weaknesses Using CBM PRF, student miscues can be analyzed to describe student strengths and weaknesses Student reads a CBM PRF passage and teacher writes down student errors First 10 errors are analyzed using a Quick Miscue Analysis Table

62. 62 Step 4: How to Use Data to Describe Student Strengths and Weaknesses Written Word Spoken WordGraphophoneticSyntaxSemantic 1 2 3 4 5 6 7 8 9 10 %

63. 63 Step 4: How to Use Data to Describe Student Strengths and Weaknesses

64. 64 Step 4: How to Use Data to Describe Student Strengths and Weaknesses

65. 65 Step 4: Let’s Practice How to Use Data to Describe Student Strengths and Weaknesses

66. 66 Step 4: How to Use Data to Describe Student Strengths and Weaknesses

67. 67 CBM Materials AIMSweb / Edformation DIBELS Edcheckup McGraw-Hill Pro-Ed, Inc. Vanderbilt University