1. How Do My Students Compare? Exploring National Assessment Tools Crystal Walcott Indiana University Purdue University Columbus Doris J. Mohr University of Southern Indiana Peter Kloosterman Indiana University - Bloomington

2. http://nces.ed.gov/nationsreportcard/ NAEP – National Assessment of Educational Progress

3. NAEP Programs Main NAEP – results are representative of the entire US population Main NAEP – results are representative of the entire US population State NAEP – same items and testing format, reports achievement for fourth and eighth grade students on a state-by- state basis State NAEP – same items and testing format, reports achievement for fourth and eighth grade students on a state-by- state basis Long-Term Trend – uses different items, national sample, and testing schedule. Long-Term Trend – uses different items, national sample, and testing schedule.

4. NAEP Content Strands in Mathematics Number sense, properties, and operations Number sense, properties, and operations Measurement Measurement Geometry and spatial sense Geometry and spatial sense Data analysis, statistics, and probability Data analysis, statistics, and probability Algebra and functions Algebra and functions

5. NAEP Item Formats Multiple choice format Multiple choice format 4 th grade – four choices 8 th & 12 th grades – five choices Short constructed-response Short constructed-response Two types 1. Students write answer in space provided. 2. Multiple questions or a brief rationale. Extended constructed-response Extended constructed-response Scored with focused, holistic rubrics

6. Reporting Results: Scale Score and Achievement Levels Scale scores Scale scores Range from 0 to 500 Available by content strand Available by demographic characteristics Designed to get a sense of performance of the nation as a whole, not performance of individual students Achievement levels Achievement levels Basic, proficient, and advanced Setting of achievement levels is controversial (proficient level is very ambitious)

7. Questionnaires Student Questionnaire Student Questionnaire All students complete two five-minute questionnaires before the cognitive items and one five-minute questionnaire after completing the items #1 focuses on demographics #2 focuses on mathematics background & courses #3 focuses on how hard the students tried and the difficulty of the assessment Teacher Questionnaire Teacher Questionnaire School Administrator Questionnaire School Administrator Questionnaire

8. NAEP Online Tools

9. http://nces.ed.gov/nationsreportcard/ Nation’s Report Card Homepage

10. http://nces.ed.gov/nationsreportcard/about/naeptools.asp Learn More About the Tools Available Online

11. Main NAEP Question Tool

12. Accessing the Questions Click on “Questions Tool” from the tools and applications page……..

13. Accessing the Questions Or click on “Sample Questions” from the left navigation bar on the homepage

14. NAEP Questions Tool

15. http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx

16. Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

17. Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

18. Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

19. Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

20. Main NAEP Mathematics Search Results http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

21. Item Preview http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

22. View Question Detail

23. Show Additional Materials

24. Key/Scoring Guide

25. Sample Responses

26. National Performance Summary

27. National “More Data”

28. Jurisdiction Data

29. Adding Items to Workspace

32. Using Workspace

33. Workspace Document

34. Example of Multiple-choice item

35. Example of Extended Constructed Response Item

36. Long-term Trend Item Tool

37. Long-term Trend Item Search http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx

38. Long-term Trend Item Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=long-term_trend_mathematics

39. Long-term Trend MC Items From Age 9 Assessment From Age 13 Assessment From Age 17 Assessment

40. Long-term Trend SCR Item From Age 9 Assessment From Age 13 Assessment From Age 17 Assessment

41. Long-term Trend Question Detail & Workspace

42. NAEP Online Data Explorer

43. http://nces.ed.gov/nationsreportcard/about/naeptools.asp Learn More About the Tools Available Online

44. http://nces.ed.gov/nationsreportcard/naepdata NAEP Data Explorers

45. http://nces.ed.gov/nationsreportcard/naepdata/dataset.aspx Main NAEP Data Explorer

46. Data Explorer Results

47. NCES Kids’ Zone

48. http://nces.ed.gov/nceskids/index.asp

49. NCES Kids’ Zone Tools

50. NCES Kids’ Zone Graph

52. NCES Kids’ Zone Graph Example

53. NCES Kids’ Zone Dare to Compare

57. NCES Kids’ Zone Grab Bag

58. NCES Kids’ Zone Chances

60. Send your email address to walcottc@iupuc.edu to receive an electronic copy of this presentation.walcottc@iupuc.edu