1. Understanding Alaska Measures of Progress Results: Reports 1 ASA Fall Meeting 9/25/2015 Alaska Department of Education & Early Development Margaret MacKinnon, Director, Assessment & Accountability

2. Objectives Review how the knowledge and skills in the Alaska ELA and mathematics standards are measured by the AMP assessments. Provide an overview of the AMP reports: how to read them, what they tell you, and why they don’t tell you all you might like to know about student performance. Show where to find AMP results and reports and resources available for educators. 2

3. A Balancing Act 3

4. New ELA & Math Standards Grade Level Expectations Reiteration of the Performance Standards adopted in the 1990s. Only covered grades 3 ‐ 10. “A mile wide and an inch deep.” College and Career Ready Prepare students for post- secondary options without remediation. Grades K-12. Developed with learning progressions. More rigorous and focused. 4

5. SBAs vs. AMP Standards Based Assessments Questions measured isolated skills on GLEs. Alaska Measures of Progress Technology enhanced items measure related concepts and skills in a single test question. More integrated and efficient. Designed to reflect how teachers teach and students learn. 5

6. Teaching and Learning When students learn, they use skills related to multiple standards. 6 Key Details Word meaning Analyzing text features Grammar and punctuation

7. Putting it all together 7

8. What do we want our students to do in Math? 8 Modeling and Data Analysis Problem Solving Concepts & Procedures Communicate Reasoning Claim 1Claim 2Claim 3Claim 4

9. What do we want our students to do in ELA? 9 Produce effective writing for a range of purposes Read closely and analytically Employ effective speaking and listening skills Claim 1Claim 2Claim 3

10. AMP Results Results are reported in 4 achievement levels from Level 1 (lowest) to Level 4 (highest). Levels reflect emphasis of growth along a continuum toward the goal of meeting the standards rather than the pass/fail nature of proficient/not proficient. Students achieving Levels 3 and 4 are meeting the standards, those achieving Levels 1 and 2 are partially meeting the standards. 10

11. AMP Reports School & District Summary Reports School & District Detail Reports Student Reports – Available to download from KITE in Educator Portal based on permission of user access. User can see “down” but not “up” Superintendent & district administrators can see all district, school & student reports Principal can see own school and student reports 11

12. 12 District Summary Report page 1 One for each content area – shows all grades tested. District Summary Report shows district and state results. School Summary Report has same format as district, but also includes school results.

13. 13 District Summary Report Shows median scale score for the content area for each grade level, for district & state. Scales for all grades range from 620 to 780. The dotted line represents 700, the minimum scale score needed to meet the standards.

14. Median & Standard Error 14 An explanation is provided on each report For the scores reported on a bar chart, the standard error is usually shown as a line embedded within the bars on a chart

15. 15 District Summary Report page 2 Shows percentage of students in each achievement level by grade for district and state.

16. 16 District Detail Report page 1 One for each grade and content area District Detail Report shows district and state data. School Detail Report has same format as district, but also includes school results.

17. 17 District Detail Report Arrow points to median score in the achievement level range for the all students group in the district and state for the grade level and content area. AMP Meters

18. 18 District Detail Report Achievement Levels Shows score range for each achievement level for reported grade and content area. Scales range from 620 to 780, with Level 3 beginning at 700 for all grades. Levels 2 and 4 ranges vary by grade and content area.

19. 19 District Detail Report Percentage of students in each achievement level for grade

20. 20 District Detail Report page 2 Explanation of median and standard error. Shows district relative performance on claims (big ideas) for content. Describes claims (big ideas) for content.

21. 21 District Detail Report District sub-scores & claims - Math Represents the strengths of the district and state by claim. Scale for claims is different than the assessment score scale and is not reported by achievement level. 1: Concepts & Procedures 2: Problem Solving 3: Communicate Reasoning 4: Modeling & Data Analysis

22. 22 District Detail Report District sub-scores & claims - ELA Claim 1: Reading Claim 1-RL: Reading Literature texts Claim 1-RI: Reading Informational texts Claim 2: Writing

23. 23 Student Report, page 1 Explanation of median and standard error. Student score and school, district, state comparison for grade and content. Achievement Levels and score range information. Separate reports for ELA and Mathematics

24. 24 Student Report Arrow points to student’s score within the Achievement Level range. AMP Meter

25. 25 AMP Meters: School, District, State Allows comparison of student’s achievement level to median scale score and achievement level of students in the same grade in the school, district, and state. Student Report

26. Achievement Level Summaries 26 Student Report A student who performs at this level can… shows overall summary for specific achievement level, grade level, and content

27. Achievement Level Summaries Provides a summary of what student can do at each achievement level for the grade and content area. Summaries for Levels 2, 3, and 4 describe some typical skills and knowledge that a student who barely reaches each achievement level can demonstrate. 27

28. Level 1 Summary – Math & ELA Level 1 scores are difficult to interpret. They range from no correct answers to scores that miss Level 2 by one point. There are a number of reasons a student’s performance resulted in a Level 1 score; however, most students whose scores fall into Level 1 likely have difficulty in … Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1. 28

29. Achievement Level Summaries Available on EED website as resource for educators and parents 29

30. 30 Student Report, page 2 Shows student’s relative areas of strength for content. Describes claims (big ideas) for content.

31. Student’s Relative Strengths (Math) 31 Student Report This graph shows the student’s performance on Claim 1 in math (concepts and procedures) as compared to Claims 2, 3, & 4 (problem solving, communicating, and modeling). The math claims are combined on the student report because of the small number of items.

32. 32 AMP Reports- Educator Resources education.alaska.gov https://education.alaska.gov/tls/Assessments/AMPresources.html

33. 33 AMP Resources

34. AMP Tool Kits 34

35. 35

36. elizabeth.davis@alaska.gov brian.laurent@alaska.gov margaret.mackinnon@alaska.gov 36 Contact us!