1. 1 AMP Results Overview for Educators October 30, 2015

2. Elizabeth Davis, Standards Implementation Elizabeth.Davis@Alaska.gov Brian Laurent, Data Management Brian.Laurent@Alaska.gov Kari Quinto, AMP Project Coordinator Kari.Quinto@Alaska.gov Anji Gallanos, ELA Specialist Anji.Gallanos@Alaska.gov Deb Riddle, Math Specialist Deb.Riddle@Alaska.gov 2

3. 3 Content for this hour session: AMP Reports available in Educator Portal & other AMP Results sources.

4. 4 This session assumes that the participants: Are implementing the current Alaska ELA and Math Standards. Are aware of the reasons for the changes in standards, assessments, and accountability in Alaska. Understand the design and purpose of different kinds of assessments. Are familiar with the AMP Summative Assessment Framework and the terms Claims, Targets, and Evidence Statements. For further information on this content, please view the Understanding AMP Reports webinar.

5. Strategies To Use During This Session Document what you need to learn more about, tell someone, or teach someone. Apply the information to your context. Write down your questions and send them to us. 5

6. Your Learning At your table group, discuss with a partner: 1.What are 3 ideas or pieces of information that you hope to take away from this session? 2.What strategies will you use to… Be fully present knowing that you will have email, texts, phone calls, etc. Remember what further learning you may need to do. Document your next steps. 6

7. AMP Assessment System Formative resources Interim Testlets: Alaska Instructional Impact Measures (AIIMs) Standardized, large scale summative 7

8. 8 Formative Resources Activities to elicit student thinking w/teacher guides to interpret student work Focus on how student understanding develops: prerequisites, common misconceptions

9. 9 Interim Testlets Alaska Instructional Impact Measures Measures & reports student learning at the standard and target level Now: individual testlets available 2016-17: Ability to bundle testlets into custom interim assessment 2018: predictive data for the purposes of intervention

10. 10 AMP Summative Assessment Measures at the target level. Reports student learning at the Content Area level and student relative strengths at the Claim level. The Summative Assessment Framework provides the information of how the AMP summative measures the AK Standards.

11. Partially Meets Standards Student demonstrates knowledge & skills of complex grade level content Student demonstrates knowledge & skills of current grade level content Student may have gaps in knowledge & skills but is capable of most grade-level content Student may have significant gaps in knowledge and skills. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1. Level 4 Level 3 Level 2 Level 1 Meets Standards 11

12. 12

13. 13

14. AMP Reports 1.Where they are found. 2.How to read them. 3.What they tell you and what they don’t tell you (and why). 4.Resources available for educators. Please provide your suggestions on how to make these first year reports better next year. Email elizabeth.davis@alaska.com or visit the web-based feedback form in the AMP Results Toolkit. 14

15. Accessing Reports in KITE Educator Portal 15 Guide available on EED website, AMP Toolkit

16. Types of AMP Reports in KITE Educator Portal Student Report School Summary School Detail District Summary District Detail 16 Packet of report templates

17. Student Reports One each: Math, ELA Accessible in Educator Portal to principals, district administrators Hard copies mailed to districts Guide to Test Interpretation available online 17

18. Student Report Level 3 & 4 : Meets Standards Level 1 & 2: Partially Meets Standards AMP Meter 18

19. AMP Meters: School, District, State Allows comparison of student’s achievement level to median achievement level of students in the same grade in the school, district, and state. Student Report 19

20. Score Ranges for Achievement Levels Shows score range for each achievement level for reported grade and content area. Scales range from 620 to 780. Levels 2 and 4 ranges vary by grade and content area. 20 700 Grade 8 ELA Score Ranges shown

21. Achievement Level Summaries A student who performs at this level can… 21 Student Report

22. 22 Level 1 scores are difficult to interpret. They range from no correct answers to scores that miss Level 2 by one point. There are a number of reasons a student’s performance resulted in a Level 1 score; however, most students whose scores fall into Level 1 likely have difficulty reading, analyzing, and understanding complex grade-level texts. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1.

23. 23 Level 1 scores are difficult to interpret. They range from no correct answers to scores that miss Level 2 by one point. There may be a number of reasons why a student’s performance resulted in a Level 1 score; however, a student whose score falls into Level 1 may have difficulty computing with decimals, explaining place value patterns, or using formulas to calculate volumes of rectangular prisms. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1.

24. Consider the shift from the previous SBA “Far Below Proficient” to the AMP Level 1 summaries. 24 How might the language in the level 1 summary impact conversations between teachers, students, and their families? How might it impact conversations between teachers?

25. 25 Student’s Relative Strengths Student Report Shows student’s performance at the Claim level. Target level (or “strand” level) reporting is not possible due to the small number of items. Unique scale 100-120

26. Student’s Relative Strengths (Math) Claim 1: Concepts and Procedures Claim 2: Problem Solving Claim 3: Communicating & Reasoning Claim 4: Modeling & Data Analysis 26

27. 27 Student’s Relative Strengths (ELA) Claim 1: Reading Claim 1-RL: Reading Literature texts Claim 1-RI: Reading Informational texts Claim 2: Writing

28. School & District AMP Reports: Summary, Detail 28

29. School Summary Report One for each content area – shows all grades tested. School Summary Report shows school, district, and state results. 29

30. School Summary Report Median Achievement by grade Shows median scale score for the content area for each grade level, for school, district & state. Scales for all grades range from 620 to 780. The dotted line represents 700, the minimum scale score needed to meet the standards. 30

31. School Summary Report page 2 Shows percentage of students in each achievement level by grade for school, district, and state. 31

32. Meets Standards Partially Meets Standards School Summary Report 32 The percent of students in an achievement level is shown in ranges when there are small numbers of students. CAUTION: The size of the bars is NOT proportional!

33. School Detail Report One for each grade and content area. School Detail Report shows school, district, and state data. 33

34. School Detail Report page 2 Sub-scores – “relative strengths” Claims 34

35. For your consideration…. Thinking about who you will talk with about the AMP reports… Which strategies & resources do you find most effective when explaining new content this? What resources might you need from EED? 35

36. 36 education.alaska.gov

37. 37

38. AMP Results Tool Kit Resources – AMP Results Fact Sheet – AMP Score Setting Fact Sheet – Drop-In Newsletter Content – Understanding AMP Reports PowerPoint – Parent Brochures – Guide: what a Level 1 (or 2,3,4) Score means – Comparison of AMP and SBA items – Released AMP Items – Key Messages & Talking Points More added regularly… 38

39. One thing you will learn more about. One thing you will share with someone tomorrow (who, what) One topic you feel more confident about than you did before. One message you want to communicate to your students &/or their parents. AMP 39

40. Elizabeth Davis, Standards Implementation Elizabeth.Davis@Alaska.gov Brian Laurent, Data Management Brian.Laurent@Alaska.gov Kari Quinto, AMP Project Coordinator Kari.Quinto@Alaska.gov Anji Gallanos, ELA Specialist Anji.Gallanos@Alaska.gov Deb Riddle, Math Specialist Deb.Riddle@Alaska.gov 40