1. Katherine Beck, Program Effectiveness Supervisor, ELA CoTESOL 2015 Convention 11/6/15 Helping teachers evaluate EL progress to English language acquisition using WIDA ACCESS for ELLs

3. PURPOSE This interactive workshop illustrates how the Denver Public Schools prepares its teachers and administrators to use ACCESS Status, Trajectory, and Growth data.

4. GOAL 1 Participants understand ACCESS achievement (Status) data and ACCESS MGPs, and are introduced to the DPS ACCESS Trajectory.

5. GOAL 2 Participants practice interpreting that data for students with different English proficiency levels in different domains of language.

6. ROLES I will facilitate our 45 minutes together. I will modify my delivery to your needs. You will participate and practice. You will ask questions!

7. AGENDA 5 minutes – Welcome! 15 minutes – Status, Growth, and Trajectory 20 minutes – Student data practice 5 minutes – Wrap Up

8. PERSONAL OUTCOMES

9. INSIGHTS, IDEAS, APPLICATION

10. WIDA ACCESS FOR ELLS (ASSESSING COMPREHENSION AND COMMUNICATION IN ENGLISH STATE-TO-STATE FOR ENGLISH LANGUAGE LEARNERS) Primary source of information used for monitoring a student’s progress in acquiring academic English. ACCESS data are used by teachers at DPS in three ways: –ACCESS Status, MGPs, and DPS ACCESS Trajectory Current year and Prior year histories 10

11. ACCESS TRAININGS AT DPS To facilitate the use of ACCESS Status, MGPs, and DPS ACCESS Trajectory, and to help schools make better decisions based on these data, the English Language Acquisition department developed guidance and an interactive training program for teachers and schools. To better understand their results, schools were offered: –Webinars –One-on-one data-dives –Reflection guides –Walkthrough opportunities. 11

12. GOAL 1 Participants understand ACCESS achievement (Status) data and ACCESS MGPs, and are introduced to the DPS ACCESS Trajectory.

21. DRAWING CONCLUSIONS AND NEXT STEPS FROM THE DATA The students who are most off-track have stalled at a Level 4 on English proficiency. Most students at Level 3 and Level 4:Year 1 are behind their on-track target proficiency level by 2 levels. The progression from Level 3 to Level 4 is the hardest to complete in just one year. In order to prevent stalling while a student is a Level 3 and to facilitate early intervention while at Level 4, it would be beneficial to work with Level 3 students on Level 4 WIDA Can-Do skills earlier. Instructional guidance can specifically target students to help them move from Level 3 to Level 4 and Level 4 to Level 5. 21

22. Off-track students may fall under the radar because of excellent (Level 5, Level 6) speaking skills. Identify students’ skills at each domain (not just their Overall proficiency score), so as to not be misled by their social speaking skills. This further enables the creation of a personalized plan which supports the students across all the domains. 22 DRAWING CONCLUSIONS AND NEXT STEPS FROM THE DATA

23. GOAL 2 Participants practice interpreting data for students with different English proficiency levels in different domains of language.

24. STUDENT AND SCHOOL DATA DIVE Through manipulating real school data, learn how we enabled our schools to make data informed decisions for English language learners. Review: Reading, Writing, Speaking, and Listening domains utilizing the ACCESS ELP (English language proficiency) levels MGP Growth results "Trajectory to English Language Proficiency". Leave the session with skills to use in your classrooms with your students. 24

25. ACCESS FOR ELLS REPORT (STATUS RESULTS) Overall Reporting Levels: –School and District/Region Results by –School –Measure Codes –Grades –Subgroup 25

26. WHAT DO YOU SEE? 26 Results by School Config ELL*FRL*SPED*Minority*Enrollment* ELA Desig nationN No Score (NS) Entering (1)Emerging (2)Developing (3)Expanding (4)Bridging (5)Reaching (6) Bridging & Reaching (5+) High33 %95 %12 %94 %1477TNLI554 6%3%15%22%19%18%16%34% Click here for Tested Student List

27. WHAT DO YOU SEE? 27 Results by Measure Code MeasureTotalNo Score (NS)Entering (1)Emerging (2)Developing (3)Expanding (4)Bridging (5)Reaching (6)Bridging & Reaching (5+) Comprehension554346 %193 %8215 %12022 %10819 %10218 %8916 %19134 % Listening554346 %255 %499 %8716 %14326 %12122 %9517 %21639 % Literacy554346 %183 %6111 %12022 %16430 %12022 %377 %15728 % Oral554366 %5310 %468 %5710 %10719 %14125 %11421 %25546 % Overall554377 %244 %519 %9918 %16329 %12923 %519 %18032 % Reading554336 %204 %13124 %11020 %6412 %9918 %9718 %19635 % Speaking554295 %8916 %458 %5410 %5410 %468 %23743 %28351 % Writing554346 %244 %417 %10118 %22240 %12523 %71 %13224 % Click here for Tested Student List

28. WHAT DO YOU SEE? 28 Results by Grade GradeTotalNo Score (NS)Entering (1)Emerging (2)Developing (3)Expanding (4)Bridging (5)Reaching (6)Bridging & Reaching (5+) 09227104 %73 %198 %2712 %5926 %7232 %3315 %10546 % 101311310 %86 %118 %1915 %4635 %2620 %86 %3426 % 1110666 %6 1615 %2322 %2826 %2019 %77 %2725 % 129089 %33 %56 %3033 %3033 %1112 %33 %1416 % Click here for Tested Student List

29. WHAT DO YOU SEE? 29 Results by Subgroup GenderTotalNo Score (NS)Entering (1)Emerging (2)Developing (3)Expanding (4)Bridging (5)Reaching (6)Bridging & Reaching (5+) F246167%104%2410%5221%6627%6024%187%7832% M308217%145%279%4715%9731%6922%3311%10233% FRL Eligible534346%244%479%9818%15729%12724%479%17433% Not Eligible20315%00%420%15%630%210%420%630% SPED No507357%245%449%8417%14428%12525%5110%17635% Yes4724%00%715%1532%1940%49%00%49% Spanish Lang BG No4225%2 1024%819%1024%614%410%1024% Yes512357%224%418%9118%15330%12324%479%17033% Click here for Tested Student List

30. ACCESS MEDIAN GROWTH PERCENTILES REPORT (MGP GROWTH RESULTS) Overall Reporting Levels: –School and District/Region Results by –Year 30

31. WHAT DO YOU SEE? 31 Results by Year x Grade School Overall CELAACCESSCELA-ACCESSACCESS Grade2012201312-13 Change201413-14 Change201514-15 Change 95857.5-0.5602.554-6 1047672063-448.5-14.5 114561.516.551-10.5554 124549.54.547.5-2524.5 All525865753-4 District Overall 14946-3559605 2545360751-9 351 0671666 45455160557-3 5575662655-7 65754-355150-5 75653-353051-2 85451-3532541 95255.53.5626.557-5 104757.510.5613.551-10 114258.516.557-1.555-2 1241561556054-2 * Median growth percentiles based on fewer than 20 students have been suppressed due to the potential for inaccurate conclusions. Scores for individual students are available in district online applications.

32. ACCESS PROFICIENCY LEVEL CHANGE REPORT (STATUS RESULTS) Overall Reporting Levels: –School and District/Region Results by –Measure Code 32

33. WHAT DO YOU SEE? 33 Results by Measure Code

34. ACCESS TRAJECTORY REPORT (TRAJECTORY GROWTH RESULTS) Overall Reporting Levels: –District –School 34

35. ACCESS TRAJECTORY REPORT Report Report User Guide Guiding Questions District Key Findings 35

36. ACCESS TRAJECTORY REPORT 36

37. ACCESS TRAJECTORY REPORT 37

38. WHAT DO YOU SEE? - GUIDE 38 Questions to help you enhance your supports for ELs: How are your ELs doing? What is the on-track rate at your school? How does your school on-track rate compare to the district’s rate? How does your school’s on-track rate compare to other schools in my network or similar schools?

39. WHAT DO YOU SEE? Data Trends: At which proficiency bands/levels do students have higher on-track rates? At which proficiency bands/levels do students have lower on-track rates? What trends do you notice among your on-track students? –Did they tend to score at specific proficiency bands/levels? –Do you notice any other trends among these students? –What factors might have influenced the performance of these students? Consider programming and services last year, ELD enrollment, etc. –How might you build on this knowledge to further support students? What trends do you notice among your off-track students? –Did they tend to score at specific proficiency bands/levels? –What factors might have influenced the performance of these students? Consider programming and services last year, ELD enrollment, etc. –How many levels away from their Trajectory Target ACCESS level do these students tend to be? SL o Do you notice any other trends among these students? –How might you build on this knowledge to further support students? 39

40. WHAT DO YOU SEE? Data Trends: What trends do you notice within and across domains among on-track students? Among off-track students? –What do you notice about the on-track students when you look at performance by each domain (i.e., Speaking, Listening, Reading, Writing)? And your off-track students? –Are there differences in performance between productive domains (writing & speaking) and receptive domains (reading & listening)? –Are there subgroups of students who scored higher? Lower? What are the commonalities between these students? –How might you support these students to strengthen performance within the identified domains? What trends do you notice within grade levels among on-track students? Among off-track students? –Which grades have high numbers of on-track students? Can lessons be learned from these grade levels and applied in other grade levels? –Which grades have high numbers of off-track students? –How might you use this knowledge to strategically engage supports/resources to support students? What trends do you notice among students who have one year of ACCESS scores? –What is the distribution of students with only one year of ACCESS status? –How did these students perform in each domain? –Do you notice any other trends among these students? –How might you build on this knowledge to further support students? 40

41. WHAT DO YOU SEE? Implications & Next Steps –What were areas of focus for English Learners at your school or network in 2014-15? Are these reflected in the data? –What are your school’s strengths? –What are the areas to target for development? –What instructional practices and curriculum from the previous year may need to be adjusted? –What specific actions/strategies/resources can you use to support all students? Areas to consider include: Placement of students (including ELD block scheduling) Classroom materials o Curricula, including ELD Teacher support o Note: consider what resources are needed to implement the instructional focus –Who will be in charge of leading further discussion on this subject? –What additional evidence might be needed to confirm or support these findings? 41

42. ACCESS TRAJECTORY REPORT (TRAJECTORY GROWTH RESULTS) ACCESS Trajectory Student List 42 2014-15 ACCESS Trajectory Results On-track Status ACCESS Trajectory Starting Year ACCESS Starting Proficiency Level for Starting Year ACCESS Current Proficiency Level 2014-15 Trajectory Target Levels Ahead of Trajectory Target Off-track2013Overall Level 4 Overall Level 4 and GP>AGPOverall Level 5+ Off-track2013 Overall Level 5+ and Literacy Level 5+Overall Level 3 Overall Level 5+ and Literacy Level 5+-4 On-track2013 Overall Level 5+ and Literacy Level 5+ 0 First Year of Data2015 Overall Level 5+ and Literacy Level 5+ 0 Off-track2013Overall Level 5+Overall Level 4 Overall Level 5+ and Literacy Level 5+-3 Off-track2013Overall Level 4 Overall Level 4 and GP>AGPOverall Level 5+ Off-track2013Overall Level 4 Overall Level 5+-2 Off-track2013Overall Level 4 Overall Level 5+-2 On-track2013Overall Level 4 Overall Level 5+ and Literacy Level 5+Overall Level 5+1 Off-track2013Overall Level 4 Overall Level 4 and GP>AGPOverall Level 5+ On-track2014 Overall Level 5+ and Literacy Level 5+ 0

43. ACCESS TRAJECTORY REPORT (TRAJECTORY GROWTH RESULTS) 43 Current School Name The school and network where the student is currently enrolled (as of the run-date for the report). Current School Number Current School Network Tested School Name The school and network where the student took the 2015 ACCESS test. Tested School Number Tested School Network Current GradeThe student's current 2015-16 grade. Current EL Status Students included in the report: In-service ELs (also includes Provisional Els); Redesignated/Exited ELs; Non-ELs (this may not have been status at time of test) Current Program Placement The type of ELA services in which the student is enrolled; this is based on the teacher's designation (for Elementary) or course designation in which the student is enrolled (for Secondary). Possibilities: ELA-E, ELA-S, Dual Language, Mainstream. Current PPF Selection Parent Permission Form: The parent preference for type of ELA services the student recieves. Possibilities: PPF1 (Spanish-instruction); PPF2 (English-instruction); PPF3 (opt-out of ELA Services); Null (no PPF on file). Background LanguageThis represents the student's "home" or native language, and is based on the student's Home Language Questionaire (HLQ). Current Special Ed StatusWhether or not the student recieves Special Ed services. Long-term English Learner (LTEL) Status Whether or not the student is a Long-term English Learner. The Research Brief on LTEL gives background info and guidance on how to support these students. Click on "2015-2016 Research Briefs" for more. On-track Status Whether or not the student is on-track to ACCESS proficiency. Possibilities: On-track; Off-track; First Year of Data (student needs 2 or more years of ACCESS scores in DPS to have a Trajectory calculation); Cannot determine (not enough information to calculate on-track status, due to having a No Score (NS) or not having a Growth Score). ACCESS Trajectory Starting YearThe year that the student first received an overall ACCESS score in DPS (cannot be a No Score). ACCESS Starting Proficiency Level for Starting Year The overall ACCESS proficiency level for the student's Starting Year. ACCESS Current Proficiency Level The overall ACCESS proficiency level for the student's most recent ACCESS score. 2014-15 Trajectory TargetThe overall ACCESS proficiency level the student needs to be at or above to be on-track. This is calculated based on the student's first ACCESS score. Levels Ahead of Trajectory Target The number of proficiency levels the student is currently above (or below) where they need to be to be on-track on the ACCESS Trajectory. A positive number means the student is ahead. A negative number means the student is behind. A zero means the student is exactly where they should be, as per the Trajectory. ACCESS Domains ACCESS domain and composite scores are given for 2014-15, 2013-14, 2012-13. The values will be populated for only the years that the student received ACCESS results in DPS. Growth Percentile The Growth Percentile shows how an EL progressed on ACCESS Overall during the past year, as compared to peers with similar score histories. It is calculated by the Colorado Department of Education. This field is populated if the student has a 2014-15 Trajectory Target of "ACCESS Overall 4 and GP>AGP". Adequate Growth Percentile The Adequate Growth Percentile tells us whether the year’s growth was sufficient for students to reach or maintain English language proficiency in the expected time frame. It is calculated by the Colorado Department of Education. This field is only filled out if the student has a 2014-15 Trajectory Target of "ACCESS Overall 4 and GP>AGP". GP>AGP Whether or not the Growth Percentile exceeds the Adequate Growth Percentile. If the student has a 2014-15 Trajectory Target of "ACCESS Overall 4 and GP>AGP", ACCESS growth scores are given for 2014-15. For this level, the student will be on-track if the GP>AGP, and off-track if the GP<AGP.

44. PERSONAL OUTCOMES

45. INSIGHTS, IDEAS, APPLICATION

46. CONTACT Katherine_Beck@dpsk12.org Program Effectiveness Supervisor English Language Acquisition Department