1. Introducing Edwin An integrated suite of teaching and learning tools

2. Our core strategies Prepare all students for success after high school by:  Strengthening curriculum, instruction, and assessment  Improving educator effectiveness  Turning around the lowest performing districts and schools  Using data and technology to support student performance Massachusetts Department of Elementary and Secondary Education 2

3. Student profiles An early warning indicator system Dashboards & reports Model curriculum units Curriculum mapping and Lesson planning tools Aligned to Standards Tools to assess student understanding of multiple standards Competency Tracking System Aligned to standards High-quality digital resources to support instruction Aligned to standards 3

4. What is Edwin Analytics?  Data Warehouse Merged into Edwin Login roles for Edwin Analytics remain the same as the EDW:  DW – (210) District User  DW – (211) School User  DW – Evaluator URL for Edwin Analytics remains the same as EDW  No need to update Trusted Sites Security Portal  Edwin Analytics link added

5. New Security Portal Link Data Warehouse v3.0 link will be gone. Edwin Analytics (EDW) will have Data Warehouse content. What is Edwin Analytics? Data Warehouse Announcement will explain the move. New Content in Edwin Analytics EWIS reports on the Student tab College Readiness reports on the Student tab

6. Accessing Edwin Log in with your Data Warehouse (EDW) ID 6

7. What is in Edwin Analytics?  What is the SAME: EDW reports are still available  What is NEW and available by the end of January:  Identify current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)  Identify how your former students did after they graduated from your school/district (Postsecondary Readiness and Success) 7

8. Early Warning Indicator System (EWIS) 8

9. 9 What are Early Warning Indicators?  Methodological way of looking at students and their likelihood of meeting specific academic goals  Traditionally implemented at the high school level to help predict which students are most likely to drop out  Tool for educators to better design and target student interventions in a timely way

10. MA EWIS Background  Department previously provided Early Warning Indicator Index (EWII) to predict the likelihood grade 9 students would graduate  Department worked with American Institutes for Research (AIR) to develop the new risk models  District feedback, e.g., focus groups and webinars  Rollout of EWIS in September via Security Portal 10

11. 11 Key Concepts  Massachusetts EWIS is for grade levels 1-12  Based on four grade-level groupings that are connected to key academic goals along the academic trajectory that are designed to be relevant to and actionable for educators  As a state, currently at different levels of achieving these four academic goals  Three EWIS risk levels: low, moderate, high  A student that is “low risk” is predicted to be likely to meet the academic goal

12. 12 Grade Groupings & Goals Age Groups Grade Levels Academic Goals (expected student outcomes for each age group) 2011-12 Statewide Results for Goal Early Elementary Grades 1-3 Proficient or advanced on 3rd grade ELA MCAS 61% Late Elementary Grades 4-6 Proficient or advanced on 6 th grade ELA and Mathematics MCAS 54% Middle Grades Grades 7-9 Passing grades on all 9 th grade courses75% High School Grades 10-12 High school graduation (four-year)84.7%

13. Key Concepts, continued  Provides risk level information for all students based on prior year data  The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students  Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level  Only includes data from existing statewide collections (SIMS and SCS) and state assessments (MCAS and MEPA) 13

14. 14 EWIS is / is not… The Massachusetts EWIS is…The Massachusetts EWIS is not… A tool to better target interventions and supports at the individual, small group, and whole school levels. A “life sentence” or a reason to label students. A systematic way to flag students that need to be further examined to determine what additional support are necessary. A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal. Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure. An accountability measure. Based on data and risk models that the Department will reexamine each year to continually improve the system. A stagnant system that will remain exactly the same in future years.

15. 15 Statewide EWIS Findings Early Elementary: P/A of Gr 3 ELA MCAS Late Elementary: P/A of Gr 6 ELA & math MCAS Middle Grades: Passing all Gr 9 courses High School: High school graduation Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10 Grade 11 Grade 12 High28.3%29.0%29.2%34.5%34.6%37.2%18.3%16.0%18.5%9.9%7.4%4.1% Mod.23.4%20.9%18.7%18.1%19.6%14.5%22.3%23.4%18.4%13.3%5.9%4.5% Low42.9%47.4%49.6%45.1%43.5%45.7%56.0%57.6%56.7%72.4%82.1%84.8% N/A5.4%2.7%2.5%2.3% 2.6%3.4%2.9%6.4%4.4%4.6%6.7%

16. Edwin Analytics: EWIS Reports  There are three EWIS reports in Edwin:  EWIS Student List (EW601)  EWIS District View (EW301)  EWIS Graphical View (EW302)  All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups) 16

17. EWIS Student List (EW601) 17  What are the current risk levels of my students?  What are the prior risk levels of my current students?  What data points (indicators) went into the calculation to determine the risk level?

18. 18

19. EWIS District View (EW301) 19  Which grade levels or schools have the most students that need targeted support in order to be on track to meet the next academic goal?  What is the breakdown of high, moderate, and low risk levels in a particular student subgroup (e.g. among students with disabilities)?  Where does the district need to focus additional resources to get students back on track for meeting the next academic goal?

20. 20

21. EWIS Graphical View (EW302) 21  How does a selected group of students compare to the district and state?  What are the previous risk levels of the currently enrolled students over the past 5 years?  E.g., what are the previous risk levels of my current 4 th grade male ELL students?  What are the risk levels of a specific student group over the past 5 years?  E.g., what are the risk levels of 4 th grade male ELL students each year over the last 5 years?

22. 22

23. Postsecondary Enrollment and Outcomes 23

24. How did our students do after graduating? Three new reports:  Postsecondary Outcomes of Public HS Graduates: All Institutions (CR301)  Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302)  Postsecondary Outcomes of Public HS Graduates: Academic Preparation (CR303) … but each is really several reports in one! 24

25. How many public high school graduates enroll postsecondary? … at MA public institutions? On top: data from CR301; on bottom: data from CR302 25

26. Where did students enroll? (Anywhere in the USA) This data from CR301 See CR302 for MA Public Institutions Only 26

27. What does persistence look like across subgroups? How many return for a 2 nd year? Data from CR301; See CR302 for MA Public Institutions Only 27

28. How many of your graduates obtain a degree?  How does that vary by subgroup?  How does that vary by the type of institution where students enroll? (4-year, 2-year, public, or private) Data from CR301; See CR302 for MA Public Institutions Only 28

29. What are enrollment rates of students who complete AP or Mass Core coursework ? Data from CR301; See CR302 for MA Public Institutions Only 29

30. Which type of institutions do they attend? Data from CR303 30

31. Of those in MA public postsecondary, what % enroll in remedial courses? In which subjects? Data from CR302 31

32. What are the MCAS scores of students who take remedial courses? Data from CR302 32

33. How many credits do graduates earn in their first year of college? What about developmental credits? Data from CR302 33

34. … and this is just the beginning of what we can do! We could also explore…  What is the relationship between MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)  What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)? 34

35. Comparing the Three Reports Potential QuestionsCR301CR302CR303 How many graduates go on to postsecondary?XXX What type of institutions (4-year/2-year, private/public) do graduates attend? XXX Which specific institutions did students attended? How many went to each? XX What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t? XXX What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework? X What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc) XXX What percentages of students enroll in and complete remedial courses? XX In what remedial subjects to do students enroll?X What are the MCAS scores of students who take remedial coursework in math and reading? XX How many credits, on average, do public high school graduates earn in their first year of college? XX 35

36. CR301: all institutionsCR302: MA public only Postsecondary data from National Student Clearing House (NSC) Postsecondary data from MA Department of Higher Education Enrollment anywhere in the USA Academic Preparation Persistence to 2 nd year Degree Obtainment Enrollment by Institution Name Enrollment at MA Public Postsecondary Only Academic Preparation 1 st Term Developmental Coursework 1 st Year Credit Obtainment Persistence to 2 nd year Degree Obtainment Enrollment by Institution Name Comparing Reports 36

37. CR303: Postsecondary Outcomes by Academic Preparation For each of the following high school metrics:  MassCore Completion  AP Course Completion  MCAS 10th Grade ELA  MCAS 10th Grade Math  MCAS High School Science...we can look at the following outcomes:  Postsecondary Enrollment, Persistence, and Degree Obtainment (all postsecondary institutions)  MA Public Postsecondary Enrollment, Persistence, and Degree Obtainment  MA Public 1st Yr. Avg Credit Obtainment  MA Public 1st Term Developmental Enrollment  MA Public 1st Yr Avg. Developmental Credit Obtainment 37

38. Refining your search 38

39. What else is coming?  Spring 2013:  Postsecondary Readiness and Success for Adult Basic Education (ABE) graduates  Classroom-level reports for educators  School readiness reports for K-3 educators  Fall 2013:  Educator evaluation reports  District financial analysis 39

40. 40 For more information…  Watch the Edwin website for updates, including materials and professional development opportunities: www.doe.mass.edu/Edwinwww.doe.mass.edu/Edwin  Follow Edwin on Twitter! @ Edwin_DESE  Questions can be submitted to: Edwin@doe.mass.edu Edwin@doe.mass.edu  If you need access to Edwin Analytics – contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx) http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx