1. Massachusetts Department of Elementary & Secondary Education 1 College and Career Readiness Webinar Series: College and Career Readiness Data Tools District and School Profiles

2. Massachusetts Department of Elementary & Secondary Education 2 About the C&CR Webinar Series SeptemberSept 15, 2015 Edwin: EWIS and Post Secondary Reports http://www.doe.mass.edu/co nference/?ConferenceID=8169 OctoberOct 13, 20159 th Grade Transition http://www.doe.mass.edu/co nference/?ConferenceID=8170 NovemberNov 17, 2015Labor Market Information http://www.doe.mass.edu/co nference/?ConferenceID=8171 JanuaryJan 12, 2016Individual Learning Plans http://www.doe.mass.edu/co nference/?ConferenceID=8172 FebruaryFeb 9, 2016Graduation Rates http://www.doe.mass.edu/co nference/?ConferenceID=8173 MarchMarch 8, 2016Career Development Education http://www.doe.mass.edu/co nference/?ConferenceID=8174 AprilApril 13, 2016 Maximizing Graduation Coaches and Other Adult Advocates http://www.doe.mass.edu/co nference/?ConferenceID=8175 MayMay 10, 2016Early College Pathwayshttp://www.doe.mass.edu/co nference/?ConferenceID=8176

3. Massachusetts Department of Elementary & Secondary Education 3 Welcome!  Please type your question or comment in the chat window at any point during the presentation  All phones will be muted  PowerPoint slides will be sent to all registered participants

4. Massachusetts Department of Elementary & Secondary Education 4 Goals for the Session  Understanding of the nature of data  Introduction to college and career readiness data tools offered by ESE “Information is a beacon, a cudgel, an olive branch, a deterrent--all depending on who wields it and how.” Steven Levitt

5. Massachusetts Department of Elementary & Secondary Education 5 The Nature of things… Qualitative dataQualitative data are everything that refers to the quality of something. For example, a description of experiences, observations and interviews are all qualitative data. Quantitative dataQuantitative data are data that refers to a number. The numbers of students, test scores, anything that can be added, multiplied, subtracted or divided. Simply put, data is information that helps in our decision making.

6. Massachusetts Department of Elementary & Secondary Education 6 What is the Cycle of Inquiry?

7. Massachusetts Department of Elementary & Secondary Education 7 Making the Data Dance  Data is a tool…  Data can help inform our decisions…  Behind the data are real human beings…  Use data to tell the story…  Data is our friend…

8. Massachusetts Department of Elementary & Secondary Education 8 School Profiles: http://profiles.doe.mass.edu/http://profiles.doe.mass.edu/  Graduation rates, MCAS results, discipline data Edwin Analytics: https://gateway.edu.state.ma.us/https://gateway.edu.state.ma.us/  Early Warning Indicator System (EWIS) reports  Postsecondary Readiness and Success reports Success After High School DART: http://www.doe.mass.edu/apa/dart/SAHS.xlsx  5-year trend lines for individual high schools Overviews of College & Career Readiness related data tools

9. Massachusetts Department of Elementary & Secondary Education Profiles 9

10. Massachusetts Department of Elementary & Secondary Education First, a quick look at Profiles 10 http://profiles.doe.mass.edu/ Profiles are a great way to find basic information about schools and districts and also acts as an access point to a great deal of other publicly available data.

11. Massachusetts Department of Elementary & Secondary Education Edwin Analytics 11

12. Massachusetts Department of Elementary & Secondary Education 12 What is Edwin Analytics?  Goes beyond but includes reports previously available in the Education Data Warehouse (EDW)  A state-level platform that provides a more comprehensive view of students, teachers, schools, districts and the state;  Timely and actionable information that empowers educators and informs better decision making at every level  Tools and resources that will help educators improve teaching, learning, school readiness and education outcomes  New reports are constantly being added

13. Massachusetts Department of Elementary & Secondary Education 13 Out of the many reports in Edwin Analytics, today we are focusing on…  Identifying current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)  Identifying how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)

14. Massachusetts Department of Elementary & Secondary Education Early Warning Indicator System (EWIS) 14

15. Massachusetts Department of Elementary & Secondary Education 15 What are Early Warning Indicators?  Methodological way of looking at students and their likelihood of meeting specific academic goals  Traditionally implemented at the high school level to help predict which students are most likely to drop out  Tool for educators to better design and target student interventions in a timely way

16. Massachusetts Department of Elementary & Secondary Education 16 Grade Groupings & Goals == Age Groups Grade Levels Academic Goals (expected student outcomes for each age group) 2013-14 Statewide Results for Goal Early Elementary Grades 1-3 Reading by the end of third grade: Reaching proficient or advanced on 3 rd grade ELA MCAS 57% Late Elementary Grades 4-6 Middle school ready: Reaching proficient or advanced on 6 th grade ELA and math MCAS 54% Middle Grades Grades 7-9 High school ready: Passing grades on all 9 th grade courses 78% High School Grades 10-12 High school graduation: Meeting all local and state graduation requirements 85% Use when setting school and district goals!

17. Massachusetts Department of Elementary & Secondary Education 17 EWIS Key Concepts  Provides risk level information for all students based on prior year data  The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students  Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level  Only includes data from existing statewide collections (SIMS, SSDR and SCS) and state assessments (MCAS and ACCESS)

18. Massachusetts Department of Elementary & Secondary Education 18 EWIS is / is not… == The Massachusetts EWIS is…The Massachusetts EWIS is not… A tool to better target interventions and supports at the individual, small group, and whole school levels. A “life sentence” or a reason to label students. A systematic way to flag students that need to be further examined to determine what additional support are necessary. A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal. Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure. An accountability measure. Based on data and risk models that the Department will reexamine each year to continually improve the system. A stagnant system that will remain exactly the same in future years.

19. Massachusetts Department of Elementary & Secondary Education 19 Edwin Analytics: EWIS Reports There are Five EWIS reports in Edwin:  EWIS District View (EW301)  EWIS Student List (EW601)  EWIS Graphical View (EW302)  EWIS Risk Level Indicator Analysis (EW317)  EWIS Subgroup Analysis (EW318)  All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups)

20. Massachusetts Department of Elementary & Secondary Education 20 EW301: District Overview

21. Massachusetts Department of Elementary & Secondary Education 21 School Name Gr ad e Last Name First Name SASID Risk Level Attend Rate Susp ensio n Retain ed Scho ol Move Low Income SPED Level Gender Urban Reside nce Overag e Title1 School wide ACCES S for ELLs ELA MCAS 2014 Math MCAS 2014 Math Course Perf ELA Course Perf Sci Course Perf SS Course Perf Non- Core Course Perf Previo us Year Risk Level Race/E thnicit y ELL ELL Progra m Special Educat ion Placem ent Any High School 9AardvarkArnold High98%0No FreeNoneFemaleYesNoYes1.8--Pass N/AHispani c or Latino YEnrolled in sheltere d English immersi on Not a Special Educati on Student, age 6-21 Any High School 9BaileyBilly High90%0No FreeModerat e FemaleYes NoneNeeds Improve ment WarningPass Fail HighWhiteNN/AFull Inclusio n special educatio n services outside the general educatio n classroo m less than 21% of the time Any High School 9ColoradoCarlos High88%0No ReducedNoneFemaleYesNoYes2.6--Pass N/AWhiteYEnrolled in sheltere d English immersi on Not a Special Educati on Student, age 6-21 Any High School 9DentonDaisy High99%0No FreeNoneMaleYes NoneProficie nt Needs Improve ment Pass FailPassFailHighHispani c or Latino NN/ANot a Special Educati on Student, age 6-21 Any High School 9EverettElena High74%0NoYesFreeNoneFemaleYesNoYesNoneNeeds Improve ment WarningPass FailHighWhiteNN/ANot a Special Educati on Student, age 6-21 EW601: The Student Level Student ID info Indicators in the risk model Student info

22. Massachusetts Department of Elementary & Secondary Education 22 EW302: Graphical View

23. Massachusetts Department of Elementary & Secondary Education 23 EWIS Risk Level Indicator Analysis (EW317) A tool to analyze specific attendance, behaviors, and course Early Warning Indicator System (EWIS) indicators for students in each risk level for a selected grade. EWIS Subgroup Analysis (EW318) Provides educators with aggregate student risk levels of not achieving their next educational outcome as determined by the Early Warning Indicator System (EWIS) by student subgroups within a District THE NEWEST EWIS TOOLS!

24. Massachusetts Department of Elementary & Secondary Education 24 Insert EW 318 Screen shot

25. Massachusetts Department of Elementary & Secondary Education 25 Insert EW317 Screen shot Sample of larger amount of data

26. Massachusetts Department of Elementary & Secondary Education Postsecondary Outcome Reports 26

27. Massachusetts Department of Elementary & Secondary Education 27 Postsecondary Outcomes of Public High School Students Collecting and analyzing data about what college-bound students actually do after graduating high school helps district and school leaders assess the effectiveness of their programs in developing graduates who are college ready. The data for these reports are drawn from existing ESE data sources such as SIMS, SCS and MCAS as well as College Board (for SAT), the Mass. Dept. of Higher Education HEIRS system and the National Student Clearinghouse.

28. Massachusetts Department of Elementary & Secondary Education How did our students do after graduating? The Three Basic Reports:  Postsecondary Outcomes of Public HS Graduates: All Institutions (CR301)  Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302)  Postsecondary Outcomes of Public HS Graduates: Academic Preparation (CR303) 28

29. Massachusetts Department of Elementary & Secondary Education Comparing the Three Reports Potential QuestionsCR301CR302CR303 How many graduates go on to postsecondary?XXX What type of institutions (4-year/2-year, private/public) do graduates attend? XXX Which specific institutions did students attended? How many went to each? XX What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t? XXX What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework? X What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc) XXX What percentages of students enroll in and complete remedial courses? XX In what remedial subjects to do students enroll?X What are the MCAS scores of students who take remedial coursework in math and reading? XX How many credits, on average, do public high school graduates earn in their first year of college? XX 29 Use when setting school and district goals!

30. Massachusetts Department of Elementary & Secondary Education 30 How many high school graduates enroll in postsecondary education? … at MA public institutions? On top: data from CR301; on bottom: data from CR302 Drill down to student level records

31. Massachusetts Department of Elementary & Secondary Education 31 What Types of Institutions are Your Students Attending?

32. Massachusetts Department of Elementary & Secondary Education 32 What does persistence look like across subgroups? How many return for a 2 nd year?

33. Massachusetts Department of Elementary & Secondary Education 33 Where did students enroll? (Anywhere in the US) This data from CR301 See CR302 for MA Public Institutions Only

34. Massachusetts Department of Elementary & Secondary Education 34 What are enrollment rates of students who complete AP or MassCore?

35. Massachusetts Department of Elementary & Secondary Education 35 Of those in MA public postsecondary, what % enroll in remedial courses? In which subjects? Data from CR302

36. Massachusetts Department of Elementary & Secondary Education 36 How many of your graduates obtain a degree?

37. Massachusetts Department of Elementary & Secondary Education 37 … and this is just the beginning of what we can do! We could also explore…  What is the relationship between MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)  What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?

38. Massachusetts Department of Elementary & Secondary Education 38 Several additional new Edwin Analytics reports may assist schools and districts in analyzing post-secondary data for program improvement. CR304 Postsecondary Outcomes of Public HS Graduates View by MA Public Postsecondary Institution: Details postsecondary enrollment, achievement, and outcomes of MA public graduating students from a fall enrollment class in a specific MA public postsecondary institution. It also contains details by “feeder” MA public high schools. (Postsecondary data source: MA Department of Higher Education)Postsecondary Outcomes of Public HS Graduates View by MA Public Postsecondary Institution: CR321 CVTE Graduate Pathway Summary: MA Public Postsecondary: Details postsecondary enrollment, outcomes, and continuation of vocational field of study for MA public school graduates who were CVTE concentrators and who enrolled in a MA public postsecondary institution. (Postsecondary data source: MA Department of Higher Education)CVTE Graduate Pathway Summary: MA Public Postsecondary: Additional Post-Secondary Reports

39. Massachusetts Department of Elementary & Secondary Education 39 Two other reports are available on the Student tab for those who have been granted access to student-level data: CR608 Student High School Academic Preparation and Postsecondary Experience: This source provides student-level high school academic experience, postsecondary enrollment, and outcomes for students graduating from MA public schools and enrolling in public or private postsecondary institutions.. (Postsecondary data source: National Student Clearinghouse) CR601 Student Progress towards MassCore: While not specific to postsecondary education, this report displays a list of high school students and their progress towards completing the MassCore recommended program of study. It identifies students who are falling behind, enables drill-drown to investigate course completion for specific students, and is available for all students in grades 9-12. Student Level Data

40. Massachusetts Department of Elementary & Secondary Education 40 For more information…  Watch the Edwin website for updates, including materials and professional development opportunities: www.doe.mass.edu/Edwinwww.doe.mass.edu/Edwin  Follow Edwin on Twitter! @ Edwin_DESE  Questions can be submitted to: Edwin@doe.mass.eduEdwin@doe.mass.edu  If you need access to Edwin Analytics – contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx) http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx  EWIS use workshop day: October 1: http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator- System-EWIS-Workshop-10-1-15 http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator- System-EWIS-Workshop-10-1-15  Early warning implementation guide available at http://www.doe.mass.edu/edwin/analytics/ewis.html http://www.doe.mass.edu/edwin/analytics/ewis.html

41. Massachusetts Department of Elementary & Secondary Education Success After High School DART Detail 41

42. Massachusetts Department of Elementary & Secondary Education The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information. The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations. DARTs are free and available to the public on the ESE website What is the DART? 46

43. Massachusetts Department of Elementary & Secondary Education 43 What is the Success After High School DART?  The Success After High School Dart is a DART: Detail tool  DART: Detail tools provide in-depth data on targeted topic areas  The Department already released DART Detail’s: Staffing and Finance and English Language Learners to go along with the more comprehensive DART tools  The intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well- organized, accessible format for schools, districts, non-profit organizations, researchers, families and the general public.

44. Massachusetts Department of Elementary & Secondary Education 44 Example elements for DART Detail: Success After High School  High School Indicators: Graduation, dropout, suspension, and retention rates.  High School Performance: Students scoring proficient on MCAS, students scoring on SAT and AP tests, and participation in SAT and AP tests.  Program of Study: Students completing MassCore and Advanced Placement coursework. Students passing all ninth grade courses, Students passing 12 th grade mathematics and science technology/engineering coursework. Use when setting school and district goals!

45. Massachusetts Department of Elementary & Secondary Education 45 Example elements for DART Detail: Success After High School (continued)  Post-Secondary Educational Outcomes: Students enrolling in post-secondary education, students persisting in post-secondary education, percentage of students enrolling in developmental (remedial) coursework in Massachusetts Public Colleges.  Workforce Development: Students participating in career/technical education by cluster, Students completing work based learning plans and Connecting Activities, links to other regional workforce development data. Use when setting school and district goals!

46. Massachusetts Department of Elementary & Secondary Education 46 DART for Success After High School is a publicly accessible tool that provides a snapshot of high school, postsecondary, and career development education data. This tool allows users such as district and school staff, parents, students, workforce partners and organizations to:  Find comparable high schools based on demographic characteristics  Look at trends over several years  View school data in charts that are easy to interpret  Evaluate and reflect on schools and their progress

47. Massachusetts Department of Elementary & Secondary Education 47 Find comparable high schools based on demographic characteristics Comparable schools

48. Massachusetts Department of Elementary & Secondary Education 48 Trend over several years with easy to interpret charts

49. Massachusetts Department of Elementary & Secondary Education 49 “The Waterfall”

50. Massachusetts Department of Elementary & Secondary Education 50 And recently released!

51. Massachusetts Department of Elementary & Secondary Education 51 The Success After High School DART is available at http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx It is openly accessible to anyone, however it is a large file due to all the data in the file, so… a.it is best to download it to your computer and b.won’t go through most email systems

52. Massachusetts Department of Elementary & Secondary Education 52 Questions or comments?