Massachusetts Department of Elementary & Secondary Education College and Career Readiness Webinar Series: Tools to be CCR Data-Wise September 17, 2013

Massachusetts Department of Elementary & Secondary Education 2 Welcome!  Please type your question or comment in the chat window at any point during the presentation  All phones will be muted  PowerPoint slides will be sent to all registered participants

Massachusetts Department of Elementary & Secondary Education 3 About the C&CR Webinar Series  New for the school year – monthly webinars on a variety of college and career readiness topics  Typically held on the 3 rd Tuesday of month at 2:00  The October 15 th webinar on topic of career development education

Massachusetts Department of Elementary & Secondary Education 4 Webinar Agenda  Overviews of two College and Career Readiness related data tools that were released last winter through Edwin Analytics:  Early Warning Indicator System (EWIS) reports  Postsecondary Readiness and Success reports  Preview of the new College & Career Readiness DART that will be available soon  Q&A

Massachusetts Department of Elementary & Secondary Education Edwin Analytics 5

Massachusetts Department of Elementary & Secondary Education Student profiles An early warning indicator system Dashboards & reports Model curriculum units Curriculum mapping and Lesson planning tools Aligned to Standards Tools to assess student understanding of multiple standards Competency Tracking System Aligned to standards High-quality digital resources to support instruction Aligned to standards 6

Massachusetts Department of Elementary & Secondary Education 7 What is Edwin Analytics?  What is the SAME: Education Data Warehouse (EDW) reports are still available  What is NEW and NOW available:  Identify current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)  Identify how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)

Massachusetts Department of Elementary & Secondary Education Early Warning Indicator System 8

Massachusetts Department of Elementary & Secondary Education 9 What are Early Warning Indicators?  Methodological way of looking at students and their likelihood of meeting specific academic goals  Traditionally implemented at the high school level to help predict which students are most likely to drop out  Tool for educators to better design and target student interventions in a timely way

Massachusetts Department of Elementary & Secondary Education 10 MA EWIS Background  Department previously provided Early Warning Indicator Index (EWII) to predict the likelihood grade 9 students would graduate  Department worked with American Institutes for Research (AIR) to develop the new risk models  District feedback, e.g., focus groups and webinars  First rollout of EWIS in school year

Massachusetts Department of Elementary & Secondary Education 11 Grade Groupings & Goals == Age Groups Grade Levels Academic Goals (expected student outcomes for each age group) Statewide Results for Goal Early Elementary Grades 1-3 Proficient or advanced on 3rd grade ELA MCAS 61% Late Elementary Grades 4-6 Proficient or advanced on 6 th grade ELA and Mathematics MCAS 54% Middle Grades Grades 7-9 Passing grades on all 9 th grade courses75% High School Grades High school graduation (four-year)84.7%

Massachusetts Department of Elementary & Secondary Education 12 Key Concepts, continued  Provides risk level information for all students based on prior year data  The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students  Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level  Only includes data from existing statewide collections (SIMS and SCS) and state assessments (MCAS and ACCESS)

Massachusetts Department of Elementary & Secondary Education 13 EWIS is / is not… == The Massachusetts EWIS is…The Massachusetts EWIS is not… A tool to better target interventions and supports at the individual, small group, and whole school levels. A “life sentence” or a reason to label students. A systematic way to flag students that need to be further examined to determine what additional support are necessary. A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal. Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure. An accountability measure. Based on data and risk models that the Department will reexamine each year to continually improve the system. A stagnant system that will remain exactly the same in future years.

Massachusetts Department of Elementary & Secondary Education 14 Edwin Analytics: EWIS Reports  There are three EWIS reports in Edwin:  EWIS Student List (EW601)  EWIS District View (EW301)  EWIS Graphical View (EW302)  All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups)

Massachusetts Department of Elementary & Secondary Education 15 EWIS Student List (EW601)  What are the current risk levels of my students?  What are the prior risk levels of my current students?  What data points (indicators) went into the calculation to determine the risk level?

Massachusetts Department of Elementary & Secondary Education 16

Massachusetts Department of Elementary & Secondary Education 17 EWIS District View (EW301)  Which grade levels or schools have the most students that need targeted support in order to be on track to meet the next academic goal?  What is the breakdown of high, moderate, and low risk levels in a particular student subgroup (e.g. among students with disabilities)?  Where does the district need to focus additional resources to get students back on track for meeting the next academic goal?

Massachusetts Department of Elementary & Secondary Education 18

Massachusetts Department of Elementary & Secondary Education 19 EWIS Graphical View (EW302)  How does a selected group of students compare to the district and state?  What are the previous risk levels of the currently enrolled students over the past 5 years?  E.g., what are the previous risk levels of my current 4 th grade male ELL students?  What are the risk levels of a specific student group over the past 5 years?  E.g., what are the risk levels of 4 th grade male ELL students each year over the last 5 years?

Massachusetts Department of Elementary & Secondary Education 20

Massachusetts Department of Elementary & Secondary Education Postsecondary Outcome Reports 21

Massachusetts Department of Elementary & Secondary Education How did our students do after graduating? Three reports:  Postsecondary Outcomes of Public HS Graduates: All Institutions (CR301)  Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302)  Postsecondary Outcomes of Public HS Graduates: Academic Preparation (CR303) 22

Massachusetts Department of Elementary & Secondary Education 23 How many public high school graduates enroll postsecondary? … at MA public institutions? On top: data from CR301; on bottom: data from CR302

Massachusetts Department of Elementary & Secondary Education 24 Where did students enroll? (Anywhere in the USA) This data from CR301 See CR302 for MA Public Institutions Only

Massachusetts Department of Elementary & Secondary Education 25 What does persistence look like across subgroups? How many return for a 2 nd year? Data from CR301; See CR302 for MA Public Institutions Only

Massachusetts Department of Elementary & Secondary Education 26 How many of your graduates obtain a degree?  How does that vary by subgroup?  How does that vary by the type of institution where students enroll? (4-year, 2-year, public, or private) Data from CR301; See CR302 for MA Public Institutions Only

Massachusetts Department of Elementary & Secondary Education 27 What are enrollment rates of students who complete AP or MassCore ? Data from CR301; See CR302 for MA Public Institutions Only

Massachusetts Department of Elementary & Secondary Education 28 Which type of institutions do they attend? Data from CR303

Massachusetts Department of Elementary & Secondary Education 29 Of those in MA public postsecondary, what % enroll in remedial courses? In which subjects? Data from CR302

Massachusetts Department of Elementary & Secondary Education 30 What are the MCAS scores of students who take remedial courses? Data from CR302

Massachusetts Department of Elementary & Secondary Education How many credits do graduates earn in their first year of college? What about developmental credits? Data from CR302 31

Massachusetts Department of Elementary & Secondary Education 32 … and this is just the beginning of what we can do! We could also explore…  What is the relationship between MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)  What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?

Massachusetts Department of Elementary & Secondary Education Comparing the Three Reports Potential QuestionsCR301CR302CR303 How many graduates go on to postsecondary?XXX What type of institutions (4-year/2-year, private/public) do graduates attend? XXX Which specific institutions did students attended? How many went to each? XX What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t? XXX What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework? X What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc) XXX What percentages of students enroll in and complete remedial courses? XX In what remedial subjects to do students enroll?X What are the MCAS scores of students who take remedial coursework in math and reading? XX How many credits, on average, do public high school graduates earn in their first year of college? XX 33

Massachusetts Department of Elementary & Secondary Education 34 Refining your search 34

Massachusetts Department of Elementary & Secondary Education 35 For more information…  Watch the Edwin website for updates, including materials and professional development opportunities:  Follow Edwin on Edwin_DESE  Questions can be submitted to:  If you need access to Edwin Analytics – contact your district directory administrator (List is available at ist.aspx) ist.aspx

Massachusetts Department of Elementary & Secondary Education Coming soon: Success After High School DART Detail 36

Massachusetts Department of Elementary & Secondary Education The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information. The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations. DARTs are free and available to the public on the ESE website What is the DART? 37

Massachusetts Department of Elementary & Secondary Education 38 What is the Success After High School DART?  The Success After High School Dart is a DART: Detail tool  DART: Detail tools provide in-depth data on targeted topic areas  The Department already released DART Detail’s: Staffing and Finance and English Language Learners to go along with the more comprehensive DART tools  The intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well-organized, accessible format for schools, districts, non-profit organizations, researchers, families and the general public.

Massachusetts Department of Elementary & Secondary Education 39 Example elements for DART Detail: Success After High School  High School Indicators: Graduation, dropout, suspension, and retention rates.  High School Performance: Students scoring proficient on MCAS, students scoring on SAT and AP tests, and participation in SAT and AP tests.  Program of Study: Students completing MassCore and Advanced Placement coursework. Students passing all ninth grade courses, Students passing 12 th grade mathematics and science technology/engineering coursework.

Massachusetts Department of Elementary & Secondary Education 40 Example elements for DART Detail: Success After High School (continued)  Post-Secondary Educational Outcomes: Students enrolling in post-secondary education, students persisting in post-secondary education, percentage of students enrolling in developmental (remedial) coursework in Massachusetts Public Colleges.  Workforce Development: Students participating in career/technical education by cluster, Students completing work based learning plans and Connecting Activities, links to other regional workforce development data.

Massachusetts Department of Elementary & Secondary Education Look for the Success After High School DART on November 1, 2013!