2019 MCAS Grade 10 Reporting and CD Requirements for the Class of 2021 September 10, 2019

Bob Lee, MCAS Chief Analyst Scott Kelley, Data & Reporting Specialist Presenters Bob Lee, MCAS Chief Analyst Scott Kelley, Data & Reporting Specialist Jodie Zalk, Test Administration Coordinator Massachusetts Department of Elementary and Secondary Education

Logistics for This Session Questions may be asked at any time using the Questions feature on the GoToWebinar screen. Questions about a specific student should be sent by email to mcas@doe.mass.edu. Some questions may be covered during the course of the presentation. We will answer some questions at the end of this session. After the session, we will email questions and answers to participants. This session is being recorded and will be available online in about one week at the MCAS Resource Center.

May 2018 Today’s Discussion High school Competency Determination (CD) requirements during the transition to next-generation MCAS tests and achievement levels Yes, it is true that some students in the class of 2021 may be in the “Not Meeting Expectations” level but still earn their CD. John and Abigail Adams & Koplik scholarship eligibility during the transition Special reporting and retesting considerations related to the grade 10 ELA voided essay prompt Review of the MCAS reporting schedule and November retest registration timeline

High School CD Requirements 01

Interim CD Regulations (Adopted in February 2018) As determined in 2018, in order to earn their CD, the classes of 2021 and 2022 (this year’s juniors and sophomores) must earn a next- generation MCAS scaled score that is equivalent to a legacy MCAS scaled score of at least 240 on the grade 10 ELA and Mathematics tests or earn the next-generation MCAS equivalent of a legacy scaled score between 220 and 238 and fulfill the requirements of an Educational Proficiency Plan.

Interim CD Regulations (Adopted in February 2018) continued The interim standard was identified in summer 2019 through: A statistical linking process, and Validation by a panels of experts Provides members of the classes of 2021 and 2022 with timely notice of the passing standard and time to become familiar with the new tests and expectations before a new passing standard is established. Provides time to conduct outreach to students, parents, educators, administrators, and other stakeholders as we move toward a new CD.

Statistical Equipercentile Linking Model (ELA) 13% Exceeding Expectations 48% Meeting Expectations % of students 31% Partially Meeting Expectations 8% Not Meeting Expectations

Statistical Equipercentile Linking Model (ELA) continued 13% Exceeding Expectations 48% Meeting Expectations % of students 31% Partially Meeting Expectations 8% Not Meeting Expectations

A Closer Look at the ELA Cut Score for Passing/Failing 472 Partially Meeting Expectations 240 470 EPP required % of students 5% Passing & Not Meeting Expectations 455 220 3% Not Passing & Not Meeting Expectations 200 440

Interim CD Standard for the Classes of 2021 and 2022 Legacy PASSING but requires an Educational Proficiency Plan (EPP) Legacy PASSING and met the MCAS graduation requirement Next Gen PASSING EPP Next Gen PASSING and met the MCAS ELA 220–238 240+ 455–471 472+ Mathematics 469–485 486+ STE 220 220+ TBD - Summer 2020

MCAS Achievement Levels Legacy Next-Generation Advanced (260-280) Students at this level demonstrate a comprehensive and in-depth understanding of rigorous subject matter, and provide sophisticated solutions to complex problems. Proficient (240-258) Students at this level demonstrate a solid understanding of challenging subject matter and solve a wide variety of problems. Needs Improvement (220-238) Students at this level demonstrate a partial understanding of subject matter and solve some simple problems. Failing (200-218) Students at this level demonstrate a minimal understanding of subject matter and do not solve simple problems. Exceeding Expectations (530-560) A student who performed at this level exceeded grade-level expectations by demonstrating mastery of the subject matter. Meeting Expectations (500-529) A student who performed at this level met grade-level expectations and is academically on track to succeed in the current grade in this subject. Partially Meeting Expectations (470-499) A student who performed at this level partially met grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should consider whether the student needs additional academic assistance to succeed in this subject. Not Meeting Expectations (440-469) A student who performed at this level did not meet grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should determine the coordinated academic assistance and/or additional instruction the student needs to succeed in this subject. Massachusetts Department of Elementary and Secondary Education

Current CD Requirements for ELA and Mathematics, by Class School Year CD requirements 2017-18 2018-19 2019-20 2020-21 2021-22 2022-23 Class of 2020 Grade 10 Grade 11 Grade 12   Legacy (240 or 220+EPP, per Board vote in October 2016) Class of 2021 Grade 9 Grade 10* Interim (standard on new test that represents similar level of achievement as 240, or 220+EPP) Class of 2022 Class of 2023 Grade 9* Grade10 Future (to be determined after results of new tests are considered by the Board in the 2019-2020 school year) * First administration of next-generation grade 10 tests with new CD requirement in ELA/Mathematics

How will this appear on the Parent/Guardian Report? Front Page Inside (Page 2)

Adams and Koplik Scholarship Eligibility 02

Class of 2021 and 2022 Adams and Koplik Scholarships Adams Scholarship Koplik Scholarship Score equivalent to Advanced in at least one subject Score equivalent to Proficient or higher in the remaining subjects Combined scores in the top 25 percent in their district when they enter 12th grade Score equivalent to Advanced in at least one subject Score equivalent to Proficient or higher in the remaining subjects Meet Koplik standards on 2 AP, SAT II or other tests See website for details

Interim Adams and Koplik Cut Scores for the Classes of 2021 and 2022 Legacy Proficient Legacy Advanced Next-Gen Proficient Equivalent Next-Gen Advanced Equivalent ELA 240-258 260-280 472-500 501-560 Math 486-503 504-560 STE N/A

Special Reporting and Retesting Considerations Related to the Gr Special Reporting and Retesting Considerations Related to the Gr. 10 ELA Voided Essay Prompt 03

Special Reporting Issues Related to the Voided ELA Prompt The third operational essay question on the spring 2019 grade 10 test (about a passage from the novel The Underground Railroad) was voided during test administration. Students who had not finished the essay were told to skip it. Student essays were not scored. The ELA operational test was reduced from 59 to 51 points. An independent study was conducted to see if the performance of African American students declined after the voided prompt.

The independent study concluded that the question: Study Results The independent study concluded that the question: showed that while black students experienced a small difference (approximately 0.006 standard deviations) in performance as compared to white students on the second day of the MCAS ELA test, that small difference was within the normal variation of such differences on past MCAS tests.

Special Considerations The Department gave scores of 455, the minimum passing score, to all students in the state who were on track to pass prior to the prompt. (This applied to 61 students.) Other students who believe they were affected by the prompt will be allowed to take the November 2019 MCAS ELA retest for consideration for the Adams and Koplik scholarships. Additional guidance on this opportunity will follow shortly.

Review of the MCAS Reporting Schedule and November Retest Registration Timeline 04

Preliminary Release – Data Currently Available August 30 Preliminary School and District Results available in Dropboxes; includes scaled scores, achievement levels, growth, CD status September 4 Preliminary School and District Results available in Edwin Analytics; includes curriculum, item analysis, achievement, growth, and classroom reports

Upcoming Release Dates (Tentative) September 18 Official school and district results available in Dropboxes/Edwin Analytics conference call with superintendents September 19 Official embargoed school and district results available in Edwin Analytics September 20 MCAS results conference call with principals and test coordinators Register here: http://doe.mass.edu/conference/?ConferenceID=10090 September 24 Public release of official MCAS results on Profiles September 30 District offices receive printed Parent/Guardian Reports

Student Registration for the November Retests Schools will complete the Student Registration/Personal Needs Profile (SR/PNP) for the November retests: September 23–October 4: Regular registration period October 7 –10: Window to register additional students retesting for ELA (if needed) Guidance will be provided in the next Student Assessment Update. SR/PNP training session on September 19 Register at http://www.doe.mass.edu/conference/?ConferenceID=10087

(Use the “Questions” feature to ask questions.) Questions & Answers (Use the “Questions” feature to ask questions.)

Today: Complete the evaluation form. Next Steps Today: Complete the evaluation form. Responses associated with the name and email address used to log in Email your input to mcas@doe.mass.edu if you have problems accessing or completing the form. Later this week/early next week: Receive an email with the Q&A from this session Recording will be available Massachusetts Department of Elementary and Secondary Education

The Office of Student Assessment Services THANK YOU The Office of Student Assessment Services 781-338-3625 mcas@doe.mass.edu www.doe.mass.edu/mcas 75 Pleasant Street, Malden, MA 02148