1. Accountability Updates NCAEE Region 1 May 2, 2014 M. E. (Butch) Hudson, Jr. Regional Accountability Coordinator Accountability Region 4

2.  To introduce and discuss changes in Accountability and Testing for 2013-14 and beyond Objective

3.  NC has always historically had 4 achievement levels  Levels 1 and 2 were considered not proficient, 3 ad 4 were proficient  Testing is not an exact science  Students can score higher or lower on the same test if taken on another day (Standard Error of Measure, SEM)  When student level accountability (promotion standards) was tied to achievement levels, 1 SEM was used for the students’ benefit Achievement Levels

4.  With Read to Achieve (RtA) student level accountability is back (for 3 rd Grade)  However law specifically states “proficiency in reading”  Created new Level 3 from scale scores within 1 SEM of old Level 3, the level is “Proficient”  Old Levels 3 & 4 are now Levels 4 & 5, not only proficient but “College and Career Ready” (ESEA Waiver)  Remaining old Level 2 is new Level 2 and Level 1 is still Level 1, both are still Not Proficient (Math) Achievement Levels

5.  Proficiency Levels (3,4, &5) used for:  RtA Reading Proficiency  School Performance Composite  School Performance Grade  College and Career Readiness Levels (4&5) used for:  AMO Performance Targets  State Performance Targets  Cut scores for the new achievement levels can be found at http://www.ncpublicschools.org/accountability/te sting/shared/achievelevel/ http://www.ncpublicschools.org/accountability/te sting/shared/achievelevel/ Achievement Levels

6.  Legislative Requirement  Beginning of Grade 3 (BOG3) administered for baseline results  Students who scored a 439 or higher on the BOG3 are considered proficient in reading  Met RtA criteria for promotion  Will count as proficient in Accountability calculations for the school (still must take the Grade 3 ELA EOG) Read to Achieve (RtA)

7.  Local RtA alternative assessment  LEA chooses test and proficiency criteria  Local BoE declares it as valid and reliable  Students who meet criteria are considered proficient in reading for RtA purposes (but not Accountability)  Grade 3 ELA EOG  Students who score a 439 (Level 3) or higher are considered proficient  Met RtA criteria for promotion  Count as proficient in Accountability calculations RtA

8.  Students who meet the following criteria are not required to take any other tests for RtA purposes:  Scored a 439 or higher on either the BOG3 or Grade 3 ELA EOG  Scored at least the locally established proficiency level on the local RtA alternative assessment  LEP with <2 years instruction in an ESL program  Assessed with either the NCEXTEND2 or NCEXTEND1 alternate assessment  Successfully completed a SBE approved portfolio  Previously retained more than once in K, 1 st, 2 nd, or 3 rd grades RtA

9.  LEAs can choose which test to administer to students who still have not demonstrated reading proficiency, either the  State RtA Alternative Assessment OR  Grade 3 ELA EOG Retest  Parents may request for student to not participate in any more testing  Student automatically attends summer reading camp RtA

10.  State RtA Alternative Assessment  A form of the Grade 3 ELA EOG  Passages are chunked  Assesses the same standards as the Grade 3 ELA EOG  Assessment may be easier to take although content is the same  Grade 3 ELA EOG Retest  Administer another form (different color) of the ELA EOG RtA

11.  Immediate results available whichever assessment is given  Level 3 or higher required to show proficiency for RtA  Results from either test are NOT used for school/LEA Accountability RtA

12.  LEA may decide to automatically administer the test not previously administered (EOG Retest or RtA State Alternative) to students who qualify OR may administer by parent request only  This would be a third test administration  All state test administrations MUST be in the last 10 days of the school year  Parents may again opt out of testing with the acknowledgement that the student would automatically attend the summer reading camp RtA

13.  Students must score at least a Level 3 on whichever test is administered for the third administration to show proficiency for RtA  Results from the third administration are NOT used for school/LEA Accountability  Students who, after this third test administration, have not shown reading proficiency under RtA must attend a summer reading camp  Parents may refuse to send students to summer reading camp  Student automatically acquires retention label for 2014-15 RtA

14.  Students may demonstrate reading proficiency at the end of the summer reading camp by  Successfully completing a SBE approved portfolio  Can continue working on the one already started  Scoring a level 3 or higher on the state RtA Alternative Assessment  Administered at the end of the summer camp For more information on RtA policy please contact Abbey Whitford, Region 1 K-3 Literacy Consultant, at abbey.whitford@dpi.nc.govabbey.whitford@dpi.nc.gov RtA

15.  Legislative Requirement  Last 5 days of the course for semester long courses  Last 10 days of the course/school year for year long courses  Exemption for students with Multiple Testing Sessions over Multiple Days Testing Windows

16.  Legislative Requirement  Guidance Counselors may not be in charge of planning for testing  80% of a guidance counselor’s time must be spent working directly with students  Can be test administrators and help with testing in other ways School Test Coordinators

17.  K-2 teachers participate in Roster Verification (3 rd grade did this in 2012-13)  K-2 teachers’ growth based on Text Reading Comprehension (TRC) from Reading 3D  Recommended that End of Year TRC administrator not be teacher of record  This can be waived for 2013-14  Best 2 out of 3 years for first Standard 6 status  Only Reading used at this time Educator Effectiveness

18.  Grade 3 teachers’ growth based on pre/post model  BOG3  Grade 3 ELA EOG Educator Effectiveness

19.  General Assembly law in 2012  The 2013 General Assembly session delayed reporting until no earlier than August 1, 2014  Based on the 2013-14 school year data School Performance Grades (SPG)

20. School Performance Grades 20 School Achievement Score: 80 % Growth: 20 % School Performance Grade

21. School Performance Grades - Indicators 21 Elem/Middle EOG Mathematics EOG ELA/Reading EOG Science EOCs (middle) High Schools Math I English II Biology Math Course Rigor Graduation Rate The ACT ACT WorkKeys

22. School Achievement Score  Test Scores: Percent of students who score at or above Achievement Level 3 End-of-Grade Tests End-of-Course Tests  Graduation Rate: Percent of students who graduate in four years (Cohort Graduation Rate)  Math Course Rigor: Percent of graduates who successfully complete Math III (Algebra II, Integrated Math III, Math III)  ACT: Percent of 11 th grade students who score 17 or above (the UNC System’s minimum composite score requirement)  ACT WorkKeys: Percent of graduates that are CTE Concentrators and achieve a Silver Certificate or above 22

23. Growth  Education Value-Added Assessment System (EVAAS) End-of-Grade Tests End-of-Course Tests  SPG Uses School Accountability Growth Index  Reported for each school Exceeds Expected Growth Meets Expected Growth Does Not Meet Expected Growth  Not included in School Performance Grades for schools that have a School Achievement Score at or above 80% and Meets Expected Growth 23

24. Growth Meets growth: No additional calculation; growth not included in School Performance Grade Does not meet or exceeded growth: Include growth in calculation of School Performance Grade School Achievement Score at or above 80 % Include growth in calculation of School Performance Grade School Achievement Score 79 % or below 24

25. Growth Conversion 80 85 90 10050 60 70 0+2 +4+6 +8 +10 -10 -8 -6-4 -2  Index range constrained at -10 to +10  Index value converted to 50-100 point scale Does Not Meet Expected Growth Exceeded Expected Growth Meets Expected Growth 71.3% in 2012-13 25

26. Elementary/Grade School: Achievement Calculation 5&8 Science % Proficient 3-8 Math % Proficient 3-8 Reading % Proficient Biology % Proficient English II % Proficient Algebra I % Proficient # of Available Indicators ++ ++ + = Points 60.1% (98/163) 83.6% (336/402) 73.1% (294/402) 0% (0/0) 0% (0/0) 93.8% (30/32) 4 ++ ++ + = 77.7 73.1 + 83.6 + 60.1 + 93.8 = 310.6 and 310.6 ÷ 4 = 77.65 ≈ 77.7 26

27. Elementary/Grade School: Grade Letter Determination (62.2)+(18.3)= 80.5 80.5pts=letter grade of “B” Achievement Score under 80 OR Achievement Score at least 80 AND “Did Not Meet Growth” or “Exceeded Growth Achievement Score = School Performance Grade Points 90-100pts=A 80-89pts=B 70-79pts=C 60-69pts=D Under 60pts=F = 80.5 + X 0.2 X 0.8 Growth Points ( ) ( ) + X 0.2 X 0.8 ( ( ) ) 91.3 77.7 27

28. Additional Reporting  Growth will be reported for each school: exceeds, meets, or does not meet expected growth  A separate achievement score for math and reading will be reported for schools serving grades K-8  The report card for schools serving 3rd graders will contain information on the number and percentage of third graders who are retained or promoted based on reading performance 28

29.  Current EOGs/EOCs for 2014-15 and 2015-16  Testing Committee to make recommendations to SBE about testing in 2016-17 and beyond Future Testing

30. Focus Group Timeline 30 April-August 2014 Focus group explore assessment options September 2014 Focus group makes recommendation to State Board of Education (SBE) October 2014 SBE decides assessment for 2016-17, and if needed, funding is requested in the 2015 budget

31. Questions???

32.  butch.hudson@dpi.nc.gov butch.hudson@dpi.nc.gov  252-532-4212 Contact