Accountability Update Brian Swiger North Carolina Department of Public Instruction Accountability Services Division

No Major Changes There will be no major changes to the materials distribution or data validation processes this testing cycle.

Important Dates Ordering file to MetriTech on December 5, 2012 All updates to CFDC by this date Materials will be in LEA by January 11, 2013

Important Dates Testing Window: February 1–March 15, 2013 Materials shipped back to MetriTech by March 22, 2013 Data Validation Window: April 22–May 3, 2013

Important Dates Reports will be delivered to LEAs by May 23, 2013 Final Data from MetriTech to NCDPI on June 6, 2013 Any corrections to MetriTech between these two dates

Lessons Learned More tier A and tier C test books in overage Additional materials requests will not require approval by me (small orders). Large print requests will go directly to MetriTech.

Fall Testing Calendar

Spring Testing Calendar

OTISS vs. RCR When should an ACCESS or W-APT testing irregularity be reported in OTISS? Anytime one occurs. RCR should be made when irregularity occurs due to incorrect data in CFDC.

Irregularity Types

Which irregularity types necessitate a Record Change Request (RCR)? Student not required to take test Failure to test eligible students

Transfer Students Download Student Transfer form from Metritech.com Sending and receiving LEAs must both fill out form Ensures combining of scores and correct recipient of score report

Student Transfer Form

LEP Accountability Links Accountability Policy Page: accountability/policies/ Accountability LEP Page: accountability/policies/slep/ Metritech.com

Thank You! Thanks for all you do to ensure a smooth testing cycle! Contact me anytime you need help

AMAOs and AMOs Scott W. Beaudry North Carolina Department of Public Instruction Accountability Services Division

AMOs ESEA Flexibility Waiver Through (ESEA reauthorization) Eliminate school designations of Met or Not Met AYP AYP  Annual Measureable Objective (AMO)

AMOs Used data as the baseline State-level data used to set state-wide targets Targets increase based on the goal of reducing percent non-proficient by half within six years

AMOs: what’s different? ELA and Mathematics targets Targets differ between subgroups Minimum subgroup size drops to 30 Participation rate consequences

% = 62.8% not proficient 62.8% / 2 = 31.4% reduction in 6 years = 68.6% target for

100 – 68.5% = 31.5% not proficient 31.5% / 2 = 15.7% reduction in 6 years = 84.2% target for

AMAOs Strictly using CFDC for AMAO 1 and AMAO 2 AMAO 3 will use AMO results from Accountability Seeking guidance on AMAO 3

AMAOs: 2012 Preliminary AMAO Outcomes report scheduled for late September (AMAO 3 guidance). LEAs will have time to review/comment. Title III Watchlist and additional reports in November (after SBE action on AMAO Outcomes Report).

AMAOs: 2013 New EOG/EOC assessments Standard setting and SBE action Preliminary Outcomes Report tentatively scheduled for November, Final in December.

Testing Accommodations & Alternate ACCESS Carrie Perkis North Carolina Department of Public Instruction Accountability Services Division September 12, 2012

Accommodations for Students Identified as Limited English Proficient

Guidelines for Testing Students Identified as Limited English Proficient Document contains detailed information on testing accommodations bility/policies/slep/ bility/policies/slep/ Updated document in October 2012

LEP Students & Accommodations Eligibility criteria for accommodations: –LEP students scoring below Level 5.0 Bridging on the reading subtests of the W- APT/ACCESS for ELLs eligible to receive state-approved LEP accommodations on state tests

State-Approved LEP Accommodations Multiple Testing Sessions Testing in a Separate Room Scheduled Extended Time Student Reads Test Aloud to Self Test Administrator Reads Test Aloud (In English) Computer Reads Test Aloud – Student Controlled Word-to-Word Bilingual English/Native Language Dictionary/Translator

Instructional Accommodations/ Modifications Testing Accommodations drive 31

Considerations for Committee Decision-Making Students should be using accommodations ROUTINELY during instruction and similar classroom assessments – accommodations should not be a surprise on test day! Routine use = at least 30 days prior to test date except for newly enrolled students late in the school year 32

Multiple Testing Sessions Allows student to test in mini sessions –More frequent breaks (e.g., every 20 minutes, every 10 questions completed) –May test over one day or multiple days (e.g., half of test day 1, half of test day 2) Must complete test within the allowed time unless student has Scheduled Extended Time If breaks differ from the standard, student will require Testing in a Separate Room

Scheduled Extended Time For students who need extra time to test LEP team documents estimated extended time, but student is allowed as much time as needed with this accommodation Student must finish the test in one day, unless he/she also has Multiple Testing Sessions

Student Reads Aloud to Self Student may read the test aloud, but the test administrator may not help or correct errors the student makes Requires Testing in a Separate Room – One-on-One accommodation

Test Administrator Reads Test Aloud (In English) LEP team must document specifics - Read Aloud Everything vs. Read Aloud by Student Request Not available for EOG English Language Arts or EOC English II Requires Testing in a Separate Room (one-on- one or small group)

Test Administrator Reads Test Aloud (In English), cont’d Test administrator should be familiar with grade-level/course content Information should be read so as not to give away the answer –e.g., read number as instead of one hundred when place value is tested

Computer Reads Test Aloud – Student Controlled Available for EOC Biology, EOC Algebra I/Integrated I, grade 5 & 8 science EOG, NCEXTEND2 tests Students press audio button to hear recorded human reader Students may use headphones to test in regular setting Without headphones, students will require separate setting (one-on-one)

Computer Reads Test Aloud – Student Controlled, cont’d Limitation: only item stems and answer choices read by computer (not graphs, charts, etc) For online tests, student may have the test read aloud by: –Test Administrator Reads Test Aloud –Computer Reads Test Aloud – Student Controlled –Combination of the two methods

ACT, EXPLORE, PLAN, and WorkKeys ACT – LEP students may only use State- Allowed accommodations. If used, ACT score is not college-reportable EXPLORE/PLAN – LEP accommodations are a local decision WorkKeys – LEP students may only use word- to-word bilingual dictionary

ACT, EXPLORE, PLAN, and WorkKeys cont’d LEP teams may record accommodations for these assessments on the LEP plan, or may use existing classroom/testing accommodations documentation to support accommodations decisions Accommodation policies may differ from NC policies. LEP teams must be aware of differences

Alternate ACCESS

What is Alternate ACCESS? A new test developed specifically for students identified as limited English proficient with significant cognitive disabilities access.aspx

Eligibility Criteria Student has been identified as LEP Student has been identified as having one or more of the existing categories of disabilities under IDEA (e.g.; intellectual disabilities, autism, traumatic brain injury, multiple disabilities, etc.) Student is participating in alternate curriculum and in state-wide alternate accountability assessments IEP team recommended the assessment after considering all three criteria above

Alternate ACCESS Student Identification Collaboration between LEP and EC 3-12 – look for LEP students with NCEXTEND1 documented on IEP K-2 – No NCEXTEND1 documentation, will need to consider LEP and disability status

Alternate ACCESS Testing Details Alternate ACCESS is individually administered Testing window will be the same as ACCESS –February 1 – March 15, 2013 Ordering will be the same as ACCESS Training materials online Formal training to occur this winter

Questions? Carrie Perkis

Process Check Plus Humor Good pace Small group Snacks Todaysmeet Collaboration Good and up-to-date \ information Face-to-face meeting Delta More rooms for group works Less unidentifiable jargon P.P.slides available in advance Meeting information on website & easily to be found Differentiated meeting

Process Check Plus Finishing the meeting on- time Delta