1 National Center on Educational Outcomes (NCEO) Martha L. Thurlow Accommodations for Students with Disabilities Decision Making Considerations for Validity

2 National Center on Educational Outcomes (NCEO) Where Are We? Many more people understand the difference between accommodations that alter the construct being measured and those that do not. For those accommodations that alter the construct, it is generally believed that when students use them, scores should be treated differently for aggregation or reporting.

3 National Center on Educational Outcomes (NCEO) Research on Effects of Accommodations Universal design as a way to reduce the need for accommodations – does not eliminate the need Research on the effects of accommodations is complicated – underlying decision making may not be at level of rigor needed for good designs Paul Sherlock Center on Disabilities (2002) – accommodations often “bundled” and usually determined by location of student during testing rather than what IEP says

4 National Center on Educational Outcomes (NCEO) Research on Decision Making DeStefano, Shriner, & Lloyd (2003) – test accommodations not always linked to instructional accommodations, not made on individual student level Lazarus, Thompson, & Thurlow (2005) – special education teachers often unable to identify whether an accommodation was considered standard or nonstandard by the state; 1/3 did not know what happened to students’ scores when a nonstandard accommodation was used

5 National Center on Educational Outcomes (NCEO) Why are Decision Makers Having Problems? Need to know the students’ needs – created by disability Need to understand the state policies

6 National Center on Educational Outcomes (NCEO) Accommodation: Read Aloud Directions X Number of states Allowed without Restriction 35 Allowed in Certain Circumstances 10 Allowed with Implications for Scoring 6

7 National Center on Educational Outcomes (NCEO) Accommodation: Read Aloud Questions X Number of states Allowed without Restriction 3 Allowed in Certain Circumstances 44 Allowed with Implications for Scoring 14

8 National Center on Educational Outcomes (NCEO) Accommodation: Sign Interpret Questions X Number of states Allowed without Restriction 13 Allowed in Certain Circumstances 29 Allowed with Implications for Scoring 8

9 National Center on Educational Outcomes (NCEO) Policies are complex – more and more because of the awareness that the validity of scores that result when accommodations are used is related to specific characteristics of what is assessed. It has been suggested that needed accommodations may even be item specific! What does that mean for NAEP and NCLB assessments?

10 National Center on Educational Outcomes (NCEO) Options  Ignore the issue and just continue on with our large-scale assessments, but do a lot more training  Continue to strive for universally designed tests and hope that we can ignore accommodation-by- individual item thoughts

11 National Center on Educational Outcomes (NCEO) Options  Use computer-based testing where accommodations can be used or not used at the item level  For specialized cases, think about the use of a decision-making tree approach (this is for states or districts) See example to follow

12 National Center on Educational Outcomes (NCEO) Problem: A student who is deaf is required by the state assessment to match the sounds of words. What accommodation can be provided for this student? Issue: The skill is one that is a part of a larger assessment in which the student can participate. The student cannot perform on these types of items because of the disability – they would be measuring the disability. What should be done?

13 National Center on Educational Outcomes (NCEO) Five points of decision can be followed by a state to determine how to address this issue: 1.Does the skill in question reflect a standard that is to be assessed? 2.Is there a clear match between the breadth and depth in the standard and how the standard is reflected on the test?

14 National Center on Educational Outcomes (NCEO) Five points of decision : 3.Is there an accommodation that can be used by a student, even though it might not be used for other aspects of the assessment? 4.Is there an alternative skill that could be used for students whose disability precludes performance of the skill?

15 National Center on Educational Outcomes (NCEO) Five points of decision : 5.Is there a way to score the assessment so that the student and the school are not punished because the student’s disability precludes performance on the skill? Similar questions can be applied for ELLs with disabilities (e.g., an ELL who is deaf taking a listening test).

16 National Center on Educational Outcomes (NCEO) Attaining valid large-scale assessment scores with the use of accommodations is going to have to go beyond studies of the effects of accommodations.

17 National Center on Educational Outcomes (NCEO)