1. Laura M. B. Kramer, Ph.D. December, 2009 Copyright © 2009 Mississippi Department of Education 1 2009-10 MAAECF Teacher Training Making Sure the MAAECF is Accessible and Fair

2. Ensuring Fairness General assessments, same items, chosen by State  Established committee review procedures and statistical analyses MAAECF, different items, chosen by YOU!  No committees, no statistical analysis  External review at Scoring Center December, 2009 Copyright © 2009 Mississippi Department of Education 2

3. Fairness Issues Access  Accommodations vs Modifications Bias / Sensitivity  Stereotypes  Multiple word meanings  Prior knowledge  Experiential impact (e.g., cultural, SES) December, 2009 Copyright © 2009 Mississippi Department of Education 3

4. Accessibility Universal Design  Based on the architectural concept that buildings should be accessible to all.  Items should be accessible to the tested population.  Items can be made accessible through the use of accommodations in presentation, response, setting, and/or timing. December, 2009 Copyright © 2009 Mississippi Department of Education 4

5. Accommodations “Level the playing field” Assess students in the most valid manner Do NOT change what is being measured (that is a “modification”) Do NOT give away the answer (then we’re not assessing what the student can do…) December, 2009 Copyright © 2009 Mississippi Department of Education 5

6. Accommodations “Testing Accommodations Manual” for the general assessment is a good starting point  Some MECF objectives say that a “non-allowable” accommodation is allowable –Language Arts: several objectives state “by reading or listening to text read aloud” –Math: using manipulatives allowed for MAAECF Prompting  Direct vs. Indirect prompts  Allowed but will impact score!!! December, 2009 Copyright © 2009 Mississippi Department of Education 6

7. Bias and Sensitivity Be aware of potential sources of bias in worksheets or other commercially availably products you may use Be aware of your own personal biases Use professional judgment and common sense! December, 2009 Copyright © 2009 Mississippi Department of Education 7

8. Bias and Sensitivity Do any items portray anyone in a stereotypical manner?  Stereotyping includes activities, occupations, or emotions.  Positive stereotypes are still stereotypes. Blondes have more fun. People who wear glasses are smart. December, 2009 Copyright © 2009 Mississippi Department of Education 8

9. Stereotypes Stereotype threat for students  What they think of themselves Your personal biases (for or against!)  What you think  What you say  How you interact (non-verbal channels) December, 2009 Copyright © 2009 Mississippi Department of Education 9

10. Unfamiliar Language Do any items contain language that is not commonly used statewide or has different connotations in different parts of the state or in different cultural or gender groups? Riding a hog… Is that a swine or motorcycle? December, 2009 Copyright © 2009 Mississippi Department of Education 10

11. Unfamiliar Language Does a word in the item / task have multiple meanings? e.g., “club,” “fair” Does a word in the response the student gives have multiple meanings, denotatively or connotatively? If the student answers a question “wrong” – ASK! They might know something you don’t! December, 2009 Copyright © 2009 Mississippi Department of Education 11

12. Prior Knowledge Does the item or task require the student to bring in information from outside of the objective?  Synthesizing information is different from reliance on prior knowledge!  Ask the student for more information if they answered in an unexpected / “wrong” way – if you let them explain, you might see there’s another “correct” answer. December, 2009 Copyright © 2009 Mississippi Department of Education 12

13. Different Experiences Do any items assume that all students come from the same socioeconomic or family background? Where would the apostrophe go in the question, “Did you borrow your parents car?” Is the student from a one- or two- (or more) parent home? December, 2009 Copyright © 2009 Mississippi Department of Education 13