Increase the Reliability of the Administration of the MI-Access P/SI Assessments Angela Dalhoe Michigan Department of Education Assessment for Students with Disabilities Program

Today’s Focus Help those charged with training Primary Assessment Administrators (PAAs) and Shadow Assessment Administrators (SAAs) learn ways to effectively conduct training for the administration of the Participation and Supported Independence Assessments.

Tools to Assist in Training Coordinator and Assessment Administrator Manual (CAAM) Online Learning Released Items Item Analysis EGLCEs and EHSCEs

2007/2008 CAAM Manual The manual is located online at You may want to include portions of the manual in your group or individual training. Picture Card Presentation P/SI Rubric

Picture Card Presentation Correct presentation of picture cards will assist in obtaining valid results on P/SI Selected Response Items. An explanation of picture card presentation is provided in the CAAM in Appendix D (a copy is in your binder)

Selecting 1 Word from a Set of 4 Presented with all 4 words visually accessible at one time Student can select correct word OR Assessed using a “yes/no” response by presenting each word beginning with an unrelated and moving to a related

Selecting 2 Words from a Set of 4 Presented with all 4 words visually accessible at one time. Student can select correct words

Selecting 2 Words from a Set of 4 Assessed using a “yes/no” response Presenting 2 sets of 2 words (one related and one unrelated in each set).

Selecting 3 Words from a Set of 6 Presented with all 6 words visually accessible at one time Assessed using a “yes/no” response by presenting 3 sets of 2 words (one related and one unrelated in each set).

Scoring Rubric Knowledge of the scoring rubric is very important for increasing the reliability of the P/SI Assessments. The PAA and SAA work together prior to the assessment to determine the student’s anticipated response mode. The PAA and the SAA score the student simultaneously and independently. Flow Charts for P and SI are located in Appendix E and F in the CAAM (a copy is available in your binder).

Scoring Rubric- Participation Score PointDefinition 3 Responds correctly with no assessment administrator assistance 2 Responds correctly after assessment administrator provides verbal/physical cues 1 Responds correctly after assessment administrator provides modeling, short of hand-over-hand assistance Condition Codes - All condition codes result in no points. A Incorrect response B Resists/refuses C Assessment administrator provides hand-over-hand assistance and/or step-by-step directions

Scoring Rubric – Supported Independence Score PointDefinition 2 Responds correctly with no assessment administrator assistance 1 Responds correctly after assessment administrator provides verbal/physical cues Condition Codes - All condition codes result in no points. A Incorrect response B Resists/refuses C Assessment administrator provides hand-over-hand assistance and/or step-by-step directions

Online Learning The MI-Access Participation and Supported Independence Scoring Rubrics Online Learning is located at under the Professional Development Opportunities section. The online learning is still labeled “pilot” There are 7 modules

Released Items Released items are useful for PAA and SAA to discuss item formats and practice item administration. Released item booklets are available online. There is a booklet for each population and subject and at each level: FI – Grades 3,4,5,6,7,8, and 11 P/SI – Grades 3-5, 6-8, 11

Item Analysis Item analysis documents allow the PAA and the SAA to observe how released items were scored by both assessment administrators. Can be used at a district and/or building level to discuss issues of consistency. Differences in item format Differences in standards/strands

EGLCEs and EHSCEs Becoming familiar with the EGLCEs and EHSCEs will make the PAA and the SAA more likely to consistently recognize the scoring focus when they observe a student and score an assessment item. Updated documents are posted on at this site and available for download

Select EGLCEs or EHSCEs

Questions?