May 16, 2007 New Jersey Alternate Proficiency Assessment

2 Main Topics History of APA process Description of current APA Positives and Concerns Future Direction

3 IDEA Legislation IDEA 97 requirement to include all students with disabilities in statewide and local assessments Publicly report progress of students with disabilities Most participate in general assessment with or without accommodations Law allowed for alternate assessment for student with the most severe cognitive disabilities.

4 NCLB Legislation NCLB required the performance of students with disabilities to be included in the accountability system for schools and districts. A change in New Jersey. NCLB required students to be assessed in relation to the state standards NCLB allowed for a small percentage of students to be accountable under alternate achievement standards. (1% of total tested population)

5 Who are the APA Students? Is the nature of the students cognitive disability severe? Is the students cognitive disability so severe that the student is not receiving instruction in any of the knowledge and skills measured by the general statewide assessment? Is the students cognitive disability so severe that the student cannot complete any of the types of questions on the assessment in the content area, even with accommodations and modifications? Is the students Individualized Education Program (IEP) aligned to grade level New Jersey Core Curriculum Content Standards through modified expectations and/or access skills that promote social interaction, independence, self-determination, and generalization.

6 Tim is a 9 year old student with significant disabilities. He uses a walker and an augmentative communication device for expressive communication but often needs reminders to do so. He needs picture symbols to supplement verbal information. Student Vignette: TIM

7 He can repeat single words verbally. He is supposed to wear glasses, but generally will not leave them on without frequent reminders and supervision. Student Vignette: TIM (cont.)

8 Vicki is a 14 year old student with significant disabilities. She uses a wheelchair and smiles to indicate yes and rounds her mouth to indicate no. Sometimes it takes several seconds for her to give a yes/no response. While Vicki has very limited use of her arms and legs, she can activate a pressure switch with her cheek by turning her head slightly to the left. Student Vignette: VICKI

9 Since Vickis eyesight is somewhat impaired, objects/photos/symbols must be held approximately 12 inches in front of her. Student Vignette: VICKI (cont.)

10 Historical Perspective Alternate assessment had to be aligned to state standards but the achievement standards could be modified NJ organized advisory group to develop the goals and framework of the assessment Goals of assessment (same as for all students) Evaluate student achievement relative to the state standards Allow for inclusion in the accountability system Inform and improve instruction by teaching to the standards even if mastery is not near grade level Evaluate programs

11 Initial Test Design Determinations Determinations of the advisory group: Paper and pencil test inappropriate Portfolio assessment appropriate Each one individualized to assess progress at level of instruction Individual selection of the standards and indicators to be assessed The assessment would be a collection of the work being done in the classroom not a one day test (unreliable)

12 Initial Test Design Determinations (cont.) Critical issues for instruction of students with severe cognitive disabilities (from teachers, administrators, etc.) Generalization of skills Level of support - independence Socialization Self determination Could not evaluate programs solely on academic progress of students with severe cognitive disabilities –need to look at other critical dimensions in relation to the standards Therefore scores based on progress and the other dimensions

13 What Grades Are Assessed? Students in grades and 11 are assessed. APA in grades 4, 8, and 11 contain language arts literacy, mathematics, and science. APA in grades 3, 5, 6, and 7 contain language arts literacy and mathematics.

14 How Many Skills are Assessed? In language arts literacy two skills are assessed. In mathematics two skills are assessed. In science three skills are assessed.

15 How are the Skills Selected? The childs teacher in conjunction with the IEP team selects the skills they want to assess. As per federal and state guidelines, the skills must be academic in nature, and linked to the NJ Core Curriculum Content Standards. Teacher selects content standard, cumulative progress indicator, and skill on which to assess the student.

16 Who Decides How Well the Child Should Perform the Skill? The teacher and the IEP team determine what the progress goal is for the student. The teacher reviews how well the student is doing on the skill in October and determines how well the student should do in February.

APA What does a portfolio entry look like? 17

18 Test Design for LAL and Math Select two skills per subject For each skill, collect 4 pieces of evidence which includes 3 different activities. Collected over a four month time frame. Collect data on performance of skill, settings, supports, social interactions, connection to standards, and self-evaluation.

Mathematics Entry Sample Michael

Entry Cover Sheet

1 Student Work Sample – Evidence Label

1a Student Work Sample

2 Self-Check Sheet

3 Peer Note 1/5/05 Michael and I followed the pancake recipe that Michael doubled by adding fractions in Home Ec. class to make pancakes for the class. Susan Peer

4 Student Work Sample – Evidence Label

4a Student Work Sample

5 Student Work Sample – Evidence Label

5a Student Work Sample Mike completed this homework on his own. He did not need help from his dad or I. Mrs. H

DateOct. 24,05Nov. 22, 05Jan. 5, 06Feb. 17, 06 Progress45% with 1 verbal prompt 65 % independent 100 % independent 100 % independent SettingSpecial Education Class Special Education Class Home Economics Class Home ActivityAddition of fractions using manipulatives Addition of fractions on computer Addition of fractions using recipe Addition of fractions worksheet Name: Mike H. Datasheet for Addition of Fractions Targeted skill: Add fractions with like denominators 6

Language Arts Literacy Sample Eddie

Entry Cover Sheet

Performance Data

Student Work Sample – Evidence Label 2

Student Work Sample 2a

Planning, Monitoring, and Self-Evaluation Name:________________________Date:___________________ PLANNING: MONITORING: Today while reading, I need to work on: I worked on these: (Circle the items you are going to work on today) Looking at pictures to help me understand YES NO Looking at all of the letters before saying word YES NO Making the sound that goes with each letter YES NO EVALUATION: Overall, I think I did a ____________________ job reading today. GREAT GOOD O.K. NOT SO GOOD Next time, I need to work harder on: Looking at pictures to help me understand Looking at all the letters before saying the word Making the sound that goes with each letter 12/8/04 EXTENDING PERFORMANCE: Planning, Monitoring, and Evaluation Sheet 3

Student Work Sample 4 Eddie worked with a peer in the third grade regular education class to complete this assignment. The peer read the directions and helped Eddie read the sentences. Eddie cut out, matched and pasted pictures to the correct sentences.

New Jersey Alternate Proficiency Assessment – Evidence Documentation Students Name: Eddie Date: 2/5/05 Standard #: A2 Page #: 5a Description of Activity: Eddie goes to general education 3class to study Healthy Lifestyles. Students had to answer questions on factors that contribute to a healthy life. Eddie answered questions related to behavioral factors by reading his vocabulary words and adding the factors to his chart. Setting: General Education Class (3rd grade) Supports: picture symbols Social Interaction: General Education 3rd grade peers who also worked on charting factors that contribute to a healthy lifestyle. 5 Student Work Sample – Evidence Label

5a Student Work Sample Eddie completed this in my 3 rd grade class. Mr. P. (General Education Teacher) exercise eat fruit drink milk Do not swim alone.

39 Student Work Sample – Evidence Label 6

Student Work Sample 6a

41 APA Scoring Rubric Six Scoring Dimensions Student Progress Connection to Standards Social Interaction Independence Self-Determination Generalization

42 Score Reports Reports include information defining a students progress level and program level for each content area assessed. Proficiency level is a result of the combination of the student progress level and program level for the subject. Proficiency levels are parallel with other state assessments and APA results will be combined with the other state assessment results for federal and state reporting.

43 Positives We are meeting the federal requirement to include all students in assessment system Teachers are looking at the standards and some say they are teaching material they never would have before Some are stressing the critical issues of socialization, independence and generalization Parents expressed satisfaction with having some assessment of the instruction of their children and concrete examples of progress

44 Concerns USDE has determined that the APA is not sufficiently focused on academic proficiency in language arts and math. They are requiring that we eliminate scoring based on the areas of self-determination, socialization, etc. Many concerns raised by the field Takes too long - costs too much In some schools it is a staged occurrence not related to actual instruction Teachers cannot relate what they are doing to the standards Do not see the assessment as relative to the kinds of instruction they are providing Belief that functional life skills should be taught and directly assessed. USED specifically does not allow that for purpose of NCLB.

45 Future Actions The DOE will work with advisory committee to revise the assessment for the administration to: Meet the federal requirements Address concerns of the field