How Good is ACCUPLACER ® Really? A Report on a Successful Placement System. By Ron Gordon

Developed Over Time Began in 1994 with 4 scrap computers and ACCUPLACER ® 4.0 Conducted research on cut scores in 1995 Again in 1996 Again in 1997 Developed multiple measures system in 1997

How Good is it? Faculty rate 85% to 93% of placements “Accurate” Students rate 83% to 88% of placements “Accurate” Of students rated “Under-prepared,” 88% to 96% fail or drop the course Of students rated “Adequately prepared,” more than 60% earn “C” or better

Placement Accuracy

The Clencher Pass rates are 5 to 7 percentage points higher than they were in Withdrawals are 7 to 9 percentage points lower than in 1997.

Why? California State Law: “A community college may not restrict enrollment in any course solely on the basis of the score on any test.” Additionally, any test used for placement into courses must be approved the the Chancellor’s Office. It makes sense

What is it? Select appropriate tests or combinations of tests Collect personal and academic background information “Weight” the test scores on the basis of the background information Make placement recommendations on the basis of the weighted scores.

What Factors Affect Success?  Academic history  Environment  Behavior

Academic History  Highest level of study in the discipline  Grade in last course in the discipline  Number of honors or AP classes  Study in advanced science  Voc Ed??  GPA????

Environment Parents’ education Education value Support system Finances Family/work demands

Behavior Time management Reading habits Perception of study time Hours of sleep per day Goal setting Attitudes (e.g. Importance of studying math)

How Much Adjustment Reliability of the test Enough to support capable students Move students no more than one level “Half the range”

Examples

Procedures Involve faculty and counselors/advisors Select set of questions to use Select weighting criteria and protocols Develop weighting chart Develop cut scores Outline rules Create rules in ACCUPLACER ®

Weighting Chart

Rule Outline IF –All background information is present – and –Weights are applied and –.5 * Reading Plus –.5 * Sentence Skills is GT or EQ to 71 and –.5 * Reading Plus –.5 * Sentence Skills is LT 81 then –Placement is English 105

The Old Way -- 1 of 32 If ( ( 4-Highest English Is 3. Advanced writing or literature course beyond senior English OR 4-Highest English Is 4. Honors studies or advanced placement (AP) in senior English) AND 5-Reading Habits Is to 5 hours AND ( 6-English grade Is 1. A OR 6-English grade Is 2. B) AND ( 7-Homework Is 2. More than 1 hour but less than 2 hours OR 7-Homework Is 3. Two to Three hours) AND (((((0.71 Times The Score Of Reading Comprehension) Plus (0.35 Times The Score Of Sentence Skills)) Is Greater Than Or Equal To 70.5) AND (((0.71 Times The Score Of Reading Comprehension) Plus (0.35 Times The Score Of Sentence Skills)) Is Less Than 80.5)) OR ((((0.37 Times The Score Of LOEP : Reading Skills) Plus (0.35 Times The Score Of LOEP : Language Usage) Plus (0.34 Times The Score Of LOEP : Sentence Meaning)) Is Greater Than Or Equal To 81.5)))) Placement Would Be This Rule Applies To All Majors

The New Way -- 1 of 1 IF: ( The Score Of Reading Comprehension IS NOT NULL AND The Score Of Sentence Skills IS NOT NULL AND 1. Reading Time IS NOT NULL AND 3. Study Time IS NOT NULL AND 5. English Honors/AP IS NOT NULL AND 10. English Grade IS NOT NULL ) AND ( 20. English at Home IS A. Yes AND 21. Prefer English IS A. Yes ) AND (( { ( 0.5 TIMES The Score Of Reading Comprehension PLUS 0.5 TIMES The Score Of Sentence Skills ) PLUS -1%, ONLY IF 1. Reading Time IS A. 2 hours or less ; PLUS 0%, ONLY IF 1. Reading Time IS B. More than two but less than 4 hours per week ; PLUS 0%, ONLY IF 1. Reading Time IS C. More than 4 but less than 6 hours per week ; PLUS 2%, ONLY IF 1. Reading Time IS D. 6 Or more hours per week ; PLUS -1%, ONLY IF 3. Study Time IS A. Less than 1/2 hour ; PLUS 0%, ONLY IF 3. Study Time IS B. 1/2 to 1 hour ; PLUS 2%, ONLY IF 3. Study Time IS C. 1 to 1-1/2 hours ; PLUS 2%, ONLY IF 3. Study Time IS D. 1-1/2 to 2 hours ; PLUS 0%, ONLY IF 3. Study Time IS E. 2 to 3 hours ; PLUS 0%, ONLY IF 3. Study Time IS F. More than 3 hours ; PLUS 2%, ONLY IF 5. English Honors/AP IS A. Yes ; PLUS 0%, ONLY IF 5. English Honors/AP IS B. No ; PLUS 2%, ONLY IF 10. English Grade IS A ; PLUS 2%, ONLY IF 10. English Grade IS B ; PLUS 0%, ONLY IF 10. English Grade IS C or CR ; PLUS 0%, ONLY IF 10. English Grade IS D ; PLUS -1%, ONLY IF 10. English Grade IS F or NC ; } IS GREATER THAN OR EQUALS TO 50.5 ) AND ( { ( 0.5 TIMES The Score Of Reading Comprehension PLUS 0.5 TIMES The Score Of Sentence Skills ) PLUS -1%, ONLY IF 1. Reading Time IS A. 2 hours or less ; PLUS 0%, ONLY IF 1. Reading Time IS B. More than two but less than 4 hours per week ; PLUS 1%, ONLY IF 1. Reading Time IS C. More than 4 but less than 6 hours per week ; PLUS 2%, ONLY IF 1. Reading Time IS D. 6 Or more hours per week ; PLUS -1%, ONLY IF 3. Study Time IS A. Less than 1/2 hour ; PLUS 0%, ONLY IF 3. Study Time IS B. 1/2 to 1 hour ; PLUS 2%, ONLY IF 3. Study Time IS C. 1 to 1-1/2 hours ; PLUS 2%, ONLY IF 3. Study Time IS D. 1-1/2 to 2 hours ; PLUS 0%, ONLY IF 3. Study Time IS E. 2 to 3 hours ; PLUS 0%, ONLY IF 3. Study Time IS F. More than 3 hours ; PLUS 2%, ONLY IF 5. English Honors/AP IS A. Yes ; PLUS 0%, ONLY IF 5. English Honors/AP IS B. No ; PLUS 2%, ONLY IF 10. English Grade IS A ; PLUS 2%, ONLY IF 10. English Grade IS B ; PLUS 0%, ONLY IF 10. English Grade IS C or CR ; PLUS 0%, ONLY IF 10. English Grade IS D ; PLUS -1%, ONLY IF 10. English Grade IS F or NC ; } IS LESS THAN 81.5 )) THEN: Placement Would Be: This Rule Applies To: All Majors.

Requirements Above average technical skills Someone to lead 2 to 10 hours with each faculty group 10 hours set-up time About 20 hours desk/computer time Minimal cash outlay

How Good is ACCUPLACER ® Really? A Report on a Successful Placement System. By Ron Gordon Thank you for not throwing things at the presenter.