Using Computer Adaptive Testing Software in a College Environment George Alexander UW Rock County Eric Key and Richard O’Malley UW-Milwaukee

Difficulties Teaching Pre-College Mathematics at the College Level Diverse student skill base “One size fits all” model Inefficient use of instructional time Diversion of student effort from degree objectives Diversion of university resources

Project Goals Identify ways to: Help students avoid needless review Help students achieve accurate mathematics placements Enable teachers to target instruction to the individual needs of students Engage students as active learners

Possible Remedy: Computer Adaptive Testing Computer adaptive testing is a cyclical process Assess the students’ current skill set Provide a list of topics that can reasonably be studied from that skill set Assess student progress and identify new topics to study This works on an individualized basis

Two implementations Computer Adaptive Testing in a Classroom Setting Beginning Algebra at UW-Rock County College Algebra at UW-Milwaukee Computer Adaptive Testing as a Means of Review Before Starting Coursework Math PEP Product Choice: ALEKS - Assessment and LEarning in Knowledge Spaces

Access to ALEKS Standard Internet requirements Plug-in download required Math Lab/Computer Lab/Library/Home

Beginning Algebra: ALEKS at UW Rock County Require a minimum of: 45 hours of ALEKS usage 75% of ALEKS topics mastered Recommend 90 hours of ALEKS usage Give in-class exams to confirm mastery Final Exam: UW Math Placement retest

ALEKS at UW Rock County Class meets in lab with 25 computers Students work independently in and out of class Individual instruction during class period Student tutor available 5 hours per week

Initial ALEKS assessments UW Rock County, Spring 2002

Recent ALEKS assessments UW Rock County, Spring 2002 (midterm)

Assessments vs. Hours of Usage UW Rock County, Spring 2002 (midterm)

College Algebra : ALEKS at UW Milwaukee Base Text: Barnett, Ziegler, Byleen ALEKS and Text are linked Course consists of two types of topics Readiness for College Algebra College Algebra proper

College Algebra : ALEKS at UW Milwaukee Recommended minimum 70 hours of ALEKS usage Required: 100% mastery of readiness items 70% of ALEKS topics mastered for C All exams administered by ALEKS

College Algebra : ALEKS at UW Milwaukee Initial ALEKS Assessment has two components Readiness for College Algebra (40 items) College Algebra Material (99 items)

Initial Readiness Assessment Including Dropped Students

ALEKS College Algebra Progress

ALEKS College Algebra Overall Progress

College Algebra Progress: Items Learned/hours Spent

Mathematics Placement Enhancement Program (Math PEP) How to increase math placement retesting? 90% place lower than last high school course taken 5% retest 65% test below math required for admission Too few UWM students repeat the Mathematics Placement Exam!

Math PEP Convincing Students to Retest Identify Students who just missed a higher placement Work with Advising Check University Records Mass mailing Individual Phone Calls to Selected Candidates

Math PEP Participation Factors influencing students’ choices Comfort level of Current Placement Disenchantment with placement into Non-Credit Courses Willingness to take classes that repeat high school work even if degrees are delayed

Math PEP Structure Use software to verify students’ current placement Use software to monitor individual student review Provide computer resources Provide encouragement to review Encourage students to re-test Advise students on future courses

Math PEP Outcomes 31% more students re-tested than in % of Math PEP students in pre-algebra re- placed into algebra courses vs 59% of others 56% of Math PEP students in non-credit courses re-placed into credit courses vs 49% of others 8% of Math PEP students in credit courses re-placed higher vs 28% of others 96% of Math PEP students re-placed at least as high vs 89% of others

Math PEP Outcomes 750 students contacted 72 students reviewed 48 students retested 54% tested higher 140 others retested 50% of these tested higher

Students Retesting

Placement Code 00 Retesting Results 56 Students Retested With Original Placement Code did not participate in Math PEP 10 participated in Math PEP Math PEP participants did markedly better!

Level 00 Retesting Results

Placement Code 10 Retesting Results 66 Students Retested With Original Placement Code did not participate in Math PEP 26 participated in Math PEP Math PEP participants did slightly better!

Level 10 Retesting Results

Placement Code 20 Retesting Results 41 Students Retested With Original Placement Code did not participate in Math PEP 12 participated in Math PEP Non-Math PEP participants did significantly better!

Level 20 Retesting Results

Initial Distribution of Placement Codes

Final Distribution of Placement Codes

Non Math PEP Before and After

Math PEP Before and After