1. 1 Making Better Decisions on Placement in Mathematics Courses W. Robert Stephenson Iowa State University

2. Outline ALEKS Logistic Regression Calculus I (MATH 165) Introductory Statistics (STAT 101/104) 2

3. ALEKS Assessment and Learning in Knowledge Spaces Online, adaptive assessment Assesses mastery in eight areas of mathematics 3

4. ALEKS Equations and Inequalities Exponentials and Logarithms Exponents and Polynomials Geometry and Trigonometry 4

5. ALEKS Linear and Quadratic Equations Radical Expressions Rational Expressions Real Numbers 5

6. ALEKS 6

7. The ALEKS score is the weighted combination of the 8 sub-scores. Scores range from 0 to 100. 7

8. Prediction We wish to use the ALEKS score to predict the probability of “success” in a mathematics or statistics course. 8

9. “Success” A– or better B– or better C– or better PASS (D– or better) 9

10. Logistic Regression 10

11. Logistic Regression 11

12. Calculus I 1,099 students who took MATH 165 fall 2011. 72% Frosh, 28% Soph ALEKS mean: 72.95, std dev: 14.92 12

13. Calculus I 13 ALEKS Score

14. Calculus I 14 Letter Grade

15. Calculus I 15

16. Calculus I 16 0.7955 0.7163 0.4484 0.1696

17. Calculus I There is fairly good agreement between the predicted probabilities of “success” and the observed probabilities, with the possible exception of A– or better. 17

18. Calculus I Using ALEKS for placement recommendations seems reasonable. Current recommendation: ALEKS of 65 or greater. 18

19. Intro Statistics 156 students who took STAT 101/104. CLAS: 59%, CALS: 25% ALEKS mean: 50.1, std dev: 23.28 19

20. Intro Statistics 20 ALEKS Score

21. Intro Statistics 21 Letter Grade

22. Intro Statistics 22

23. Intro Statistics 23 0.7955 0.7163 0.4484 0.1696

24. Intro Statistics There is not as good agreement between the predicted probabilities of “success” and the observed probabilities as there is when using ALEKS with Calculus I. 24

25. Intro Statistics Using ALEKS for placement recommendations is not as accurate for Introductory Statistics. Current recommendation: ALEKS of 35 or greater. 25

26. Sub-scores The ALEKS score is a weighted average of the 8 area sub-scores. Some of the areas may have little to do with prerequisite knowledge for success in introductory statistics. 26

27. Predicting PASS The use of the sub-score for rational expressions does a better job of predicting the probability a student passes an introductory statistics course. 27

28. Intro Statistics 28 Rational Expressions sub-score

29. Rational Expressions 29 0.9592 0.9338

30. Intro Statistics Use the Rational Expressions sub-score for placement in an introductory statistics course Suggested recommendation: Rational Expressions sub- score of 20 or greater. 30