Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community.

Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community College, Department of Chemistry, Independence, KS Diana Mason, Ph.D., ACSF, Emeritus Professor, University of North Texas, Department of Chemistry, Denton, TX

“we do not assess knowledge, we assess performance” Thomas Jose Professor of Chemistry Blinn College, Bryan Campus Bryan, TX

Abstract Student success in chemistry requires students to learn problem-solving skills they normally do not possess when they enter General Chemistry I courses. Many times students solve problems using their misconceptions without the feedback needed to correct their misconceptions. There are many different online homework systems, all designed to provide instant feedback to students when they have answered questions incorrectly and to provide hints or suggestions to solve the problem correctly. This type of feedback helps student’s correct misconceptions before assessments and thereby increase student success in chemistry courses. BUT, what happens with content retention after several days have passed, like on the final exam. Will online homework be advantageous in preventing knowledge decay? Some systems appear to be better than others in helping students retain valid conceptions. This research investigated the correlation between the different online homework systems, knowledge decay, and the effect on student success.

Background First Semester General Chemistry Course Diana Mason, Ph.D. at the University of North Texas Chemistry: The Molecular Science, John W. Moore & Conrad L. Stanitski, Cengage Fall 2001 to the Spring 2012 Fall 2001 to Spring 2005: Traditional Homework Fall 2005, Spring 2006, Fall 2006, Spring 2012: OWL (Spring 2012-OWL Book) Fall 2010, Spring 2011: Sapling Learning Spring 2009, Fall 2009: ALEKS Fall 2007: MasteringChemistry Spring 2008: Catalyst

Online Homework Systems OWL: Online Web-based Learning, Brooks/Cole- Cengage Sapling: Sapling Learning, Austin, TX ALEKS: Assessment and LEarning in Knowledge Spaces, UC Regents, ALEKS Corp MasteringChemistry: Pearson Publishing Catalyst: WileyPLUS, John Wiley & Sons

Definitions Successful: Grades of A, B, C, or scores ≥ 69.5% Unsuccessful: Grades of D, F, W, or scores < 69.5% Knowledge Decay: Forgetting what has been learned Retention: Retaining what has been learned Delta Exams (  Exams ): Final Exam Score – Exam Average

Correlations

Fall 2001-Spring 2005 Traditional Homework (r 2 = 0.7032, n = 608)

Fall 2005, Spring 2006, Fall 2006, Spring 2012 OWL Online Homework (r 2 = 0.6708, n = 575)

Fall 2010, Spring 2011 Sapling Online Homework (r 2 = 0.8339, n = 408)

Fall 2009, Spring 2009 ALEKS Online Homework (r 2 = 0.7666, n = 364)

Fall 2007 MasteringChemistry Online Homework (r 2 = 0.7155, n = 71)

Spring 2008 Catalyst Online Homework (r 2 = 0.6941, n = 144)

Percentage of successful students using different homework systems n = 608 59.5% n = 575 53.6% n = 408 54.7% n = 364 52.5% n = 71 60.6% n = 144 56.9%

Knowledge Decay students “experience a significant decrease in achievement during the first 48 hours following a test. This decrease remains constant for at least 2 weeks.” Diane Bunce, Ph.D. Bunce, D. M.; Vandenlas, J. R.; Soulis, C. J. Chem. Educ. 2011, 88, 1231- 1237.

Traditional Homework (n = 545) (r 2 = 0.3967)

Traditional Homework (n = 545, 473) (r 2 = 0.3967, 0.2350)

OWL Homework (n = 559) (r 2 = 0.4148)

OWL Homework (n = 559, 412) (r 2 = 0.4148, 0.2332)

Sapling Homework (n = 399) (r 2 = 0.6279)

Sapling Homework (n = 399, 337) (r 2 = 0.6279, 0.6086)

ALEKS Homework (n = 346) (r 2 = 0.5060)

ALEKS Homework (n = 346, 254) (r 2 = 0.5060, 0.3157)

MasteringChemistry Homework (n = 71) (r 2 = 0.2461)

MasteringChemistry Homework (n = 67, 58) (r 2 = 0.2461, 0.2274)

Catalyst Homework (n = 139) (r 2 = 0.4238)

Catalyst Homework (n = 139,109) (r 2 = 0.4238, 0.2599)

Different Homework Systems: Fall 2001 to Spring 2012 TraditionalOWLSaplingALEKSMastering Chemistry Catalyst n60857540836471144 Successful (n)59.5% (608)53.6% (575)54.7% (408)52.5% (364)60.6% (71)56.9% (144) Homework Average (n) 74.1% (545)71.3% (559)69.1% (399)66.0% (346)75.6% (67)55.7% (139) Exam Average (n) 75.2% (545)61.4% (559)66.0% (399)65.3% (346)71.1% (67)64.1% (139) Final Exam Average (n) 69.3% (473)57.6% (412)63.3% (337)65.8% (254)69.3% (58)64.2% (109)  Exam (n) -8.4 (473)-4.9 (412)-4.8 (337)-5.2 (254)-4.0 (58)-4.3 (109)

Different Homework Systems: Fall 2001 to Spring 2012 TraditionalOWLSaplingALEKSMastering Chemistry Catalyst n60857540836471144 Successful (n)59.5% (608)53.6% (575)54.7% (408)52.5% (364)60.6% (71)56.9% (144) Homework Average (n) 77.4% (473)79.2% (412)71.8% (337)70.6% (255)80.0% (58)62.6% (109) Exam Average (n) 77.7% (473)62.5% (412)68.2% (337)70.8% (255)73.3% (58)68.5% (109) Final Exam Average (n) 69.3% (473)57.6% (412)63.3% (337)65.8% (254)69.3% (58)64.2% (109)  Exam (n) -8.4 (473)-4.9 (412)-4.8 (337)-5.2 (254)-4.0 (58)-4.3 (109) Op-Out A/(FW) 20/11540/12315/5413/970/131/34

Fall vs Spring

Percentage of successful students using different homework systems n = 608 59.5% n = 575 53.6 % n = 408 54.7% n = 364 52.5% n = 71 60.6% n = 144 56.9%

Fall & Spring Semesters Percentage Successful Students using the Different Homework Systems n = 143 60.1% n = 464 58.0% n = 142 57.0% n = 433 52.7% n = 132 72.0% n = 276 46.4% n = 94 48.9% n = 270 53.7% n = 71 60.6% n = 144 56.9%

Different Homework Systems: Fall & Spring Semesters TraditionalOWLSapling Learning ALEKSMastering Chemistry Catalyst FallSprFallSprFallSprFallSprFallSpr n1434641424331322769427071144 Successful Students (n) 60.1% (143) 58.0% (464) 57.0% (142) 52.7% (433) 72.0% (132) 46.4% (276) 48.9% (94) 53.7% (270) 60.6% (71)56.9% (144) Homework Average (n) 70.8% (136) 75.2% (409) 72.2% (140) 71.1% (419) 76.4% (130) 67.7% (265) 56.8% (92) 69.3% (254) 75.6% (67)55.7% (139) Exam Average (n) 74.8% (136) 75.3% (409) 64.4% (140) 60.4% (419) 69.0% (130) 62.0% (265) 62.7% (92) 66.3% (254) 71.1% (67)64.1% (139) Final Exam Average (n) 71.9% (111) 68.5% (362) 63.4% (98) 55.8% (314) 69.0% (98) 62.6% (198) 71.3% (64) 63.7% (191) 69.3% (58)64.2% (109)  exam (n) -6.7 (111) -8.9 (362) -3.9 (98) -5.2 (314) -3.2 (98) -4.8 (198) 1.4 (64) -7.4 (191) -4.0 (58)-4.3 (109)

Different Homework Systems: Fall & Spring Semesters TraditionalOWLSapling Learning ALEKSMastering Chemistry Catalyst FallSprFallSprFallSprFallSprFallSpr n1434641424331322769427071144 Successful Students (n) 60.1% (143) 58.0% (464) 57.0% (142) 52.7% (433) 72.0% (132) 46.4% (276) 48.9% (94) 53.7% (270) 60.6% (71)56.9% (144) Homework Average (n) 76.0% (111) 77.9% (362) 81.5% (98) 78.5% (314) 81.6% (98) 75.0% (198) 61.0% (64) 73.8% (191) 80.0% (58)62.6% (109) Exam Average (n) 78.6% (111) 77.4% (362) 67.3% (98) 61.0% (314) 72.2% (98) 67.5% (198) 70.0% (64) 71.1% (191) 73.3% (58)68.5% (109) Final Exam Average (n) 71.9% (111) 68.5% (362) 63.4% (98) 55.8% (314) 69.0% (98) 62.6% (198) 71.3% (64) 63.7% (191) 69.3% (58)64.2% (109)  exam (n) -6.7 (111) -8.9 (362) -3.9 (98) -5.2 (314) -3.2 (98) -4.8 (198) 1.4 (64) -7.4 (191) -4.0 (58)-4.3 (109)

Males vs Females

Different Homework Systems: Male vs Female TraditionalOWLSapling Learning ALEKSMastering Chemistry Catalyst MaleFemaleMaleFemaleMaleFemaleMaleFemaleMaleFemaleMaleFemale n33227529128122118721315147248955 Successful Students (n) 54.5% (332) 65.8% (275) 53.6% (291) 54.4% (281) 53.3% (221) 56.1% (187) 45.5% (213) 63.6% (151) 55.3% (47) 66.7% (24) 55.1% (89) 60.0% (55) Homework Average (n) 67.0% (307) 78.4% (253) 68.3% (280) 74.4% (279) 66.3% (218) 72.5% (181) 62.9% (200) 70.2% (146) 73.2% (44) 80.3% (23) 53.7% (85) 58.9% (54) Exam Average (n) 69.7% (307) 77.3% (253) 62.6% (280) 60.2% (279) 65.5% (218) 66.5% (181) 62.7% (200) 69.0% (146) 71.2% (44) 68.9% (23) 62.2% (85) 66.9% (54) Final Exam Average (n) 68.0% (246) 70.7% (227) 59.4% (199) 55.9% (213) 62.5% (194) 64.4% (145) 63.5% (136) 68.0% (119) 69.1% (37) 69.6% (21) 63.7% (66) 65.0% (43)  exam (n) -8.5 (246) -8.5 (227) -4.9 (199) -4.9 (213) -5.2 (194) -4.2 (145) -5.4 (136) -4.9 (119) -5.0 (58) -2.3 (21) -4.3 (66) -4.4 (43)

Fall vs Spring Males vs Females

Traditional Homework System: Fall 2001 to Spring 2005 Traditional Homework Fall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n6083322751438558464247217 Successful (n)59.5% (608) 54.5% (332) 65.8% (275) 60.1% (143) 52.9% (85) 70.7% (58) 58.0% (464) 55.1% (247) 64.5% (217) Homework Average (n) 74.1% (545) 67.0% (307) 78.4% (253) 70.8% (136) 68.9% (79) 73.3% (57) 75.2% (409) 66.4% (228) 81.0% (196) Exam Average (n) 75.2% (545) 69.7% (307) 77.3% (253) 74.8% (136) 71.3% (79) 79.7% (57) 75.3% (409) 69.1% (228) 76.7% (196) Final Exam Average (n) 69.3% (473) 68.0% (246) 70.7% (227) 71.9% (111) 70.2% (61) 75.2% (52) 68.5% (362) 64.8% (192) 69.7% (177)  Exam (n) -8.4 (473) -8.5 (246) -8.3 (227) -6.7 (111) -5.3 (61) -9.4 (52) -8.9 (362) -10.5 (192) -8.3 (177)

OWL Homework System: Fall 2005, Fall 2006, Spring 2006, Spring 2012 Fall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n5752912811427468433217216 Successful (n)53.6% (575) 53.6% (291) 54.4% (281) 57.0% (142) 58.1% (74) 55.9% (68) 52.7% (433) 52.1% (217) 53.2% (216) Homework Average (n) 71.3% (559) 68.3% (280) 74.4% (279) 72.2% (140) 68.9% (72) 75.7% (68) 71.1% (419) 68.1% (208) 74.0% (211) Exam Average (n) 61.4% (559) 62.6% (280) 60.2% (279) 64.4% (140) 66.2% (72) 62.5% (68) 60.4% (419) 61.3% (208) 59.5% (211) Final Exam Average (n) 57.6% (412) 59.4% (199) 55.9% (213) 63.4% (98) 64.5% (53) 62.1% (45) 55.8% (314) 57.3% (146) 54.2% (168)  Exam (n) -4.9 (412) -4.9 (199) -4.9 (213) -3.9% (98) -3.7 (53) -4.1 (45) -5.2 (314) -5.3 (146) -5.2 (168)

Sapling Learning Homework System: Fall 2010 to Spring 2011 Fall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n4082211871327656276145131 Successful (n)54.7% (408) 53.3% (221) 56.1% (187) 72.0% (132) 67.1% (76) 78.6% (56) 46.4% (276) 46.2% (145) 46.6% (131) Homework Average (n) 69.1% (399) 66.3% (218) 72.5% (181) 76.4% (130) 73.6% (76) 80.2% (54) 67.7% (265) 66.2% (138) 69.3% (127) Exam Average (n) 66.0% (399) 65.5% (218) 66.5% (181) 69.0% (130) 66.5% (76) 72.4% (54) 62.0% (265) 60.1% (138) 64.0% (127) Final Exam Average (n) 63.3% (337) 62.5% (194) 64.4% (145) 69.0% (98) 68.9% (54) 69.1% (44) 62.6% (198) 62.9% (97) 62.3% (101)  Exam (n) -4.8 (337) -5.2 (194) -4.2 (145) -3.2 (98) -3.1 (54) -3.3 (44) -4.8 (198) -5.1 (97) -4.1 (101)

ALEKS Homework System: Fall 2009 to Spring 2009 ALEKSFall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n364213151945539270158112 Successful (n)52.5% (364) 45.5% (213) 63.6% (151) 48.9% (94) 43.6% (55) 56.4% (39) 53.7% (270) 46.20 (158) 64.2% (112) Homework Average (n) 66.0% (346) 62.9% (200) 70.2% (146) 56.8% (92) 50.4% (54) 66.0% (38) 69.3% (254) 67.6% (146) 71.1% (108) Exam Average (n) 65.3% (346) 62.7% (200) 69.0% (146) 62.7% (92) 58.3% (54) 69.0% (38) 66.3% (254) 64.3% (146) 69.0% (108) Final Exam Average (n) 65.8% (254) 63.5% (136) 68.0% (119) 71.3% (64) 65.4% (37) 79.5% (27) 63.7% (191) 62.8% (99) 64.7% (92)  Exam (n) -5.2 (254) -5.4 (136) -4.9 (119) 1.4 (64) 0.4 (37) 2.7 (27) -7.4 (191) -7.5 (99) -7.2 (92)

MasteringChemistry Homework System: Fall 2007 Mastering Chemistry Fall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n 714724 Successful (n) 60.6% (71) 55.3% (47) 66.7% (24) Homework Average (n) 75.6% (67) 73.2% (44) 80.3% (23) Exam Average (n) 71.1% (67) 71.2% (44) 68.9% (23) Final Exam Average (n) 69.3% (58) 69.1% (37) 69.6% (21)  Exam (n) -4.0 (58) -5.0 (37) -2.3 (21)

Catalyst Homework System: Spring 2008 CatalystFall & Spring Male & Female Fall & Spring Male Fall & Spring Female Fall Male & Female Fall Male Fall Female Spring Male & Female Spring Male Spring Female n 1448955 Successful (n) 56.9% (144) 55.1% (89) 60.0% (55) Homework Average (n) 55.7% (139) 53.7% (85) 58.9% (54) Exam Average (n) 64.1% (139) 62.2% (85) 66.9% (54) Final Exam Average (n) 64.2% (109) 63.7% (66) 65.0% (43)  Exam (n) -4.3 (109) -4.3 (66) -4.4 (43)

How does e-Homework Change Course Grades? GradesOWLSaplingALEKSOverall n204295254753 RaisedLoweredRaisedLoweredRaisedLoweredRaisedLowered A138---0 0 5 5 B20884421171323 C17385513131629 D125509247189 F1094---11---3 18--- Sum75325929511426556 %12.34.49.81.74.316.58.67.4

Conclusion Homework is homework! Advantage is “time on task” Ability for instant feedback Online homework systems are different, you should choose the system that fits your teaching focus & student population. Continuity within the department using a homework system. Online homework systems seem to have an effect on knowledge decay.

Acknowledgments UNT Internal Grant for N-Gen Project for course improvement. All online homework publishers that have encouraged the research. All the students enrolled in first-semester general chemistry classes who participated. The administration at Independence Community College.

Thank You!

Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community.

Similar presentations

Presentation on theme: "Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community.

Similar presentations

Presentation on theme: "Correlation between Different Online Homework Systems, Student Success, and Knowledge Decay Blain Mamiya, Ph.D., Professor of Chemistry, Independence Community."— Presentation transcript:

Similar presentations

About project

Feedback