Online Homework and Assessment Systems: Fashion or Fad ColoMATYC Annual Conference Arapahoe Community College Friday March 8, 2013 Jeffrey V. Berg Arapahoe Community College

 Products  Introductions – Survey of Current Practice  Background of Presenter  Strength and Advantages  Weaknesses and Disadvantages  Sample Homework/Prebuilt Courses  Reliability and Validity of Tests  Unexpected Philosophy Shift of Using Online Testing in a Face-to-Face Setting  Future Direction/Discussion Topics

Products MAA (open source) – Webwork Cengage – Enhanced WebAssign MacGraw Hill – Aleks McGraw Hill – Connect Pearson – MyMathLab/MathXL xyz Textbooks WebAssign lyryx -

Introductions Name Experience with online assessment products written homework only written quizzes only written test only online and written homework online and written quizzes online and written tests online homework only online quizzes only online test only

Background of Presenter Initial Skepticism The Plunge – Fall 2008 Online College Algebra – 14 sections Online Intermediate Algebra – 4 sections Online Calculus I – 1 section (spring 2013) Face-to-Face College and Intermediate Algebra Face-to-Face Calculus I and II

Strengths and Advantages

 Cost to student  Flexibility  Immediate feedback  Unlimited attempts (on homework)  Test Generation  Study aids  Automated grading  Compilation of student performance data  Record of student effort – time spent on assignments Strengths and Advantages

Disadvantages and Weaknesses

 Impersonal  Notational inflexibility for answers (?)  Written work not viewed by instructor  Student practice with hand-drawn graphs 2013 Joint Meetings San Diego Customizable graphical user interface applets integrated with WeBWorK calculus problems. Daniel Gries*, Hopkins School (1086-VF-1023)  Immediate feedback hampers development of skills in reflection and patience

Time Spent on Homework Initial philosophy – 5 questions per section Sample Homework/Prebuilt course – about 20 questions per section Fall 2011 MAT sections questions approximate average time per student - 45 minutes Spring 2013 MAT sections questions mean time per student – 4 hours 2 minutes mean time per student – 4 hours 2 minutes median time per student – 2 hours 35 minutes

MAT 201 Calculus I – 24 hours 36 minutes MAT 202 Calculus II – 27 hours 50 minutes MAT Spring sections of Homework Roughly 4-6 hours per week on homework Sample Homework/Prebuilt Course student A1student A2student B1student B2student C1student C2 homework average time factor

Reliability and Validity of Tests “On-line Mathematics Education: Are We Upholding Our Responsibilities?” Mathematical Association of America – Rocky Mountain Section Conference Colorado School of Mines April 17, 2009 Jeffrey V. Berg

Reliability and Validity of Tests Academic Year Fall 2012 Face-to-Face Spring 2013 Online

Unexpected Philosophy Shift of Online Testing in a Face-to-Face Setting  Test Security – Early Online Discussion  Two Attempts  Test Day Evolution

 Products  Introductions – Survey of Current Practice  Background of Presenter  Strength and Advantages  Weaknesses and Disadvantages  Sample Homework/Prebuilt Courses  Reliability and Validity of Tests  Unexpected Philosophy Shift of Using Online Testing in a Face-to-Face Setting  Future Direction/Discussion Topics

 Academic Integrity  Deficiencies  Two Attempts vs Practice Test/One Attempt  Assignment Deadlines  Show your Work  Professional Time Commitment Future Direction/Discussion Topic