1. Designing Electronic Homework for Learning First, and Assesment Second Bill Vining SUNY College at Oneonta Beatrice Botch UMass Amherst Roberta Day UMass Amherst

2. Development of the OWL Electronic Homework System Philosophy Needs How it all Works

3. Philosophy Exams and Quizzes are for evaluation. Homework is for learning.

4. Needs to Support Learning Graded Homework questions No “penalty” for trying Feedback on how to answer each question A way to ensure that sometime, eventually, they really get it right on their own Extra Support –Teaching materials aimed at concepts –Detailed, step-by-step help for the more troubled among us

5. Needs to Support Teaching Comprehensive coverage Strong accuracy and pedagogical vetting Flexibility Ease of use: –Assigning work –Obtaining grades –Managing Students It needs to work

6. Needs to Support Learning Graded Homework questions No “penalty” for trying Feedback on how to answer each question A way to ensure that sometime, eventually, they really get it right on their own Extra Support –Teaching materials aimed at concepts –Detailed, step-by-step help for the more troubled among us

7. Homework Question Correct Answer and Feedback Answer Mastery Credit correct incorrect The Necessity of Parameterization: The No-Penalty Mastery Method

8. Three Dimensions of Parameterization Numbers ChemistryQuestions

9. Support I: Question-Specific Feedback

10. Homework Question Correct Answer and Feedback Answer Mastery Credit correct incorrect Concept Simulations and Exercises Newly generated question Step-by-step tutorial Support II: Additional Help for Concepts and Problem Solving

11. Tutorials: Numerical

12. Tutorials: Graphical

13. Concept Simulations

14. Multimedia Exercises

15. Homework Question Correct Answer and Feedback Answer Mastery Credit correct incorrect Concept Simulations and Exercises Newly generated question Step-by-step tutorial Support III: Integration of Materials Textbook and Learning Resources

16. Support III: Integration of Materials

17. Organization: Chapter Folders

18. Organization: Assignments

19. Organization: Units

20. Organization: Questions

21. Instructor Control Assignment Dates/ Retroactively Changeable Individual Extensions Scoring Cutoffs/Number of Tries Show Answers/Feedback Full Grade and Reporting Functions Full Question Editing and Authoring

22. OWL: The Current State Courses: –General Chemistry –Organic Chemistry –GOB –Introductory –Liberal Arts –Gen Chem and Organic “Prep” Users > 300 schools > 75,000 students Over 500,000 student users to date

23. OWL: The Current State Content: General Chemistry > 600 Assignments > 1200 Units ~ 700 Tutors ~ 100 Simulations ~ 150 Multimedia Exercises Including 20-40 Text End-of-Chapter- Specific Questions per Chapter.

24. OWL: The Current State Evaluation Studies Multiple Studies, None Perfect, General Conclusions:  Can raise grades by ~ letter grade  Most effective for C/D students  Question Repeation/Feedback is essential

25. Electronic Homework Hints and Tips  Be a believer, even if you’re not  Assign early, assign often  Assign intro- how to assignments  Put some slack in the system

26. The Content/Software Team Chemistry Roberta Day Beatrice Botch Bill Vining Barbara Stewart Peter Lillya Steve Hixson Susan Young Cowtown Productions Eric Mulvihill Jesse Charette Bill Rohan UMass CCBIT OWL Creators Steve Battisti Cindy Stein Dave Hart Thomson Learning Lisa Lockwood, David Harris, Michelle Julet, Gayle Huntress, Amee Mosely, Lisa Weber

27. Electronic Book