1. Using Mastering for both Short-Term & Long-Term Success: Tips & Techniques to Consider Using Mastering for both Short-Term & Long-Term Success: Tips & Techniques to Consider Scott Hildreth - Chabot College

2. 2 Scott Hildreth - Long Beach - October 2012 A caveat, right from the start… Nothing I can share today will eliminate….

3. 3 Scott Hildreth - Long Beach - October 2012

4. 4 Another caveat, right from the start… There is no ONE right way to do Mastering, that everyone will agree to…

5. 5 Scott Hildreth - Long Beach - October 2012 A typical division meeting at Chabot Even though we are all scientists…

6. 6 Scott Hildreth - Long Beach - October 2012 A typical Physics department meeting at Chabot Not even in the same discipline!

7. 7 Scott Hildreth - Long Beach - October 2012 Ways I used Mastering initially… In Physics – for automated grading of traditional Homework problems in a once-a-week assignment In Physics – for automated grading of traditional Homework problems in a once-a-week assignment In Astronomy – for tracking student access and time using animated tutorials In Astronomy – for tracking student access and time using animated tutorials

8. 8 Scott Hildreth - Long Beach - October 2012 An “Aha” moment

9. 9 Scott Hildreth - Long Beach - October 2012 Ways I Use Mastering Now… Calculus-based Physics Homework Homework Introductory assignments at start of each chapter Introductory assignments at start of each chapter Weekly homework assignments Weekly homework assignments In-class collaborative group work (teams) In-class collaborative group work (teams) Lecture – doing problems together Lecture – doing problems together Exam Review Exam Review In-class competition (teams) In-class competition (teams) Outside of class preparation Outside of class preparation Extra Credit & Remedial Help Extra Credit & Remedial Help

10. 10 Scott Hildreth - Long Beach - October 2012 Ways I Use Mastering Now… Introductory Astronomy Homework Homework Weekly homework assignments with ranking tasks Weekly homework assignments with ranking tasks Reading quizzes Reading quizzes Links to additional reading, videos, and resources Links to additional reading, videos, and resources Lecture – doing online simulations together Lecture – doing online simulations together Exam Review Exam Review Outside of class preparation Outside of class preparation Extra Credit & Remedial Help Extra Credit & Remedial Help

11. 11 Scott Hildreth - Long Beach - October 2012 Yet another caveat… You don’t have to do all of these at once! Try one new thing a term…

12. 12 Scott Hildreth - Long Beach - October 2012 Tips for Short-Term Success Diagnostics Diagnostics Discussion/Recitation Section Group Work Discussion/Recitation Section Group Work Competitive Group Exam Reviews Competitive Group Exam Reviews Lecture Problems Lecture Problems Homework Quizzes Homework Quizzes Remediation & Extended Learning/Extra Credit Remediation & Extended Learning/Extra Credit

13. 13 Scott Hildreth - Long Beach - October 2012 Tip #1 Diagnostics Teaching US why students get the wrong answers

14. 14 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Quickly see what they miss & why

15. 15 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Quickly what they miss & why

16. 16 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Cannon, Annie Chandrasekhar Einstein, Albert Feynman, Richard Hawking, Stephen Herschel, Carol Klumpke-Roberts, Lightman, Alan Perlmutter, Saul Rubin, Vera Quickly see who is working

17. 17 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Cannon, Annie Chandrasekhar Einstein, Albert Feynman, Richard Hawking, Stephen Herschel, Carol Klumpke-Roberts, Lightman, Alan Perlmutter, Saul Rubin, Vera Quickly see time they spend

18. 18 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Cannon, Annie Chandrasekhar, S. Einstein, Albert Feynman, Richard Klumpke-Roberts, D Lightman, Alan Rubin, Vera Cannon, Annie Chandrasekhar, S. Einstein, Albert Feynman, Richard Klumpke-Roberts, D Lightman, Alan Rubin, Vera Quickly see success on each assignment

19. 19 Scott Hildreth - Long Beach - October 2012 Mastering Captures Data Quickly see time per assignment

20. 20 Scott Hildreth - Long Beach - October 2012 #1 Short-Term Tip: Use Diagnostic Data Examine submissions quickly by Examine submissions quickly by Hardest problem (& most common errors) Hardest problem (& most common errors) Time (caveat: not necessarily valid measure) Time (caveat: not necessarily valid measure) Names Names Adapt lecture/discussion to focus on errors Adapt lecture/discussion to focus on errors Re-assign key problems (with variables!) Re-assign key problems (with variables!) Examine student success across spectrum of course assessments Examine student success across spectrum of course assessments

21. 21 Scott Hildreth - Long Beach - October 2012 Mastering Enables RAPID Data Analysis

22. 22 Scott Hildreth - Long Beach - October 2012 Mastering Enables Data Analysis

23. 23 Scott Hildreth - Long Beach - October 2012 Mastering Enables Data Analysis

24. 24 Scott Hildreth - Long Beach - October 2012 Tip #2 Group Work Shared learning & teaching

25. 25 Scott Hildreth - Long Beach - October 2012 #2 Short-Term Tip: Try Collaborative Group Work Teams of 3-4 students per single computer Teams of 3-4 students per single computer One person uses their login One person uses their login Everyone participates to arrive at single answer Everyone participates to arrive at single answer Build short assignments with tutorials, ranking tasks, test-bank questions, & a few EOCs Build short assignments with tutorials, ranking tasks, test-bank questions, & a few EOCs Copy score to gradebook for all participants Copy score to gradebook for all participants

26. 26 Scott Hildreth - Long Beach - October 2012 Tip #3: Competitive Exam Review Timed, Collaborative, Conceptual

27. 27 Scott Hildreth - Long Beach - October 2012 #3 Short-Term Tip: Try Competitive Exam Review Teams of 3-4 students per single computer Teams of 3-4 students per single computer Build short TIMED assignments with test-bank questions Build short TIMED assignments with test-bank questions Use diagnostics during event to spur on teams as they race to finish. Use diagnostics during event to spur on teams as they race to finish.

28. 28 Scott Hildreth - Long Beach - October 2012 #3 Short-Term Tip: Try Competitive Exam Review

29. 29 Scott Hildreth - Long Beach - October 2012 Tip #4: Lecture Problems Help Students see how to use the system

30. 30 Scott Hildreth - Long Beach - October 2012 #4 Short-Term Tip: Use the System in Lecture Demonstrate keyboard shortcuts Demonstrate keyboard shortcuts Entering \alpha becomes  Entering \alpha becomes  Entering x_2^2becomes x 2 2 Entering x_2^2becomes x 2 2 Demonstrate feedback for incorrect answers Demonstrate feedback for incorrect answers Provide additional problems for students to review or access if they miss lecture Provide additional problems for students to review or access if they miss lecture

31. 31 Scott Hildreth - Long Beach - October 2012 Tip #5: Homework Quizzes Encourage EVERY Student to Learn the Material

32. 32 Scott Hildreth - Long Beach - October 2012 #5 Short-Term Tip: Homework Quizzes How can we deal with “cheating”? How can we deal with “cheating”? Students do much better on HW than on exams Students do much better on HW than on exams Collaborating Collaborating Outright copying Outright copying Unlimited time Unlimited time Pick one exam-type problem for in-class quiz on day HW is due. Pick one exam-type problem for in-class quiz on day HW is due.

33. 33 Scott Hildreth - Long Beach - October 2012 #5 Short-Term Tip: Homework Quizzes

34. 34 Scott Hildreth - Long Beach - October 2012 #5 Short-Term Tip: Homework Quizzes

35. 35 Scott Hildreth - Long Beach - October 2012 Tip #6: Extra Credit & Remediation Reward Students willing to go farther

36. 36 Scott Hildreth - Long Beach - October 2012 #6 Short-Term Tip: Remediation & Extra Credit Take advantage of breadth of problems Take advantage of breadth of problems Examples from Physics/Astronomy Examples from Physics/Astronomy Math Remediation +/- Math Remediation +/- Video Tutors Video Tutors Concept Quizzes Concept Quizzes Encourage applications and extensions Encourage applications and extensions Locating (& Creating!) YouTube clips Locating (& Creating!) YouTube clips

37. 37 Scott Hildreth - Long Beach - October 2012 Adding Hyperlinks

38. 38 Scott Hildreth - Long Beach - October 2012 Link Examples Add Hyperlinks to Assignments Add Hyperlinks to Assignments Share videoclips, lecture links, and more Share videoclips, lecture links, and more

39. 39 Scott Hildreth - Long Beach - October 2012 Link Examples Add Hyperlinks to Assignments Add Hyperlinks to Assignments Share videoclips, lecture links, and more Share videoclips, lecture links, and more What they see…

40. 40 Scott Hildreth - Long Beach - October 2012 And over the long term? Data!

41. 41 Scott Hildreth - Long Beach - October 2012 Using Results Anni Cannon Marie Curie Charles Darwin Albert Einstein Natalie Angier Carolyn Shoemaker

42. 42 Scott Hildreth - Long Beach - October 2012 Tips for Long-Term Success Use Gradebook Data to Compare Assessments Use Gradebook Data to Compare Assessments Download to Excel Download to Excel Compare Homework Scores to Midterms Compare Homework Scores to Midterms Focus Attention on Particular Students Focus Attention on Particular Students Use Learning Outcomes to compare results across classes and time Use Learning Outcomes to compare results across classes and time

43. 43 Scott Hildreth - Long Beach - October 2012

44. 44 Scott Hildreth - Long Beach - October 2012 Mastering Enables Data Analysis: Learning Outcomes

45. 45 Scott Hildreth - Long Beach - October 2012 Mastering Enables Data Analysis:

46. 46 Scott Hildreth - Long Beach - October 2012 Mastering Enables Data Analysis:

47. 47 Scott Hildreth - Long Beach - October 2012 Tips for Long-Term Success Use Diagnostics to clarify and enhance key problems Use Diagnostics to clarify and enhance key problems Look at past semester results Look at past semester results Identify areas where more students “tripped” Identify areas where more students “tripped” Add messages, hints, and even wording to help students do even better Add messages, hints, and even wording to help students do even better See website for details See website for detailswebsite

48. 48 Scott Hildreth - Long Beach - October 2012 Messages – before any item in an assignment Messages – before any item in an assignment Simple editor Simple editor Add Annotations Add Annotations Add hyperlinks Add hyperlinks Rephrase or emphasize Rephrase or emphasize Advanced editor Advanced editor Expanded hints Expanded hints More correct/incorrect answer feedback More correct/incorrect answer feedback Enhancing Assignments

49. 49 Scott Hildreth - Long Beach - October 2012 Message Examples Add Messages to Assignments with instructions, caveats, gotcha’s, and encouragement Add Messages to Assignments with instructions, caveats, gotcha’s, and encouragement

50. 50 Scott Hildreth - Long Beach - October 2012 Hint Examples Add Hints to Problems w/ Simple Editor Add Hints to Problems w/ Simple Editor Declarative Hints nudge students

51. 51 Scott Hildreth - Long Beach - October 2012 Hint Examples Socratic Hints ask for students to answer

52. 52 Scott Hildreth - Long Beach - October 2012 Image Example Add your own diagrams & parts to problems Add your own diagrams & parts to problems

53. 53 Scott Hildreth - Long Beach - October 2012 Getting Started!

54. 54 Scott Hildreth - Long Beach - October 2012 Personal Goals Track student usage easily Track student usage easily Take earlier, positive action Take earlier, positive action Students obviously struggling Students obviously struggling Those working hard, and… Those working hard, and… Those hardly working. Those hardly working.

55. 55 Scott Hildreth - Long Beach - October 2012 Results: Astro Trend: Increase in Retention Trend: Increase in Retention Similar trend in Success Similar trend in Success Student Surveys: Student Surveys: 90% online AND on-campus say Mastering Astro helped them succeed. 90% online AND on-campus say Mastering Astro helped them succeed.

56. 56 Scott Hildreth - Long Beach - October 2012 Results: Physics Increase in Force Concept Inventory (FCI) Normative Gain Increase in Force Concept Inventory (FCI) Normative Gain Earlier detection of students with difficulties learning physics, and improved retention Earlier detection of students with difficulties learning physics, and improved retention Student Surveys: Student Surveys: 90% say Mastering Physics is the most important factor in their success. 90% say Mastering Physics is the most important factor in their success.

57. 57 Scott Hildreth - Long Beach - October 2012 We learn by trying things out!

58. 58 Scott Hildreth - Long Beach - October 2012 Familiarity breeds success… Over time, we will learn to incorporate Over time, we will learn to incorporate New Tutorial Problems with effective hints New Tutorial Problems with effective hints Which problems need additional hints Which problems need additional hints Which problems don’t work as well Which problems don’t work as well

59. 59 Scott Hildreth - Long Beach - October 2012 On the horizon… PhET (University of Colorado) simulations in Mastering PhET (University of Colorado) simulations in Mastering Even better audio/visual/text linkage Even better audio/visual/text linkage Improved adaptive learning Improved adaptive learning Quiz questions built into online text Quiz questions built into online text Redirection to advanced content and/or Redirection to advanced content and/or Remediation to review content Remediation to review content

60. 60 Scott Hildreth - Long Beach - October 2012 PhET Simulations My Solar System

61. 61 Scott Hildreth - Long Beach - October 2012 My Solar System PhET Simulations

62. 62 Scott Hildreth - Long Beach - October 2012 PhET Simulations Some thoughts to share… Some thoughts to share… Try these first in class if you can Try these first in class if you can Give more credit to match length Give more credit to match length Edit (with simple editor) follow-up questions Edit (with simple editor) follow-up questions Encourage students to explore Encourage students to explore Wonderful surprises from students! Wonderful surprises from students!

63. 63 Scott Hildreth - Long Beach - October 2012 On the horizon? More video Interactive Questions

64. 64 Scott Hildreth - Long Beach - October 2012 Questions? Discussion? Check out the resource list and current research Check out the resource list and current research http://www.chabotcollege.edu/faculty/shildreth/mastering http://www.chabotcollege.edu/faculty/shildreth/mastering http://www.chabotcollege.edu/faculty/shildreth/mastering Login to my classes to look around Login to my classes to look around Email me with questions! Email me with questions! Images reprinted in the online presentation and available online were borrowed with permission from "e-mail.this.book", The Cartoon Bank, Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson cannot be distributed online. Images reprinted in the online presentation and available online were borrowed with permission from "e-mail.this.book", The Cartoon Bank, Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson cannot be distributed online.

65. 65 Scott Hildreth - Long Beach - October 2012 Caveats, Gotchas, Gremlins

66. 66 Scott Hildreth - Long Beach - October 2012 Concerns How much time is required to LEARN the tool on our side…. And, How much time is required to LEARN the tool on our side…. And, How much time away from key concepts is really required to teach the tool to the student? How much time away from key concepts is really required to teach the tool to the student? What about teaching students to diagram problems, or explain steps of a solution? What about teaching students to diagram problems, or explain steps of a solution? What about Cheating? What about Cheating?

67. 67 Scott Hildreth - Long Beach - October 2012 “You won’t really know what they are doing wrong without looking at paper HW” “You won’t really know what they are doing wrong without looking at paper HW” “Some problems don’t lend themselves to computer mediation” “Some problems don’t lend themselves to computer mediation” “You spend too much time teaching the tool, not the concepts.” “You spend too much time teaching the tool, not the concepts.” “The tool is too complex.” “The tool is too complex.” “The grading system makes errors.” “The grading system makes errors.” “XXX’s system has more features….” “XXX’s system has more features….” Concerns & Criticisms

68. 68 Scott Hildreth - Long Beach - October 2012 But on the plus side… More time to focus on teaching More time to focus on teaching More information to use More information to use More flexibility than textbooks alone More flexibility than textbooks alone More accessibility More accessibility More help for students and because of you… More help for students and because of you… More help for faculty getting started, the right way. More help for faculty getting started, the right way.

69. 69 Scott Hildreth - Long Beach - October 2012 Credit: Walter Scriptunas II/Spaceflight Now