MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009

Where is Clemson University? October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Where is Clemson University? US Air Force Academy, Colorado Springs, CO October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Where is Clemson University? Clemson University Clemson, South Carolina October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO US Air Force Academy Colorado Springs, CO

Outline Advances in Technology: Tablet PCs Advances in Technology: Tablet PCs Interactivity in the Classroom Interactivity in the Classroom Tool: MessageGrid Replay Ink Tool: MessageGrid Replay Ink Features Features Assign, Collect, EvaluateAssign, Collect, Evaluate Replay, Tag, AnalyzeReplay, Tag, Analyze Current and Future Work Current and Future Work Acknowledgements Acknowledgements October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 6 Tablet PCs and Slates Lenovo ThinkPad X Series Tablet WACOM Tablets The Opportunity HP Pavilion dv3t series

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 7 Lenovo ThinkPad X Series Tablet HP Pavilion dv3t series WACOM Tablets How can instructors use Tablet PCs to advantage in and out of the classroom? How can instructors use Tablet PCs to advantage in and out of the classroom? The Challenge

2002 Clemson Laptop Mandate Every student is required to have a laptop computer with wireless access to the Internet Every student is required to have a laptop computer with wireless access to the Internet October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

The Challenge How can instructors use the laptop computers to advantage in and out of the classroom? How can instructors use the laptop computers to advantage in and out of the classroom? October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Web-based software tool to help promote interactivity in the classroom Web-based software tool to help promote interactivity in the classroom Clemsons Proposed Solution: MessageGrid October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Web-based Web-based Basic grid: rows and columns Basic grid: rows and columns Instructor designs grid Instructor designs grid Students post original submissions or replies to submissions Students post original submissions or replies to submissions Anything displayed by a browser Anything displayed by a browser Text, image, audio, video, animation, Ink, mapsText, image, audio, video, animation, Ink, maps Why use such a tool? Why use such a tool? Student responses to in-class exercises, presentations, online discussions, student questions, feedback from students, …Student responses to in-class exercises, presentations, online discussions, student questions, feedback from students, … Proposed Solution: MessageGrid October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 12 MessageGrid Evolution Every semester since January 2004, more instructors use MessageGrid At semesters end, instructors discuss possible improvements Suggestions with most instructor support are implemented

Current MessageGrid Features Message Grid October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Message Grid Basic Grid: Feedback/submissions from students October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Clickers: Assessment/Polling Message Grid Basic Grid: Feedback/submissions from students October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Clickers: Assessment/Polling Message Grid Basic Grid: Feedback/submissions from students Ink: Submitting diagrams and equations, rather than text October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Clickers: Assessment/Polling Ink: Submitting diagrams and equations, rather than text Mobile: Images, video, audio, GPS, and text in a portable, handheld grid Message Grid Basic Grid: Feedback/submissions from students October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Basic Grid: Feedback/submissions from students Clickers: Assessment/Polling Simple Upload/Evaluate: Rubric to facilitate evaluation of Freshman Engg labs Message Grid Ink: Submitting diagrams and equations, rather than text Mobile: Images, video, audio, GPS, and text in a portable, handheld grid October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Current MessageGrid Features Basic Grid: Feedback/submissions from students (FIE 2005, ITiCSE 2006) Clickers: Assessment/Polling (SIGCSE 2006) Message Grid New! Ink: Submitting diagrams and equations, rather than text (PLT 2007, FIE 2007, FIE 2008) Mobile: Images, video, audio, GPS, and text in a portable, handheld grid Simple Upload/Evaluate: Rubric to facilitate evaluation of Freshman Engg labs October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Message Grid Ink: Submitting diagrams and equations, rather than text October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO Current MessageGrid Features

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 21 Message Grid Ink: Pinpointing student misconceptions MessageGrid Replay Ink

Has MessageGrid Changed Teaching?

Teaching Style Studio Format (aka Mentoring, Coaching) Studio Format (aka Mentoring, Coaching) Reduced lectureReduced lecture More classroom activity/interactivityMore classroom activity/interactivity October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Teaching Style Studio Format (aka Mentoring, Coaching) Studio Format (aka Mentoring, Coaching) Reduced lectureReduced lecture More classroom activity/interactivityMore classroom activity/interactivity Typical 75-minute lecture period Typical 75-minute lecture period Data structures and algorithmsData structures and algorithms 20-minute lecture, 5-minute exercise,20-minute lecture, 5-minute exercise, repeated 3 times Typical 110-minute lab period Typical 110-minute lab period 15-minute lecture, 95-minute lab exercises15-minute lecture, 95-minute lab exercises October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

The Sandbox October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Checking Out a Tablet October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Working Individually October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Working Individually October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Teams of Three October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Teams of Two October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 31 Tablet Use at Clemson HP Tablet PC Video

Tablet PCs can provide Tablet PCs can provide Final Inked solutionsFinal Inked solutions Intermediate Ink stroke sequencesIntermediate Ink stroke sequences Ink strokes can be Ink strokes can be CollectedCollected Played and replayedPlayed and replayed Tagged and analyzedTagged and analyzed Key Observation October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 33 For example: Can provide interactivity in a data structures class (drawing graphs) For example: Can provide interactivity in a data structures class (drawing graphs) Instructor assigns exercisesInstructor assigns exercises Students submit solutionsStudents submit solutions Evaluation of solutionsEvaluation of solutions Tagging of solutionsTagging of solutions Analysis of tagsAnalysis of tags MessageGrid Replay Ink

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 34 Student solutions can be Student solutions can be Reviewed: Played and replayedReviewed: Played and replayed TaggedTagged AnalyzedAnalyzed MessageGrid Replay Ink

March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN 35 March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN 35 March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN 35 Solutions include: Solutions include: Linked listsLinked lists StacksStacks QueuesQueues Trees of all types (BST, AVL, Splay, B-Tree, binary heap, leftist heap, skew hap, binomial queue, etc.)Trees of all types (BST, AVL, Splay, B-Tree, binary heap, leftist heap, skew hap, binomial queue, etc.) Generic graphsGeneric graphs MessageGrid Replay Ink October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 36 Goals Immediate goal Immediate goal Deliver CS2/CS7 course content more effectivelyDeliver CS2/CS7 course content more effectively Long term goal Long term goal Understand thought process of CS2/CS7 studentUnderstand thought process of CS2/CS7 student Early identification of students at riskEarly identification of students at risk

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 37 MessageGrid Replay Ink

Problem Specifications October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Sample Ink Solutions October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Sample Ink Solutions All submissions attributed October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Sample Ink Solutions All submissions date/time stamped October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Student Submissions October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Replaying Student Ink Demo Demo 1. Expression tree (correct) Expression tree (correct) Expression tree (correct) 2. Expression tree (incorrect) Expression tree (incorrect) Expression tree (incorrect) 3. Gallivanting AVL Gallivanting AVL Gallivanting AVL Tagging Tagging Analysis Analysis October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Student Evaluation October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO Feedback generally positive on MG Feedback generally positive on MG 1. Students like immediate feedback 2. Pinpointing mistakes helpful 3. Anonymous evaluation of student submissions Tagging has begun (SIGCSE 2010) Tagging has begun (SIGCSE 2010) Analysis of tags has begin Analysis of tags has begin

Four Current Projects

Algebra and Calculus October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 1.Transitioning through Technology: Using Digital Learning Environments in Calculus as a Collaborative Model to Advance STEM Students through Four-year Institutions, (with Marilyn Reba, Calvin Williams), 2009 Hewlett-Packard Innovations in Education Grant 2.Mathematics Partnering with Computer Science to Improve Calculus Instruction and Learning, (with Calvin L. Williams, Marilyn Reba, National Science Foundation CCLI Type 2 (2008 NSF CCLI-2) 3.Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS), (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 47 1.CU Thinking, (with Lisa C. Benson, David Bowman, Michelle P. Cook), National Science Foundation Innovations in Engineering Education Curriculum, and Infrastructure (NSF IEECI) 2.Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS), (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant Freshman Engineering

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 48 1.OrganicPad: A Tablet PC-Based Interactivity Tool for Organic Chemistry, (with Melanie M. Cooper and Calvin L. Williams), National Science Foundation Alternative Learning Technologies (NSF ALT). 2.OrganicPad: A Tablet PC-Based Interactivity Tool for Teaching Chemistry, Camille and Henry Dreyfus Foundation 2009 Special Grant Program in the Chemical Science, (with Melanie M. Cooper). Organic Chemistry

Generic Tools: Nursing, English, Psychology, etc. October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO 1."Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS), (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant 2.Development of a Targeted Tablet PC Software Development Course, 2004 Microsoft Research Tablet PC and Computing Curriculum Grant 3.Development of a Network Applications Course Using Microsoft.NET, SQL Server, and IIS, 2003 Microsoft Curriculum and Content Development Grant

Current / Future Work Fall 2009, Spring 2010 Fall 2009, Spring 2010 Tagging existing student submissionsTagging existing student submissions Collecting and tagging additional solutionsCollecting and tagging additional solutions Analysis of tagsAnalysis of tags Summer 2010 Summer 2010 Continuing analysis of tagsContinuing analysis of tags Fall 2010 Fall 2010 Reports, reports, reports!Reports, reports, reports! October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Thank You for Your Kind Attention! Go Falcons! October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Where is Clemson University? Clemson University Clemson, South Carolina October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO US Air Force Academy Colorado Springs, CO

Extra Slides

October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

October 15, Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO