1. A Study of Digital Ink in Lecture Presentation Richard J. Anderson *, Ruth Anderson *†, Crystal Hoyer *, and Steven A. Wolfman *‡ * U. Washington, † U. Virginia, ‡ U. British Columbia Steve Wolfman presenting http://www.cs.washington.edu/research/edtech/

2.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation2 Outline Background & Motivation Study Attentional Marks & Hand Gestures Ephemerality & Persistence Conclusions & Future Directions

3.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation3 Distance & Large Class Studies Presenter Ink Study Classroom Feedback System Retro/Prospective Feedback Patterns Student Interaction Systems [ITiCSE ’04] [SIGCSE ’02, ITiCSE ’02 & ’03] [SIGCSE ’04] [CSCL ’03] [CHI ’03] Research History

4.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation4 Expected Use of Ink

5.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation5 Common Use of Ink

6.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation6 Outline Background & Motivation Study Attentional Marks & Hand Gestures Ephemerality & Persistence Conclusions & Future Directions

7.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation7 Ink Study Interpretive analysis [Erickson] of 3 courses: –Distance courses ( , A / V and ink archives) –“Slideware-style” –Experienced instructors LecturesTimeTopic Prof A.46 hrsCompilers Prof B.820 hrsAI Prof C.1023 hrsDatabases

8.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation8 Prevalence of Attentional Marks Segmented strokes from six hours of lecture into coherent episodes and coded into four categories: % of strokes% of episodes BCB+CBC Attentional495351777476 Diagram978888 Writing413840141615 Other121222

9.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation9 Outline Background & Motivation Study Attentional Marks & Hand Gestures Ephemerality & Persistence Conclusions & Future Directions

10.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation10 Understanding Attentional Marks Properties: –brief, simple markings –occur with speech –augment meaning of speech –ad hoc form Is there a linguistic context in which to understand these marks?

11.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation11 Spontaneous Hand Gestures Spontaneous Hand gestures [McNeill]: –are synchronous w/speech –are co-expressive w/speech –lack standard of form Attentional marks share these properties.

12.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation12 Gesture Types: Iconic

13.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation13 Gesture Types: Deictic & Cohesive

14.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation14 Outline Background & Motivation Study Attentional Marks & Hand Gestures Ephemerality & Persistence Conclusions & Future Directions

15.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation15 Persistent Representation vs. Ephemeral Meaning

16.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation16 Persistent Representation vs. Ephemeral Meaning

17.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation17 Design Recommendations Separate strokes w/non-homogenous color Show co-occurrence/ordering w/age cues Show process w/incremental rendering

18.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation18 “Whiteboard” Effect [Prince]

19.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation19 Candy-Striping [Prince]

20.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation20 Conclusions Identified important ink use pattern: Attentional Marks Established gestural framework for understanding/analyzing Attentional Marks Demonstrated tension between ephemeral meaning and persistent representation Generated design recommendations to resolve tension Characterized instructors’ parsimonious use of UI features

21.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation21 Future Directions Alternate ink renderings Augmented transcripts –Keyframing –Deixis resolution for blind students Improved recognition –Auto-captioning –Link time/speech to slide locations Further analysis

22.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation22 URLs for More Info UW CS&E Education & Ed. Tech. Group: http://www.cs.washington.edu/research/edtech/ Classroom Presenter: http://www.cs.washington.edu/education/dl/presenter/

23.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation23 EXTRA SLIDES: NEW SURPRISING USE

24.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation24 Surprising Use of Attentional Marks (1 of 3)

25.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation25 Surprising Use of Attentional Marks (2 of 3)

26.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation26 Surprising Use of Attentional Marks (3 of 3)

27.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation27 EXTRA SLIDES: MOTIVATING PROBLEMS

28.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation28

29.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation29 “Sticky” Colors

30.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation30 “Feature Recovery” Problem

31.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation31 EXTRA SLIDES: GESTURE TYPES

32.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation32 Gesture Types: Metaphoric

33.  t Steve Wolfman A Study of Digital Ink in Lecture Presentation33 Gesture Types: Beats