1. Roger J. Chapman Multimodal Slide Shows as Asynchronous Presentation Reviews The University of Hawaii, at Hilo Computer Science Department

2. Roger Chapman ISECON, November 2nd 2001 2 Slide Shows Advantages: –Memory and structuring aid –Common view for instructors and students –Easily stored, edited, reused, and shared Disadvantages: –Can “fly through” slides –Can simply read the slides’ contents –Hardwired structure may breakdown during an interactive class

3. Roger Chapman ISECON, November 2nd 2001 3 Deictic Gesturing Instructors often talk through a slide making a series of linking deictic gestures –Pointing at something while speaking, to gesture “this”, “that” or “there”. –Increases efficiency and accuracy of the communication

4. Roger Chapman ISECON, November 2nd 2001 4 Multimodal Reviews Hardcopies of slide shows –help students follow the material covered during a class –help students review later in their own time Can more natural reviews be simply created when it is not necessary to capture a lot of software dynamics? How useful might that be?

5. Roger Chapman ISECON, November 2nd 2001 5 Other Systems Can add audio to PowerPoint presentations, but not pointing ScreenCam and HyperCam capture dynamics, but video files are large Compressed video on the Internet (e.g. RealPresenter) is becoming common, but still not always practical for dial-up students to stay online

6. Roger Chapman ISECON, November 2nd 2001 6 Research on Multimodal Communications Chapanis (1975) Bly (1988); Tang (1991) Oviatt (1999) Faraday and Sutcliffe (1997) Neuwirth et al. (1994) Daly-Jones et al. (1997) Bergeron et al. (1999, 2001)

7. Roger Chapman ISECON, November 2nd 2001 7 C-SLANT C-SLANT (Collaborative Slide Annotation Tool): Simple screen capturing Slide show structure for asynchronous messages Synchronized voice and mouse movement recording + other annotation tools 97% of the participants made deictic gestures Combined deictic gestures with other annotations markings Slide show structure needed overarching messaging structure

8. Roger Chapman ISECON, November 2nd 2001 8 Point ‘n’ Talk Simple Asynchronous Presentation System Synchronized Speech and Pointing over an image Play only mode for students Tested in a Data Structures and Program Design Class with 17 students

10. Roger Chapman ISECON, November 2nd 2001 10 Point ‘n’ Talk

11. Roger Chapman ISECON, November 2nd 2001 11 Authoring Issues Sometimes difficult to record in “one take” –Trying to be very succinct –Recording in “chunks” helped Didn’t always need to point –E.g. Talking about the entire slide as one topic –Sometimes mouse was moved into white space while not gesturing

12. Roger Chapman ISECON, November 2nd 2001 12 Online Survey Results

13. Roger Chapman ISECON, November 2nd 2001 13 Online Survey Results Things liked: –Synchronized speech and pointing (7) –Ease of use –Asynchronous “presence” Things disliked: –Download time –Unnecessary pointer movement (5) –Fixed size images

14. Roger Chapman ISECON, November 2nd 2001 14 Point ‘n’ Talk Enhancements A text window to help scripting and annotating a slide In addition to starting and stopping recording with mouse-commands or function keys: –Recording voice only, Record pointing only, Record voice and pointing modes Actual size and best-fit image display

15. Roger Chapman ISECON, November 2nd 2001 15 2001 SIGCSE Questionnaire Special Interest Group on Computer Science Education (SIGCSE) –58 instructors responded –“Do you ever use a slide show to structure material to be covered in your classes?” 46(79%): yes; 12(21%): no

16. Roger Chapman ISECON, November 2nd 2001 16 Slide Show Usage

17. Roger Chapman ISECON, November 2nd 2001 17 2001 SIGCSE Questionnaire –“Do students have access to the same set of slides?” 44(96%): yes; 2/46(4%) no –“Do you use annotated copies of your slides as part of your preparation for teaching your classes?” 20/43(47%): yes; 23(53%) no; (3 gave no answer)

18. Roger Chapman ISECON, November 2nd 2001 18 Conclusions A lot of slide show use Multimodal slide shows with deictic referencing over static images –Useful to review some material –Simple for instructors and students Popular with students Need to record to compact discs and/or use streaming technology