1. Richard Anderson Department of Computer Science and Engineering University of Washington Dec 15, 2008Microsoft Learning1

2. How can computing technology enhance education? – Focus on classroom instruction Challenges: – Extending reach of education – Increasing interaction – Addressing problems of scale – Facilitating expression of ideas Dec 15, 2008Microsoft Learning2

3. Dec 15, 2008Microsoft Learning3 Video conferenced distance education UW PMP DISC ConferenceXP Center for Collaborative Technologies Presentation systems Classroom Presenter 2.0 Classroom Presenter 3.0 Classroom interaction systems Classroom Feedback System CATs for CS1 Structured Interaction Presentations (SIP) Student submissions with CP Tutored Video Instruction UW CC TVI Project Beihang TVI project Digital StudyHall

4. Deployment driven – Classroom use – Technology development and promotion Goals and success criteria – Adoption of technology and methodology – Influence educational practice Target specific deployments – Innovate in some aspect of deployment Dec 15, 2008Microsoft Learning4

5.  Distance Learning and Video Conferenced Classes  Tutored Video Instruction  Digital Study Hall  Educational Technology for Low Resource Environments Dec 15, 2008Microsoft Learning5

6. Multi-site internet based audio-video conferencing UW Master’s Program – Site-to-site courses between UW and Microsoft since Winter 1997 – www.cs.washington.edu/education/dl/course_index.html www.cs.washington.edu/education/dl/course_index.html – Master’s level courses – Goal: interaction across sites Approximate single classroom – Various technologies have been used since the program was introduced Dec 15, 2008Microsoft Learning6

7. Dec 15, 2008Microsoft Learning7

8. Dec 15, 2008Microsoft Learning8

9. Initial phase Winter 1997 – Winter 2002 – Polycom + Netmeeting for PPT and SmartBoard MSR DISC Project – Target: UW, CMU, UCB, Brown graduate class – Spring 2002 ConferenceXP – Since Spring 2003 – Four way courses, Autumn 2004, Autumn 2005, Autumn 2006 UW, MSR, UCB, UCSD Dec 15, 2008Microsoft Learning9

10. High quality, low latency video to support interactive classes High bandwidth internet video conferencing – Internet2 – Multicast Single machine deployment – High end PC – Performance limit: handling multiple high resolutions video streams Innovative presentation tools Dec 15, 2008Microsoft Learning10

11. What went wrong – Technology and systems failures – Multicast networking – High cost of interruptions – Audio – Loss of trust – Room configuration issues – Lack of control of lecture room – Production quality Meta lesson – Learn more from failures than from successes How to Fail at VideoConferenced Teaching – Microsoft Faculty Summit 2002 – Anderson & Beavers Dec 15, 2008Microsoft Learning11

12.  Goals  Real time interaction between sites  High quality video  Challenges  High bandwidth connections ▪ Multicast vs. Unicast  Classroom Audio  Establishing a pattern of interaction Dec 15, 2008Microsoft Learning12

13.  March 29, 2008, LACCIR Meeting  Latin American and Carribbean Collaboration for ICT Research  Seattle and University of Chile, Santiago, Chile  Seminar presentation  October 15, 2008  CXP Unicast reflector Dec 15, 2008Microsoft Learning13

14.  Masters class  University of Washington  Lahore University of Management Science  Microsoft  Computing for the Developing world Dec 15, 2008Microsoft Learning14

15.  Ensuring adequate bandwidth  Limited bandwidth to Pakistan  Reliability  Multicast  Ensuring this did not compromise UW-MS class  Limited time to prepare Dec 15, 2008Microsoft Learning15

16. Dec 15, 2008Microsoft Learning16 PMP VENUE Archiver Video cameras Audio Video Displays Speakers Video cameras Audio Video Displays Speakers CP3 Instructor CP3 Display CP3 Display Student Tablets UWMicrosoft CXP CP3

17. Dec 15, 2008Microsoft Learning17 PMP Venue 1 PMP Venue 2 Archiver MicrosoftLUMS UW CP3 Server CP3

18.  Tablet PC based presentation and classroom interaction system  Ink based presentation  Classroom Activites Dec 15, 2008Microsoft Learning18

19. Dec 15, 2008Microsoft Learning19 Student Instructor Public Display

20. Dec 15, 2008Microsoft Learning20

21.  High connectivity for 9 out of 10 classes  One lecture originated from Pakistan  Only failure was on the UW-Microsoft Link (which also brought down UW-Pakistan)  Improved audio (microphone issues)  Participation of students from Pakistan  Student submissions  Questions and discussions  Multiple rounds of audio communication Dec 15, 2008Microsoft Learning21

22.  Participants must have incentive for a distance course  Instructor need to make an effort to create multisite interaction  Active participants at remote sites help  Time zones and scheduling are major issues Dec 15, 2008Microsoft Learning22

23. Video recorded lectures shown with facilitator – Original model: lectures stopped by students for discussion – Peer tutors Developed by Jim Gibbons at Stanford University Positive results reported in Science [1977] Dec 15, 2008Microsoft Learning23

24.  Introductory programming  Address community college articulation  Experiment with alternate approaches to introductory computing instruction  UW – Beihang Algorithms course  Offering of UW Algorithms course in China  Digital StudyHall  Primary education in rural India Dec 15, 2008Microsoft Learning24

25.  Recorded lecture materials  Generally based on live classes  Class model  Lecture playback alternating with facilitator led discussion  Facilitation models ▪ Gibbons: Peer instruction ▪ Active facilitation Dec 15, 2008Microsoft Learning25

26.  Offer a course in Beijing based on UW course  UW instructor could not teach the course in China  Scheduling prevented a live course offering  1:30 pm in Seattle is 4:30 am in Beijing  Materials captured from live class  Tutored Video Instruction  Slides, talking head, digital ink Dec 15, 2008Microsoft Learning26

27.  Set up visit  Met with Teaching Assistants  Tested all technology  Trained Teaching Assistants in facilitation  Gave classes to students to demonstrate technology and TVI  Midterm visit  Observed classes  Gave lecture without recorded video  Regular communication with Teaching Assistants  Data collection Dec 15, 2008Microsoft Learning27

28.  Applications displayed  Webviewer for video replay  Classroom Presenter  Teaching Assistants would show video or show CP for inking on slides or classroom interaction Dec 15, 2008Microsoft Learning28

29.  Offering successful  Technology, institutional relationship  Cross-cultural issues  English language materials were comprehensible  Classroom discussion primarily in Chinese  Facilitation model  Significant support for facilitators  Classroom activities successful (and popular)  Facilitators innovative and reproduced some of the instruction  Interactive and informal classroom atmosphere Dec 15, 2008Microsoft Learning29

30.  Lectures delivered in English  Language exposure consider to be a positive side effect of the course  Teaching assistants facilitated in English  But discussions were generally in Chinese  Students reported using lectures outside of class  Instructor observations from site visit  Chinese students had substantially more English listening than speaking experience  Recorded lectures did contain some colloquial usage and cultural specific references which were lost Dec 15, 2008Microsoft Learning30

31.  Support provided for facilitators  Lecture notes  Activities  Facilitators invested a larger effort in preparation  Studying videos  Planning how to cover content  Active facilitation  Worked through lecture examples  Led activities  Asked questions to students  Example: facilitators working through example from lecture slides Dec 15, 2008Microsoft Learning31 InstructorFacilitator A Facilitator CFacilitator B

32.  Tablet PC supported activities  Student submission model  Used for every lecture  Technology generally successful  Considered very positive by students  High rate of participation  Provided a structure for active learning Dec 15, 2008Microsoft Learning32

33.  Contrast to traditional large lecture class  Highly interactive class  Interaction episodes measured by observation logs and videos of Beihang classes  Average of 13 interaction episodes per class, 10 with students speaking  UW class averaged about 20 interaction episodes per equivalent length of time  Beihang episodes averaged a greater number of rounds of communication  Class atmosphere was informal Dec 15, 2008Microsoft Learning33

34. Offering successful – Technology, institutional relationship Cross-cultural issues – English language materials were comprehensible – Classroom discussion primarily in Chinese Facilitation model – Significant support for facilitators – Classroom activities successful (and popular) – Facilitators innovative and reproduced some of the instruction – Interactive and informal classroom atmosphere Dec 15, 2008Microsoft Learning34

35. Affiliated Project Collaboration with Randy Wang in Lucknow Tutored Video Instruction for primary education in rural India YouTube + Netflix Dec 15, 2008Microsoft Learning35

36.  A people’s database  Mediation based pedagogy  Hub and spoke model  Content distribution by DVD Dec 15, 2008Microsoft Learning36

37. Operational hubs in Lucknow, Calcutta, Pune, and Bangladesh Each hub works with a number of poor village or slum schools Dec 15, 2008Microsoft Learning37

38.  Classroom study starts July 2009  Two year study  12 schools in Uttar Pradesh  12 DSH Classrooms  12 Traditional Classrooms  Evaluate Learning gains through pretest/posttest  Classroom observations  Study impact on teachers Dec 15, 2008Microsoft Learning38

39. Value of electronic materials in the process of classroom instruction Tools for teaching – Teacher and students drive the process – Flexible and unpredictable use Importance of high reliability – And attention to address issues Broader context – interplay of technology and other issues Dec 15, 2008Microsoft Learning39

40.  Facilitated Video Instruction  Biggest opportunity to enhance expertise  Synchronous Distance  Limited applications – but some specific cases of interest  Classroom capture  Classroom Computing  Computer lab and individual devices  Computing Education  Lack of technical literacy is a limiting factor Dec 15, 2008Microsoft Learning40

41.  Recorded video with a facilitator  Take advantage of expertise  Facilitator has very important role  Applicable to a broad range of educational domains  Primary and secondary  Health  Agriculture  Vocational  College Dec 15, 2008Microsoft Learning41

42.  Applicability for low resource environments  Low cost ▪ Replay (TV + DVD) ▪ Digital Video + PC based editing  Locally created content  Key components  Facilitation methodology  Support for facilitator  Program structure ▪ Content creation through delivery  Technology  Video production tool chain  Content distribution  Delivery  Feedback and monitoring Dec 15, 2008Microsoft Learning42

43.  Bandwidth is a significant issue  Low bandwidth + high cost  May be relevant for institutional outreach programs  Arvind Eye Hospital, Tamil Nadu, India  International medical education  Positive side effect: classroom capture  Risk: Driven by need to justify infrastructure – not for educational needs Dec 15, 2008Microsoft Learning43

44.  School based computing  Risk: deployments leading educational goals  Challenge: maximize benefits of “computers for schools initiatives”  Models  Low cost educational devices ▪ Classmate, OLPC, Asus eee, …  Shared use ▪ Multipoint  School server Dec 15, 2008Microsoft Learning44

45.  Shortage of trained professionals  Hostile Computing Ecosystem  Very high virus infection  Poorly administered machines  Solutions ▪ Computing practices and maintenance Dec 15, 2008Microsoft Learning45

46. Richard Anderson – anderson@cs.washington.edu anderson@cs.washington.edu Classroom Presenter – http://www.cs.washington.edu/education/dl/presenter/ http://www.cs.washington.edu/education/dl/presenter/ Center for Collaborative Technologies at UW – http://cct.cs.washington.edu/ http://cct.cs.washington.edu/ Digital StudyHall – http://dsh.cs.washington.edu/ http://dsh.cs.washington.edu/ Dec 15, 2008Microsoft Learning46

47. Support from Microsoft Research, National Science Foundation, HP, Ford, UW CSE Jay Beavers, Jane Prey, Randy Hinrichs, Chris Moffatt, Jason Van Eaton, Paul Oka, Steve Wolfman, Ken Yasuhara, Andrew Whitaker, Ruth Anderson, Craig Prince, Valentin Razmov, Natalie Linnell, Krista Davis, Jonathon Su, Sara Su, Peter Davis, Tammy VanDeGrift, Joe Tront, Alon Halevy, Gaetano Borriello, Ed Lazowska, Hal Perkins, Susan Eggers, Fred Videon, Rod Prieto, Oliver Chung, Crystal Hoyer, Beth Simon, Eitan Feinberg, Julia Schwarz, Jim Fridley, Tom Hinkley, Ning Li, Jing Li, Luo Jie, Jiangfeng Chen, Melody Kadenko, Julie Svendsen, Shannon Gillmore Dec 15, 2008Microsoft Learning47