1. History of HCI Adapted from a talk by Jonathan Grudin (jgrudin@microsoft.com)jgrudin@microsoft.com Lecture #13 - April 21 st, 2009 213: User Interface Design and Development

2. Is HCI a Discipline? Dedicated conferences, journals and associations emerged in 70s and 80s Hasn’t coalesced as a coherent discipline Includes researchers from CS, ISchools, Human Factors and Ergonomics, Information Systems, Cognitive Science, Psychology, Sociology, Industrial Engineering, Design, Art, etc.

3. “In the beginning the computer was so costly that it had to be kept gainfully occupied for every second; people were almost slaves to feed it.” -- Brian Shackel

5. Early Computing Jobs 1)Operation 2)Management 3)Programming

6. Human Factors & Ergonomics HF&E originated after WWI / WWII, for studying performance of fighter pilots Operators were first hands-on users Research was on reducing training time, improving efficiency, and reducing the number of errors –Improving the design of console buttons, switches, displays, …

7. “The computer industry will be forced to become increasingly concerned with the usage of people, rather then with the computer’s intestines.” -- James Martin Design of Man-Computer Dialogues (1973)

8. Information Systems Increased affordability of mainframes (and later mini/micro-computers), led to business use of computers Emergence of Information Systems, within schools of Management, focused on improving management decision-making HCI was one of early research themes

10. Computer-Human Interaction With the emergence of IBM PC in the early 1980s, computers began to be used by ordinary people, and not as part of their jobs Many initial users were programmers Early researchers had a background in Cognitive Psychology (including Card, Moran, Newell, Norman and others)

11. “It’s not enough just to establish what people can and cannot do; we need to spend just as much effort establishing what people can and want to do” -- Smith & Green Human Interaction with Computers (1980)

12. Hardware Platforms and HCI Research Fields 195519651975198519952005 SIZE, COST, ETC. Office Systems MINICOMPUTERS Cabinet EMBEDDED Invisible VACUUM TUBES Human Factors and Ergonomics Barn MAINFRAMES Room (Management) Information Systems Palm HANDHELD Ubicomp Computer-Human Interaction (CHI) MICROCOMPUTERS Desk

13. Early HCI Research 1)Operation - HF&E 2)Management - IS 3)Programming - CHI

14. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry WWII human factors Focus on non-discretionary use Shackel “In the beginning, the computer was so costly that it had to be kept gainfully occupied for every second; people were almost slaves to feed it.” – Brian Shackel 1915 1985 19451955 1965 1975 199520051905 IJMMS BIT “Human factors was the discipline we were trying to improve.” – Stu Card

15. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use WWII human factors Focus on non-discretionary use Shackel HCI, one of five major IS research streams since 1967. – Banker & Kaufmann 1915 1985 19451955 1965 1975 199520051905 TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics IJMMS BIT

16. Focus on discretionary use Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCs Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction Discretionary hands-on use WWII human factors Focus on non-discretionary use Shackel 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics “It’s not enough just to establish what non-specialist people can and cannot do; we need to spend just as much effort establishing what people can and want to do.” – Smith & Green, 1980 POET DUX Emotional design CSCW Ecommerce DIS SIGCHI IJMMS BIT TOCHI HCI Smith & Green

17. Focus on discretionary use Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction & Antecedents Discretionary hands-on use WWII human factors Focus on non-discretionary use “Freeing mathematicians to do mathematics.” – Grace Hopper Shackel 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 “Text editors are the white rats of HCI.” – Thomas Green TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics Computer- Human Interaction Computer- Programmer Interaction Computer- Engineer Interaction PARC Software psychology Hopper IJMMS BIT

18. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES HPM Psych. of HCI HUSAT General- purpose computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction & antecedents Discretionary hands-on use WWII human factors Focus on non-discretionary useFocus on discretionary use Shackel Nelson Engelbart Sutherland Licklider Kay Bush Transistor computers 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics Visionary Writers & Prototype Builders HFES CEDM Computer- Human Interaction IJMMS BIT

19. Visionary: Vannevar Bush Professor and national science advisor - wrote As We May Think in 1945 Described the hypothetical Memex device, based on microfilm, that could be used to store, access, link, share and contribute to a global knowledge base Inspiration for Hypermedia, and the modern WWW

20. Visionary: Ivan Sutherland Sutherland’s PhD thesis, Sketchpad, was a pioneering work in graphics and HCI In 1963, this was one of the first GUI applications, using a light pen to create and edit interactive drawings Inspired Windows, Icons, GUI, Object- Oriented Programming, CAD, etc. http://youtube.com/watch?v=USyoT_Ha_bA http://youtube.com/watch?v=BKM3CmRqK2o

21. Visionary: Douglas Engelbart Engelbart’s revolutionary 1968 demo (the mother of all demos) demonstrated the computer mouse, integrated text, graphics and video; real-time video conferencing, windowing, and the ancestors of email and word processing http://www.youtube.com/view_play_list?p=341 5B231F8D760C2

23. Visionary: Alan Kay Advised by Sutherland at the University of Utah, and later working at Xerox PARC, Alan Kay worked on the first GUI with overlapping windows, and developed the Smalltalk object- oriented programming language His vision for the Dynabook (1968) presaged modern laptop and tablet computers

25. Visionary: Ted Nelson Sociologist and philosopher who invented the idea of hypertext in 1963 Project Xanadu’s initial goal was to support “non-sequential writing”, where readers could choose their own path through a literary work; later expanded to an interconnected network of digital objects Many of these ideas were realized (incompletely, according to Nelson) in Tim Berners-Lee’s WWW

26. HUSAT and Xerox PARC Two pioneering labs working on HCI, both founded in 1970 HUSAT, based in the UK, focused on human factors and ergonomics PARC, based in the US, focused on new hardware, programming languages and environments –Integrated the mouse, GUI, Ethernet, laser printing, object-oriented programming, and many other innovations in the Xerox Alto, which was the first modern PC (and the inspiration for the Macintosh)

27. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT TAM style Cognitive GDSSs Ackoff Nelson Bush Kay PARC Software psychology POET SIGCHI DISDUX Emotional design General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction & antecedents Discretionary hands-on use WWII human factors SIGHCI Focus on non-discretionary use Hopper Focus on discretionary use Shackel Engelbart Sutherland Licklider 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 CSCW Sociotech & Participatory Business graphics IJMMS BIT TOCHI HCI

28. Discretion in Computer Use Computing jobs exist somewhere along a continuum between forced, repetitive tasks; and empowered, creative individuals In 1979, John Bennett predicted that more discretionary use would lead to more concern for usability (and, as a result, for subjective metrics)

29. Early HCI Research 1)Operation - HF&E Non-discretionary, hands-on 2)Management - IS Discretionary, hands-off 3)Programming - CHI Discretionary, hands-on

30. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use WWII human factors Journal-oriented fieldConference-oriented field 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 TAM GDSSs Ackoff SIGHCI Business graphics Nelson Bush Kay PARC POET SIGCHI DISDUX Emotional design Computer-Human Interaction & antecedents Discretionary hands-on use CSCW HFES CEDM Hopper Shackel Engelbart Sutherland Licklider style Cognitive Software psychology Sociotech & Participatory IJMMS BIT TOCHI HCI

31. Journals vs. Conferences Most scientific disciplines use conferences for works in progress, and journals for finished work HF&E and IS follow this tradition CS (and HCI) researchers submit their best work to conferences, and rarely submit to journals As a result, CS researchers think HF and IS conferences are poor quality, and HF and IS researchers have difficulty getting their work into CHI

32. Early CHI Conferences 1976 - User-Oriented Design of Interactive Graphic Systems (UODIGS) - SIGGRAPH 1981 - Joint Conference on Easier and More Productive Use of Computer Systems - SIGSOC 1982 or 1983 - First Conference on Human Factors in Computing Systems - SIGCHI (renamed from SIGSOC)

33. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES CEDM HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCs Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction & antecedents Discretionary hands-on use WWII human factors Pre-60’s man-machine culturePost-60’s human-computer culture Shackel 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 Ecommerce TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics Nelson Bush Kay PARC Software psychology POET SIGCHI DISDUX Emotional design Hopper Engelbart Sutherland Licklider CSCW IJMMS BIT TOCHI HCI

34. Culture: HF&E and IS Operator - a hands-on computer user Task Analysis - organizational decomposition of work Implementation - deployment of a system within an organization Man-machine interface Focus on expert, skilled use Overall goal is Automation Funded by government, military

35. Culture: CHI User - a hands-on computer user Task Analysis - cognitive decomposition of a task Implementation - a programmed software artifact Human-computer interface Focus on novice, initial use Overall goal is Augmentation Funded by software companies

36. “[W]e use the same methods, we study the same things, but we do it to get new ideas, and they do it to improve what already exists.” -- Edie Adams speaking from the CHI perspective

37. Human Factors Smith & Mosier TaylorWWI training HFS CSTG HFES HPM Psych. of HCI HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use WWII human factors Shackel 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 TAM style Cognitive GDSSs Ackoff SIGHCI Sociotech & Participatory Business graphics Nelson Bush Kay PARC POET Software psychology SIGCHI Computer-Human Interaction & antecedents Discretionary hands-on use Hopper Engelbart Sutherland Licklider CSCW HFES CEDM IJMMS BIT TOCHI HCI DISDUX Emotional design Design

38. CS and HCI Post-Mac, CHI began focusing on GUIs –Needed programmers (CS researchers) to explore the design space –More emphasis on quick-and-dirty lab studies, and qualitative methods –Assimilated history of CS visionaries Cognitive approaches (KLM, GOMS, etc.), focused on expert use, eventually merged back with HF&E CHI became user-centered, iterative, prototype-based design (Gould and Lewis, 1983)

39. $10M $1M $100K $10K $1K $100 195519651975198519952005 TX-2 PDP 1, 7 Alto Mac GUI-capable machine Approximate costs are in 2006 US$ Computer Graphics & HCI

40. $10M $1M $100K $10K $1K $100 195519651975198519952005 TX-2 PDP 1, 7 Alto Mac GUI-capable machine Graphics research community Graphics focused on realism Graphics focused on interaction Approximate costs are in 2006 US$ SG Iris Computer Graphics & HCI

41. $10M $1M $100K $10K $1K $100 195519651975198519952005 TX-2 PDP 1, 7 Alto Altair PC Mac GUI-capable machine Graphics research community Graphics focused on realism Graphics focused on interaction Human-computer interaction Approximate costs are in 2006 US$ SG Iris Lisa Star Computer Graphics & HCI

42. Smith & Mosier TaylorWWI training HFS CSTG HUSAT General- purpose computers Transistor computers MainframesPCsEcommerce Human Factors & Ergonomics Operation & data entry HCI in Information Systems Managerial use Computer-Human Interaction & antecedents Discretionary hands-on use WWII human factors Engineering Psychology 1915 1985 19451955 1965 1975 199520051905 1915 1985 19451955 1965 1975 199520051905 HFES HPM Industrial & Organizational Psychology Psych. of HCI Human Factors style Cognitive GDSSs Ackoff Sociotech & Participatory Business graphics TAM SIGHCI Nelson Bush Kay PARC POET SIGCHI DISDUX Emotional design Hopper CSCW Cognitive Psychology Social Psychology Engelbart Sutherland Licklider Shackel Software psychology HFES CEDM IJMMS BIT TOCHI HCI

43. Impact of Hardware Changes Hardware R&D Software R&D User Interface R&D Consumer Behavior Organizational & Institutional Behavior 1970s1985 2000 2015?

44. Current Status Human Factors & Ergonomics –Adopted many of the cognitive modeling approaches from early CHI research –No revolutionary breakthroughs Information Systems –Subsumed by other management disciplines –Aligning closer to CS / CHI Computer-Human Interaction –Still on the fringes of Computer Science –Are I-Schools the future?

45. For Next Time Guest lecture by Google team! Come prepared with questions… Continue working on the Final Project!