1

Plan : 1. Models of interaction 2. Types of interaction 3. Existing technologies 4. Advances in HCI 5. Architecture 2

1. MODELS OF INTERACTION terms of interaction Norman model interaction framework 3

1. MODELS OF INTERACTION Some terms of interaction: domain– the area of work under study. e.g. graphic design goal– what you want to achieve. e.g. create a solid red triangle task– how you go about doing it – ultimately in terms of operations or actions e.g. … select fill tool, click over triangle 4

1.MODELS OF INTERACTION: Donald Norman’s model Seven stages – user establishes the goal المستخدم يحدد الهدف : – formulates intention : يصوغ نية – specifies actions at interface : يحدد الإجراءات في واجهة – executes action : ينفذ العمل – perceives system state : يدرك حالة النظام – interprets system state : يفسر حالة النظام – evaluates system state with respect to goal : تقييم حالة النظام فيما يتعلق الهدف Norman’s model concentrates on user’s view of the interface 5

execution/evaluation loop user establishes the goal formulates intention specifies actions at interface executes action perceives system state interprets system state evaluates system state with respect to goal system evaluationexecution goal 1.MODELS OF INTERACTION: Donald Norman’s model 6

user establishes the goal formulates intention specifies actions at interface executes action perceives system state interprets system state evaluates system state with respect to goal system evaluationexecution goal execution/evaluation loop 1.MODELS OF INTERACTION: Donald Norman’s model 7

user establishes the goal formulates intention specifies actions at interface executes action perceives system state interprets system state evaluates system state with respect to goal system evaluationexecution goal execution/evaluation loop 1.MODELS OF INTERACTION: Donald Norman’s model 8

Human error - slips and mistakes 1.MODELS OF INTERACTION: Donald Norman’s model Slip: understand system and goal. correct formulation of action. incorrect action. Mistake: may not even have right goal! 9

Abowd and Beale framework 1.MODELS OF INTERACTION: Interaction framework The interaction framework has 4 parts – user – input – system – Output Each has its own unique language interaction  translation between languages problems in interaction = problems in translation S core U task O output I input 10

Abowd and Beale framework 1.MODELS OF INTERACTION: Interaction framework user intentions:  translated into actions at the interface : تترجم إلى أفعال في الواجهة  translated into alterations of system state : تترجم إلى تغيرات في حالة النظام  reflected in the output display: تنعكس في عرض الإخراج  interpreted by the user : تفسر من قبل المستخدم 11

2. TYPES OF INTERFACES  Command Line Interface (CLI)  Menu Driven Interface (MDI)  Graphical User Interface (GUI)  Natural Language Interface (NLI) 12

2. TYPES OF INTERFACES A. Command Line Interface : A CLI displays a prompt, the user types a command on the keyboard, the computer executes the command and provides textual output. Advantages: Very flexible with the use of “switches” (options) Good for expert users, can quickly access commands Uses the fewest system resources Disadvantages: Require the user to learn complex commands or languages Not very good for novice users 13

2. TYPES OF INTERFACES B. Menu Driven Interface : The user has a list of items to choose from, and can make selections by highlighting one. Advantages: No need to learn complex commands/languages Easier for a novice to learn/use Ideal when there are a limited number of options (efficient) Disadvantages: Can be frustrating for experienced users User interface may be limited by screen space and number of options available 14

2. TYPES OF INTERFACES C. Graphical User Interface : The GUI uses windows, icons, menus and pointers (WIMP) which can be manipulated by a mouse (and often to an extent by a keyboard as well) Advantages: Most suitable interface for inexperienced or novice users Many genetic packages for a GUI will share common features Disadvantages: GUI’s use more system resources than other types of interface 15

2. TYPES OF INTERFACES D. Natural Language Interface : Can range from simple command systems to voice activated text processing. Commands are spoken in “normal ” language. Advantages: No training required Can be quicker than keyboard entry Hands-free / can be used by the disabled Disadvantages: Emerging technology- still contain “bugs” Difficulty in dealing with homonyms Artificial languages are often more precise 16

3. EXISTING TECHNOLOGY The existing interfaces differ in the degree of complexity both because of degree of functionality or usability. The user activity has three different levels:  Physical  Cognitive  Affective The existing physical technologies for HCI basically can be categorized by human senses. 17

4. ADVANCES IN HCI The new advances in HCI can be categorized in 3 sections: Wearable devices, wireless devices and virtual devices. Recent advances of research in HCI are in these areas:  Intelligent and adaptive interfaces  Ubiquitous computing (ubicomp) These interfaces involve different levels of user activity. 18

4. ADVANCES IN HCI  Intelligent and adaptive interface: Its are interfaces that incorporate at least some kind of intelligence in perception from and/or response to users. Ex: speech enabled interfaces that use natural language to interact with users and devices. Adaptive HCI design, on the other hand, may not use intelligence in the creation of interface but use it to interact with users. Ex: a web site using regular GUI for selling various products 19

4. ADVANCES IN HCI Intelligent and adaptive interfaces are active interfaces. Non-intelligent interfaces are passive in nature. Tablet PC is an example that uses both intelligent and adaptive interfaces and it has handwriting recognition ability. 20

4. ADVANCES IN HCI  Ubiquitous Computing: The idea of ubiquitous computing was to embed computers every where in the environment and every day objects so that people could interact with many computers. 21

5. ARCHITECTURE Architecture of any HCI systems is identified by:  Number of inputs and outputs in the system  Diversity of inputs and outputs in term of modality  Working of these diverse input and output for interaction purpose Based on different configuration and design of interface, HCI systems can be divided into:  Unimodal HCI system  Multimodal HCI system 22

5. ARCHITECTURE  Unimodal HCI system: A system that is based on only one modality is called unimodal. Based on the nature of different modalities, they can be divided into three categories:  Audio-based  Sensor-based  Visual-based 23

5. ARCHITECTURE  Unimodal HCI system: Audio-based HCI: It deals with information acquired by different audio signals. The information gathered from audio signals can be more trustable and helpful. Key components: Microphone. ASR (automated speech recognition) and NLU (natural language understanding) software. 24

5. ARCHITECTURE The main research areas of audio based HCI are divided into:  Speech recognition  Speaker recognition  Auditory emotion analysis  Human-made noise/sign detections  Musical interaction 25

5. ARCHITECTURE  Unimodal HCI system: Sensor-based HCI: It has the wide range of applications in our day-to-day life. The common feature in every application is that at least one physical sensor is used between machine and human to provide interaction. Some of the sensors range from being very sophisticated primtive:  Pen-based interaction  Motion tracking sensors  Haptic sensors  Pressure sensors 26

5. ARCHITECTURE  Unimodal HCI system: Visual-based HCI: It is also called as machine vision which is the observation of an environment using cameras. In this, different aspects of human responses can be recognized visual signals. The main research areas of visual based HCI are:  Facial Expression Analysis  Body movement tracking and gesture recognition  Gaze detection 27

5. ARCHITECTURE  Limitations of Unimodal HCI:  Not a natural way of human interaction  Usually designed for the average user  Failes to cater to the needs of a diverse category of people.  Difficult to use by disabled, illiterate and untrained people  Cannot provide universal interface 28

5. ARCHITECTURE  Multimodal HCI system: Combination of multiple modalities, or usage of more than one independent channel signals for the interaction between a user and a machine is termed as multimodal human computer interaction system. A multimodal interface acts as a facilitator of human computer interaction via two or more modes of input. It is easy to use by disabled, illiterate people. 29

5. ARCHITECTURE  Applications:  Intelligent homes/offices  Driver monitoring  Intelligent games  E-commerce  Helping people with disabilities 30

5. ARCHITECTURE  Applications: Helping people with disabilities : A good application of multimodal systems is to address and assist disabled people. In this system users can interact with machine using voice and head movements. Two modalities are used and both are active continuously : speech and head movements. Speech provides the needed information about the meaning of the action that must be performed with an object selected by the cursor. The head position indicates the coordinates of the cursor on the screen at the current moment. 31