Dialog Design - Gesture & Pen Interfaces, Mobile Devices CS / Psych 6750 1 This material has been developed by Georgia Tech HCI faculty, and continues.

Slides:

Advertisements

Similar presentations

In put Devices and Media In order for a computer to do anything it must be told what to do.

Advertisements

Design of Everyday Things Chapter One

Chapter 5 p. 6 What Is Input? What is input? p. 230 and 232 Fig. 5-1 Next  Input device is any hardware component used to enter data.

1 Icon Design This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Diane.

DESCRIBING INPUT DEVICES

Chapter 5 Input and Output. What Is Input? What is input? p. 166 Fig. 5-1 Next  Input device is any hardware component used to enter data or instructions.

1 HCI History Key people, events, ideas and paradigm shifts This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors.

1 HCI History Key people, events, ideas and paradigm shifts This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors.

1 HCI History Key people, events, ideas and paradigm shifts This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors.

1 HCI History Key people, events, ideas and paradigm shifts This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors.

1 HCI History Key people, events, ideas and paradigm shifts This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors.

Dialogue Design Speech, pen, and gestures Speech Output  Tradeoffs in speed, naturalness and understandability  Male or female voice? Technical issues.

Interaction – Speech and Pen Natural input Universal design Take advantage of familiarity, existing knowledge Alternative input & output Multi-modal.

This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Diane Gromala, Elizabeth.

Dialog Design Speech/Natural Language Pen & Gesture.

This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Diane Gromala, Elizabeth.

Dialog Design - Gesture & Pen Interfaces, Mobile Devices IAT This material has been developed by Georgia Tech HCI faculty, and continues to evolve.

Dialog design How do we communicate with computers?

Requirements Gathering & Task Analysis – Part 1 of 5 Why, What and How – an Overview This material has been developed by Georgia Tech HCI faculty, and.

1 of 6 This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS DOCUMENT. © 2007 Microsoft Corporation.

Lesson Objectives To understand that users with disabilities require different input and output devices To be able to identify these devices and explain.

1 Introduction to Computers Day 2. 2 Input Devices Input devices are used to feed data and instructions to the computer systems.They consist of a range.

CHAPTER 2 Input & Output Prepared by: Mrs.sara salih 1.

1 CGS1060 Mobile UIs Copyright 2012 by Janson Industries.

Handwriting Tools Copyright 2006 South-Western/Thomson Learning.

Basic Technology Components Review Keyboarding

Input devices are hardware components that enable users to interact with a computer. Without input devices, you would not be able to feed instructions.

Design of Handheld Devices

Chapter 5 Input. What Is Input? What are the input devices? Input device is any hardware component used to enter data or instructions Data or instructions.

Ch 26 & 27 User Interfaces.

Excellence Publication Co. Ltd. Volume Volume 1.

11.10 Human Computer Interface www. ICT-Teacher.com.

PDAs Opening Programs and Entering Data Copyright 2006 South-Western/Thomson Learning.

Interaction Gavin Sim HCI Lecture /111. Aims of this lecture Last week focused on persona and scenario creation. This weeks aims are: ◦ To introduce.

Input Devices. What is Input?  Everything we tell the computer is Input.

Lesson 8 Keyboarding Unit 2—Using the Computer. Computer Concepts BASICS - 2 Objectives Define keyboarding. Identify the parts of the standard keyboard.

Unit 1_9 Human Computer Interface. Why have an Interface? The user needs to issue instructions Problem diagnosis The Computer needs to tell the user what.

Handwriting Recognition

Fall 2002CS/PSY Dialog Design 3 How to use a PDA.

Chapter 5: Input CSC 151 Beth Myers Kristy Heller Julia Zachok.

22CS 338: Graphical User Interfaces. Dario Salvucci, Drexel University. Lecture 10: Advanced Input.

Peter Norton, 6 th edition By: Rena Essa. Lesson 3A:Using the Keyboard and Mouse.

Kingdom of Saudi Arabia Prince Norah bint Abdul Rahman University College of Computer Since and Information System NET201.

E.g.: MS-DOS interface. DIR C: /W /A:D will list all the directories in the root directory of drive C in wide list format. Disadvantage is that commands.

1 Human Computer Interaction Week 5 Interaction Devices and Input-Output.

SD1230 Unit 6 Desktop Applications. Course Objectives During this unit, we will cover the following course objectives: – Identify the characteristics.

This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Diane Gromala, Elizabeth.

Interacting with your Computer Chapter 2 Learning Objectives Identify five key groups on standard computer keyboard Name six special purpose keys.

7th Meeting TYPE and CLICK. Keyboard Keyboard, as a medium of interaction between user and machine. Is a board consisting of the keys to type a sentence.

Computer Vocabulary Computer

Dialog Design - Gesture & Pen Interfaces This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory.

Typography Vocabulary and Guidelines This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory.

Introduction to Computing Slides By ADEELA MUSTAFA.

Pen Based User Interface II CSE 481b January 25, 2005.

Pen Based User Interface Issues CSE 490RA January 25, 2005.

Vidya Narayan LIS 385T.6 PDA Usability Vidya Narayan The University of Texas at Austin School of Information LIS 382L.15.

Input devices Device that accepts data and instructions from the outside world Keyboard Mouse Trackball Joystick Light pen Touch Screen Scanner Bar code.

Standard Methods of Input.

Methods of Computer Input and Output

Dialog Design 3 How to use a PDA

LECTURE Course Name: Computer Application

TYPES AND COMPONENTS OF COMPUTER SYSTEM

Objectives To define terminology associated with Windows operating systems. To examine uses of Windows in business and industry. To explain techniques.

Chapter 5 - Input.

Planning with PDAs Copyright 2006 South-Western/Thomson Learning.

GRAPHICAL USER INTERFACE

Input and Output devices in a Computer

Presentation transcript:

Dialog Design - Gesture & Pen Interfaces, Mobile Devices CS / Psych This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Elizabeth Mynatt, Jeff Pierce, Colin Potts, Chris Shaw, John Stasko, Bruce Walker, and Melody Moore Jackson. Comments directed to are encouraged. Permission is granted to use with acknowledgement for non-profit purposes. Last revision: October

Dialog Styles 1. Command languages 2. WIMP - Window, Icon, Menu, Pointer 3. Direct manipulation 4. Speech/natural language 5. Gesture & pen CS / Psych

Agenda PDA overview Pen input styles CS / Psych

How to use a PDA CS / Psych

Personal Digital Asst. (PDA) CS / Psych Palm Treo Apple Newton (1993) Dell / Asus A639 GPS PDA Apple iPhone Blackberry Curve

PDAs Now ubiquitous Small displays Often touch and pen interfaces Small thumb-based keyboards Recent Improvements Wi-Fi, GPS, more memory, better CPU, better OS, BlueTooth CS / Psych

Is it a PDA? Phone? GPS? Camera? Computer? Line between devices is blurred today Apple iPhone – phone, MP3 player, PDA, camera Palm Treo 700w – phone, Windows computer, PDA, camera Asus MyPal – Windows computer, GPS device CS / Psych

No Shredder… CS / Psych

Input Options Pen / Stylus is dominant form Main techniques Free-form ink Soft keyboard Numeric keyboard => text Stroke recognition - strokes not in the shape of characters Hand printing / writing recognition Sometimes have or can connect keyboard CS / Psych

Free-form Ink Ink is the data, take as is Human is responsible for understanding and interpretation Like a sketch pad CS / Psych

Soft Keyboards Common on PDAs and mobile devices CS / Psych

Soft Keyboard Presents a small diagram of keyboard You click on buttons/keys with pen or finger QWERTY vs. alphabetical Tradeoffs? Alternatives? 12 CS / Psych 6750 Apple iPhone soft keyboard

Numeric Keypad -T9 Tegic Communications developed You press out letters of your word, it matches the most likely word, then gives optional choices Faster than multiple presses per key Used in mobile phones CS / Psych

Stroke Recognition - Graffiti Graffiti - Unistroke alphabet on Palm PDA What are your experiences with Graffiti? Graffiti demo: mms:// /pub/hcirep/demos/DEMO -palm.wmv mms:// /pub/hcirep/demos/DEMO -palm.wmv CS / Psych

Stroke Recognition - Cirrin Developed by Jen Mankoff (GT -> Berkeley CS Faculty) Word-level unistroke technique UIST ‘98 paper Use stylus to go from one letter to the next -> CS / Psych

Hand Printing & Hand Writing Recognition Recognizing letters and numbers and special symbols Lots of commercial systems English, kanji, etc. Not perfect, but people aren’t either! People - 96% handprinted single characters Computer - >97% is really good OCR (Optical Character Recognition) CS / Psych

Recognition Issues Off-line vs. On-line Off-line: After all writing is done, speed not an issue, only quality. Work with either a bit map or vector sequence On-line: Must respond in real-time - but have richer set of features - acceleration, velocity, pressure Use best-guess pattern matching, including digram, trigram probabilities and word lists to remove ambiguity 1 I l CS / Psych

More Issues Boxed vs. Free-Form input Sometimes encounter boxes on forms Printed vs. Cursive Cursive is much more difficult to impossible Letters vs. Words Cursive is easier to do in words vs individual letters, as words create more context CS / Psych

Pen Gesture Commands CS / Psych Might mean delete -Insert -Paragraph Define a series of (hopefully) simple drawing gestures that mean different commands in a system

Pen Use Modes Often, want a mix of free-form drawing and special commands How does user switch modes? Mode icon on screen Button on pen Button on device CS / Psych

Error Correction Having to correct errors can slow input tremendously Strategies Erase and try again When uncertain system shows list of best guesses... CS / Psych

A Different Application Signature verification But not with a mouse :) CS / Psych

Multi-touch interfaces Apple iPhone CS / Psych Capacitive touchscreen: Gestures: flick, tap, pinch, un-pinch