Challenges in Multi-Modal and Context-Aware UI

Slides:

Advertisements

Similar presentations

Multimedia Components (Develop & Delivery System)

Advertisements

Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Computational Models of Multimodality Adequate.

ISTD 2003, Thoughts and Emotions Interactive Systems Technical Design Seminar work: Thoughts & Emotions Saija Gronroos Mika Rautanen Juha Sunnari.

CS335 Principles of Multimedia Systems Multimedia and Human Computer Interfaces Hao Jiang Computer Science Department Boston College Nov. 20, 2007.

CSD 5230 Advanced Applications in Communication Modalities 7/3/2015 AAC 1 Introduction to AAC Orientation to Course Assessment Report Writing.

Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis

Break-out Group # D Research Issues in Multimodal Interaction.

Fall UI Design and Implementation1 Lecture 20: HCI Research Topics.

User-Centered Design Week 4. Agenda 5:30 – Team Stand Up 5:40 – User-Centered Design 6:15 – Activities: Usability Testing 7:25 – Ongoing Offsite Activities.

Human Computer Interaction © 2014 Project Lead The Way, Inc.Computer Science and Software Engineering.

Computer Parts And Components OUTPUT DEVICES. Output Devices A display device is an output device that visually conveys texts, graphics and video information.

Mixed Reality: A Model of Mixed Interaction Céline Coutrix, Laurence Nigay User Interface Engineering Team CLIPS-IMAG Laboratory, University of Grenoble.

Math – What is a Function? 1. 2 input output function.

 Identify the output device used for:-  text  graphic  audio  video.

HARDWARE Input and Output. Hardware Input Devices Output Devices Multifunctional Devices Storage Processing Devices.

FP7-ICT Networked Media and Search Systems End-to-end Immersive and Interactive Media Technologies “creating a pervasive Augmented Reality paradigm,

Augmented Reality. The blending of digital information with the physical world User can see and is apart of the real world User is immersed in a artificial.

Multi-Modal Dialogue in Personal Navigation Systems Arthur Chan.

CARE properties Chris Vandervelpen

 Kim  Allen  Kenneth. Chapter 1 Computer Fundamentals.

Stanford hci group / cs376 u Jeffrey Heer · 19 May 2009 Speech & Multimodal Interfaces.

What is Multimedia Anyway? David Millard and Paul Lewis.

Multimodal and Natural computer interaction Evelina Stanevičienė.

A Basic Computer System

HUMAN MEDIA INTERACTION CREATIVE TECHNOLOGY FOR PLAY AND

Lesson Objectives Aims You should be able to:

Exploring Careers in Arts, Audio/Visual Technology & Communication

What do we have at school?

Basic Communication Skills

How to configure Two-way audio

Interaction Styles: Current

Augmentative and Alternative Communication Assessment and Intervention

Mixed reality week (2nd Nov)

Ubiquitous Computing and Augmented Realities

Speaking with Power and Conviction

Deaf Awareness.

Is there a meeting in this room right now?

IMTC Telepresence AG Overview

Lecture 28 Closing it Out.

Multimodal Interfaces

CEN3722 Human Computer Interaction Advanced Interfaces

Parts of the computer 2nd Grade Input and Output Devices.

Howell Istance Ambient Assisted Living Group

DrillSim July 2005.

Section 6.1 Skills for Healthy Relationships Objectives

IGE105 – Communication Technology in a Changing World

S.6.1 Communication with a partner: The importance of communication

Pervasive Computing Ubiquitous computing resources

Multimodal Human-Computer Interaction New Interaction Techniques 22. 1

Human-centered Interfaces

© 2005 Snack Music Productions

Speech & Multimodal Scott Klemmer · 16 November 2006.

IGE105 – Communication Technology in a Changing World

Communication Technology in a Changing World

Map of Human Computer Interaction

21st Century Skills.

John H.L. Hansen & Taufiq Al Babba Hasan

Draft Proposal for an Eclipse Mobile Development Suite Architecture

S.6.1 Communication with a partner: The importance of communication

Basic Communication Skills

Research about an electronic device

Interactive media.

Basic Communication Skills

Seven Laws of Better Listening

Human Computer Interaction Lecture 19 Universal Design

COMPUTER AND NETWORK.

Basic Communication Skills

The importance of communication

Computer Vision Readings

Presentation transcript:

Challenges in Multi-Modal and Context-Aware UI (the 5 minute version) 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Multi-Modal I’m using multiple output media (audio, visual, gestural, stance, posture, eye gaze, etc.). Challenge: apply this same fluidity, range, and artful redundancy/overlap to computer input techniques. 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Context-Aware Where am I? What room? What noise level? What lighting level? What elevation? 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Context-aware (2) Who am I? Biometrics best tailoring extreme interfaces Who else is nearby? 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Context-aware (3) What is around me? Other devices (IR/RF communication networks) true plug-n-play (Handspring). 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Context-aware (4) How do you know what I mean? Clutching problem How far back does context apply? Affects all the other issues (what, when, etc.) 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com 2 modest proposals get 20 itsy’s (or similar technology), “embrace and extend” them. Lego Mindstorms Study sign language 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com

Ken Fishkin;SoftBook Press;fishkin@softbook.com Hmmm…. When two fluent speakers of North American Indian Sign Language communicate 60% - redundant 30% - augment 10% - disjoint! 11/18/2018 Ken Fishkin;SoftBook Press;fishkin@softbook.com