Controlling Gestures on Avatars

Slides:

Advertisements

Similar presentations

Expressive Tangible Acoustic Interfaces Antonio Camurri, Corrado Canepa, and Gualtiero Volpe InfoMus Lab, DIST-University of Genova, Viale Causa 13, Genova,

Advertisements

Chapter 3 Nonverbal Communication. What is nonverbal communication? “Everything that communicates a message but does not use words” Facial expressions,

KAIST CS780 Topics in Interactive Computer Graphics : Crowd Simulation A Task Definition Language for Virtual Agents WSCG’03 Spyros Vosinakis, Themis Panayiotopoulos.

1 Transparent control of avatar gestures A prototype Francesca Barrientos GUIR Meeting  28 April 2000.

Communicating with Avatar Bodies Francesca Barrientos Computer Science UC Berkeley 8 July 1999 HCC Research Retreat.

Introduction to Graphics and Virtual Environments.

제 5 주. Art and Design Computer Animation: from Avatars to Unrestricted Autonomous Actors A. Pina, E. Cerezo and F. Seron, Computers & Graphics, vol. 24,

Human-Computer Interaction IS 588 Spring 2007 Week 4 Dr. Dania Bilal Dr. Lorraine Normore.

GUI: Specifying Complete User Interaction Soft computing Laboratory Yonsei University October 25, 2004.

1 Darmstadt, October 02, 2007 Amalia Ortiz Asociación VICOMTech Mikeletegi Pasealekua Donostia - San Sebastián (Gipuzkoa)

Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis

Oct 30, 2006 LUONNOS Navigation techniques for construction industry product models Jukka Rönkkö, HUT/VTT

Communicating Nonverbally 1Chapter 5. Defining Nonverbal Communication Nonverbal communication – refers to all behaviors (other than the spoken word)

Chapter 7. BEAT: the Behavior Expression Animation Toolkit

ST01 - Introduction 1 Introduction Lecturer: Smilen Dimitrov Sensors Technology – MED4.

APML, a Markup Language for Believable Behavior Generation Soft computing Laboratory Yonsei University October 25, 2004.

Interactive Spaces Huantian Cao Department of Computer Science The University of Georgia.

©2007 by the McGraw-Hill Companies, Inc. All rights reserved. 2/e PPTPPT.

卓越發展延續計畫分項三 User-Centric Interactive Media ~ 主持人 : 傅立成共同主持人 : 李琳山，歐陽明，洪一平，陳祝嵩水美溫泉會館研討會

Chapter 4 Nonverbal Communication. Understand the power of nonverbal communication Outline the functions of nonverbal communication Describe the communication.

ENTERFACE 08 Project 1 “MultiParty Communication with a Tour Guide ECA” Mid-term presentation August 19th, 2008.

Crowds (and research in animation and games) CSE 3541 Matt Boggus.

4 November 2000Bridging the Gap Workshop 1 Control of avatar gestures Francesca Barrientos Computer Science Division UC Berkeley.

Managers and Communication BUS 206 Erlan Bakiev, Ph. D. Zirve University Spring 2012.

Component 16/Unit 4bHealth IT Workforce Curriculum Version 1.0/Fall Professionalism/Customer Service in the Health Environment Unit 4, Lecture 2.

Electronic visualization laboratory, university of illinois at chicago Towards Lifelike Interfaces That Learn Jason Leigh, Andrew Johnson, Luc Renambot,

3DDI: 3D Direct Interaction John Canny Computer Science Division UC Berkeley.

Cursive: Controlling Expressive Avatar Gesture using Pen Gesture Francesca A. Barrientos John F. Canny UC Berkeley Computer science division CVE’02, September.

Cursive A novel interaction technique for controlling expressive avatar gesture Francesca Barrientos and John Canny UC Berkeley UIST 12 November 2001,

IBM - CVUT Student Research Projects Smart Kiosk in SecondLife Vojtěch Vavřín

Chapter 18: Your Body in Delivery. Pay Attention to Body Language  Body language includes  Facial expressions;  Eye behavior;  Gestures;  General.

UCL Human Representation in Immersive Space. UCL Human Representation in Immersive Space Body ChatSensing Z X Y Zr YrXr Real–Time Animation.

Building Educational Virtual Environments page 1 ICALT 2002 Building Educational Virtual Environments C. Bouras, and T. Tsiatsos Computer Engineering and.

Cursive A novel interaction technique for controlling expressive avatar gesture Francesca Barrientos and John Canny UC Berkeley UIST 12 November 2001,

Augmenting Understanding: 2 Digital Innovators LCC 2700: Intro to Computational Media Fall 2005 Ian Bogost.

The Communication Process Sender Media Receiver Ideation EncodingReceiving Decoding Transmission Feedback Noise.

What is Communication? COMMUNICATION IS THE ART OF TRANSMITTING INFORMATION, IDEAS AND ATTITUDES FROM ONE PERSON TO ANOTHER.COMMUNICATION IS THE PROCESS.

Perceptive Computing Democracy Communism Architecture The Steam Engine WheelFire Zero Domestication Iron Ships Electricity The Vacuum tube E=mc 2 The.

Crowds (and research in computer animation and games)

Human Computer Interaction (HCI)

LCC 2700: Intro to Computational Media

Types of Communication

Communication Skills Rumessa Naqvi

Chapter 3 Choosing Information & Communications Technologies that Fit the Research Design Janet Salmons, PhD.

Communication and Social Style

User Interface Design and Usability Course Introduction

What we learn about technology from people living with dementia

Types of Communication

Requirements Elicitation – 1

Human Computer Interaction (HCI)

Crowds (and research in computer animation and games)

Survey of Affective Computing for Digital Home

What Is Communication? Communication - the transfer and understanding of meaning. Transfer means the message was received in a form that can be interpreted.

Francesca Barrientos and John Canny

Towards lifelike Computer Interfaces that learn

A POCKET GUIDE TO PUBLIC SPEAKING 5TH EDITION Chapter 18

Communicating with Avatar Bodies

Map of Human Computer Interaction

Presentation skills I Persuasion through non-verbal communication

Cursive: Controlling Expressive Avatar Gesture using Pen Gesture

Interactive media.

Name: Arda Tezcan ID: Supervisor: Associate Professor Debbie Richards

Map of Human Computer Interaction

CHAPTER 8 The Nonverbal Code.

3 Forms of Communication

February 27th, 2004 Benjamin Lok

Continuous control of avatar gesture (with dirty details)

Lecture 3. Virtual Worlds : Representation,Creation and Simulation ( II ) 고려대학교 그래픽스 연구실.

December 12th, 2003 Benjamin Lok

COMMUNICATION Communication is the transfer of information and understanding from one person to another person. It is a way of reaching others with facts,

Presentation transcript:

Controlling Gestures on Avatars Francesca Barrientos with John Canny

Goals Develop a simple interface for controlling nonverbal expression (gesture) on avatar bodies Application: most likely a collaborative work tool Audio 3D interactive graphics on regular screen Desktop input devices Multi-user, networked

Outline Motivation State of the art Issues Research snapshot Solicitation

Motivation Explore capabilities of virtual humans for communication purposes Hard to control a fully articulated human Rendering Network bandwidth Ease of use

Commercial virtual worlds Blaxxun ComicChat Traveler Oz

Typical gesture interface Selecting expressions in The Palace

Example interface Video from VRAIS97 Capin + Pandzic + Thalman + Thalman

Communication interface Thalmann’s

Virtual tennis Thalmann’s

Autonomous behavior Viljamsson

Scripted/reactive behaviors Perlin Random noise adds life

How our goals differ Continuous manual control Non-obtrusive input interface Avatar movement is an extension of human’s movements Lifelike motion quality

Issues Understanding nonverbal behavior Design of controls Domain Evaluation

Functions of nonverbal behavior Psychological/Expressive Expression of emotion Construction of utterances Social/Communicative/Interactional Conversational regulators Approval, persuasion, listening Artistic Dance, theater, puppetry

Nonverbal communication types Proxemics Kinesics Context Facial expression Gaze Paralinguistic ...

Controls & Interface Gesture designs Kinematic mappings from input device motion to avatar movements Interface to select among mappings Dynamics behavior for lifelike motion

Gesture

Mappings

Early prototypes (video) Simple avatars implemented in Impulse Networked application Inverse kinematics mapping Physical simulation Mouse input

Slice of research

Domain provides context Design discussions Architecture Industrial design Theater Storyline and characters provide context Other applications?

Evaluation Expressive emphasis means evaluating ease of use and expressive satisfaction Communicative emphasis means evaluating interaction Motion quality: Realism and Believability

Summary Goals of this project State of the art in avatar gesturing Study of non-verbal behavior Technical issues in gesture control Future plans

Solicitations Descriptive title for project Ideas for domain Thoughts on evaluation Anything else to fbarr@cs