The Entertainment Industry Meets Simulation: The Challenge of the Holodeck Bill Swartout Institute for Creative Technologies University of Southern California.

Slides:



Advertisements
Similar presentations
National Technical University of Athens Department of Electrical and Computer Engineering Image, Video and Multimedia Systems Laboratory
Advertisements

Traits of an Effective Reader. What does a good reader do when they read? When good readers read, they read critically, they read deeply, they apply information.
The Core Principles of Media Literacy Education
JSIMS 28-Jan-99 1 JOINT SIMULATION SYSTEM Modeling Command and Control (C2) with Collaborative Planning Agents Randall Hill and Jonathan Gratch University.
Integrating Architecture Michael van Lent Institute for Creative Technology University of Southern California.
Mass Communication Chapter 14 Jade Lindsey Jamie.
 Distributed Cognition emphasizes the distributed nature of cognitive phenomena across individuals, artifacts, and representations that are both internal.
Introduction to HCC and HCM. Human Centered Computing Philosophical-humanistic position regarding the ethics and aesthetics of a workplace Any system.
Introduction to Virtual Reality Mark Green School of Creative Media.
Understanding Literature through Theater Teaching The Midwife’s Apprentice Peter Laszlo & Meg Smith Ed 200 Project Fall 05 Curriculum Project Trinity College.
Support for Palm Pilot Collaboration Including Handwriting Recognition.
1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents Catherine Pelachaud.
B EST L ESSON The Truman Show. V IDEO P RESENTATIONS Students were asked to create a twisted trailer for the Truman Show Modeling Watching film trailers.
Chapter One – Thinking as a Writer
Sunee Holland University of South Australia School of Computer and Information Science Supervisor: Dr G Stewart Von Itzstein.
Building the Design Studio of the Future Aaron Adler Jacob Eisenstein Michael Oltmans Lisa Guttentag Randall Davis October 23, 2004.
The Three Little Pigs Traditional Tales in Literacy to improve key competencies.
Narrative Reading By Lorie Sadler. Narrative Reading What Why When How.
Obj.1.03 Practice interpersonal skills Ms. Jessica Edwards, M.A.Ed.
©2005 University of Central Floridawww.mcl.ucf.eduMedia Convergence Laboratory Provocative Statement: Truly interactive stories have yet to be successfully.
Elements of a Short Story
GUI: Specifying Complete User Interaction Soft computing Laboratory Yonsei University October 25, 2004.
Jeanne Corcoran, OTD, OTR/L October 6 th, The mission of Envision Center for Data Perceptualization is to serve, support, and collaborate with faculty,
Performance Assessments (or PBL) J.H. MacMillan (2011) Classroom Assessment – Principles and Practice for Effective Standards-Based Instruction, 5th ed.,
Performance Assessments. Students construct responses and knowledge Create products, or perform demonstrations to provide evidence of their knowledge.
44 CHAPTER SPECIALIZED APPLICATION SOFTWARE Graphics 1. Desktop publishing 2. Image editors 3. Illustration programs 4. Image galleries 5. Graphic.
LCC 6317/4720 Interactive Narrative Lecture 2 January 13, 2005.
Chapter 7, MMADD about the Arts
CP SC 881 Spoken Language Systems. 2 of 23 Auditory User Interfaces Welcome to SLS Syllabus Introduction.
Issues in Dialogue Management for Multiparty Dialogue David Traum University of Southern California Institute for Creative Technologies (ICT)
Virtual Bullying: Virtual Environments as an Educational Tool Sarah Woods University of Hertfordshire.
What do they look like and what role does a teacher play? New Age Classrooms:
Chapter 7. BEAT: the Behavior Expression Animation Toolkit
10/5/2015 institute for creative technologies Army Excellence in Leadership (AXL) Sponsored by Army Research Institute Critical Leadership Analysis System.
The Center Collaborators:. Focusing on: Ecosystem Health Climate Change and the Ocean The Land-Sea Interaction Fisheries and Ocean Education.
Literary Genres Definition: categories in which a work of literature is classified. The major genres in literature are fiction, nonfiction, poetry, and.
TMP Professional Development Session Case Writing as Tool for Math Teacher Professional Development November 25, 2008 Katherine K. Merseth
Distance Learning and Education Center for Advanced Research in Technology for Education Lewis Johnson, Ph.D., Director Erin Shaw, presenter Research Scientist,
Transformation Mutability – of our character, of our setting, of our actions, etc. McLuhan’s mosaic media Mosaic + transformation = kaleidoscopic Challenge.
FET National Curriculum Statements Dramatic Arts Beyond 2006 WESTERN CAPE EDUCATION DEPARTMENT.
Models and Standards Week 3.
Understand Narrator, Voice, and Persona. Standard Reading Literature 3.9 –Explain how voice, persona, and the choice of narrator affect characterization.
Chapter 2. 3D User Interfaces: History and Roadmap.
Fundamentals of Information Systems, Sixth Edition1 Natural Language Processing and Voice Recognition Processing that allows the computer to understand.
I Robot.
A Common Ground for Virtual Humans: Using an Ontology in a Natural Language Oriented Virtual Human Architecture Arno Hartholt (ICT), Thomas Russ (ISI),
A Multi-agent Approach for the Integration of the Graphical and Intelligent Components of a Virtual Environment Rui Prada INESC-ID.
Qualitative Research. Narrative research How humans experience their lives How humans experience their lives Storied lives Storied lives Researchers construct.
Course Learning Key terms. Blended Learning Blended learning, also known as hybrid learning, is a form of education which combines both traditional learning.
National Educational Technology Standards for Students: The Next Generation.
Fundamentals of Game Design by Ernest Adams and Andrew Rollings Chapter 1: Games and Video Games.
 Media literacy changes what it means to be literate within the 21 st century.  Literacy is not just known as a “book culture” anymore.  Media literacy.
Hartono College of Languages of Sultan Agung Islamic University (UNISSULA)
Electronic visualization laboratory, university of illinois at chicago Towards Lifelike Interfaces That Learn Jason Leigh, Andrew Johnson, Luc Renambot,
Intelligent MultiMedia Storytelling System (IMSS) - Automatic Generation of Animation From Natural Language Input By Eunice Ma Supervisor: Prof. Paul Mc.
Listening National 6 English. Aims listen, talk, read and write, as appropriate to purpose, audience and context. understand, analyse and evaluate texts,
Reading Mindfully to Write Owning the material Adapted from Reading Analytically 6 th ed. Chapter 5, by D. Rosenwasser and J. Stephen.
Qualitative Target Audience Formative Research for Health and Development Communicatio n Presentation for SBCC Skills Building Training 8-10 Feb 2016 Agnes.
Leading Schools in a Data-Rich World. Developing an Inquiry Habit of Mind Data almost never provides answers. Instead, using data usually leads to more.
A Speech Interface to Virtual Environment Authors Scott McGlashan and Tomas Axling Swedish Institute of Computer Science.
WP6 Emotion in Interaction Embodied Conversational Agents WP6 core task: describe an interactive ECA system with capabilities beyond those of present day.
What is Multimedia Anyway? David Millard and Paul Lewis.
WHAT IS INTELLECTUAL WELLNESS? It is one’s creativity and engagement with stimulating mental activities It not only utilizes your own resources but.
Situated learning and Technology
Bell Ringer – Siskel & Ebert on Citizen Kane
Year 11 Media Mid Year Exam
SECOND LANGUAGE LISTENING Comprehension: Process and Pedagogy
Chapter 6 & 7 – Transformation & Cyberbard Hamlet on the Holodeck:
15. Telling Narratives AL AKHAWAYN UNIVERSITY COMMUNICATIONS STUDIES
Welcome to ‘Planning for Media Arts activities for the classroom (F-6)
Presentation transcript:

The Entertainment Industry Meets Simulation: The Challenge of the Holodeck Bill Swartout Institute for Creative Technologies University of Southern California

The ICT is intended to serve as a nexus between the simulation and entertainment communities

Biz Tech Show Institute For Creative Technologies

How can we best simulate reality? Two approaches –Military simulation –Entertainment industry

Simulating Reality: Two Approaches Military Simulation Literal: try to include as much reality in simulation as possible Homogeneous Entertainment Industry Goal-directed: create effect of real experience by selectively focusing on elements (real and unreal) Hybrid Approach: combine disparate elements

Movie clip

To the Holodeck and beyond…

Mission Rehearsal Exercise Project: New Operations

Mission Rehearsal Exercise Project: ICT VR Theater

What we don’t want… Movie clip

New Research Areas Speech Recognition Natural Language Understanding Dialogue Management Natural Language Generation Speech Synthesis Gesture Generation Perception Personality Variation Sound Spatialization Interactive Story Structure

Movie clip

Integration Raises New Challenges: Natural Language Project Leaders: Ed Hovy (ISI), Kevin Knight (ISI), David Traum (ISI), Shri Narayanan (IMSC) Speech recognition: Noisy environment Multimodal: Face To Face (speech+gesture), Radio Multiple Interactors (Sgt, medic, squads,…) –Messages tailored for multiple addressees/overhearers Emotion

Most speech synthesis sounds unnatural Even the best have limited expression (AT&T NextGen) –No command voice Use hybrid approach: –Multiple synthesizers with different “voices” –Command voice Text to Speech Synthesis “Squad Leaders listen up!” Challenge: Speech Synthesis Project Leaders: Lewis Johnson (ISI), Shri Narayanan (IMSC) Use pre-recorded library for highly emotional speech

Challenge: Modeling Emotions Project Leaders: Jon Gratch (ICT), Stacy Marsella (ISI)

Movie clip

Challenge: Modeling Emotions Project Leaders: Jon Gratch (ICT), Stacy Marsella (ISI) Problem addressed: –Virtual humans need emotions to be believable & realistic Approach: –Characters have beliefs, goals, utilities –Construct plans –Events evaluated against plans –If goals thwarted (or enabled) characters react

Emotional Reaction Movie clip

Modeling Emotions: Issues Integrating gesture, natural language & voice to project realistic behavior Managing unintended interpretations Hollywood vs. Psychology Movie emotions quite different from natural emotions Recognizing human emotions

Challenge: Story is Critical More than an event list Successful stories: –Juxtapose contrasting elements –Surprise (plot twists) –Dilemmas –Things go wrong –Build to climax (and ebb)

Structuring Stories for Intelligent Agents: Issues Traditional story telling tricks require linear structure Immersed participant needs freewill Need “bumpers” –Possibility: director agent controls environment & characters to limit choice

Reasons for Optimism Hybrid approach –Use all the tools in the toolbox Entertainment industry as source of knowledge and techniques Story context constrains possibilities Synergy from graphics, sound & emotional engagement –The mind is a willing collaborator

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.