1. Jonas Braasch Director of the CCC
Center for
Cognition, Communication, and Culture The road ahead:
Immersive Technologies & Synthetic Characters
Jonas Braasch

2. International focus on the Human Brain
Brain Activity Map
Collins, Greenspan, Church
Goal: map human brain with molecule size
Human Brain Project
PI Henry Markram
Goal: functional brain model on supercomputer

3. The Brain and the environment

4. 4D 2x1D 4D Auditory Perception Physical World Perceptual World
3D acoustic
scene
3D auditory
scene
Eardrums
Physical World
Perceptual World

5. Bringsjord
Sun
Braasch/
Xiang Ji
CATS

6. Characteristics of Human Perception
Chimps beat humans in memory test
Tetsuro Matsuzawa/Kyoto University
Edgar Bergen
Ventriloquism Effect

7. Scientific Data Displays

8. Wooster Installation @ EMPAC:
There is still time .. brother

9. CRAIVE lab
Collaborative-Research Augmented Immersive Virtual Environment Laboratory
EMPAC/Wooster Installation
CRAIVE: Dimensions: 18m×12m×4.3m supported by the National Science Foundation

10. Communication in an optimal space: EMPAC Studio 1

11. Human Interfaces to the World
David Whalen
Jamboxx
Tomie Hahn
Triple Point

12. The Lost Manuscript
Chang, Hajela, Odell, Sheldon, Si, Zappen 12

13. The lost manuscript The Mandarin Project
Sheldon, Chang, Si (2012)

14. EMPAC CCNI CCC MIXED REALITY CROSS-MODAL DISPLAYS SYNTHETIC CHARACTERS
Supercomputing
Center
EMPAC
Experimental
Media
Production
Immersive language learning
Game inspired methods
MIXED REALITY
Integrated virtual agents
Perceptualization
of BIG DATA
Multimodal perceptual studies & sensing
CROSS-MODAL DISPLAYS
Collaborative Virtual Reality Environments
Free improvising music agents
Text-based story telling agents
Semantic web agents
robotics
SYNTHETIC CHARACTERS
Intelligent user interfaces
Haptic telesurgery
CCC
Center for Cognition, Communication, and Culture

15. CCC Research Cycle Teaching Cognitive Models Fundamental Knowledge
experience
Cognitive Models
functional
explanatory
used to improve
data driven
Applications
Fundamental Knowledge
Virtual Environments
CRAIVE/ERL
host experiments
Psychophysical
Experiments