卓越發展延續計畫分項三 User-Centric Interactive Media ~ 主 持 人 : 傅立成 共同主持人 : 李琳山，歐陽明，洪一平， 陳祝嵩 水美溫泉會館研討會

Media Interaction and Feedback Loop Context Change Context Knowledge Observation Interaction Interpretation Reasoning / Processing for Reaction Display / Actuator User Location User Attention Posture Input Acoustic Input Visual Sensing Audio Sensing Contact Sensing (Mouse, Joystick, Pressure, …) Others (IR, RFID, EM, …) Gesture / Posture Recognition Speech Recognition Behavior / Activity Recognition Emotion Discovery Steerable Projector Multi-resolution Display Motion Platform Control Haptics Speech Synthesis Intelligent Agent Reactive Control VR/AR Immersive Environment Events Features Users’ Intention Content / Command Device Input Interactive Media Content Presentation

Stewart Platform Consists of a fixed base and a moving platform connected by six extensible actuators. Provide sensation of motion by tracking desired trajectory. Incorporate wash-out filter that improves the capability and performance. Current Achievement

System Diagram of Motion Platform Current Achievement

Stewart Platform Demo Current Achievement

Human Figure Recognition(1) 1.Extract foreground object from background image. 2.Identify if the foreground object is a human figure. Current Achievement

Human Figure Recognition(2) Current Achievement

Human Limb Tracking(1) Future Work Use calibrated camera system to track the configuration of upper body limbs.

Human Limb Tracking(2) Detect head position first. Use 3D kinematic model to help recover the posture of upper body. Future Work Head Torso Left Upper Arm Left Forearm Right Upper Arm Right Forearm shoulder elbow neck

Human Limb Tracking(3) Future Work The human limb configuration can intuitively manipulate objects displayed in large screen or immersive environment.

Context-Aware Interactive Media Humans are good at conveying ideas to each other because they use context information to increase the conversational bandwidth. Context-aware interactive applications can make HCI more natural. Context-awareness is the essential feature of next generation interactive media. Future Work

Intelligent Agents for Interactive Media Traditional Media : Direct Manipulation System only do something if we explicitly tell it to. Interactive Media : Agent-based Interaction We work with computer as peers, each carry out parts of work. Agents can do works according to their experts, or negotiate with other agents on behalf of user. Agents can issue appropriate commands to the actuator / display according to user’s intention autonomously. Asking other agents to help (via Web Services), if the commands are out of local agent’s ability.(Ex: Hotel Reservation, emergent situation…) Future Work

Intelligent Agent for Interactive Media User Intention Model Action Rules Environmental Information Memory / User Interaction History Reasoning Engine External Interfaces Foreign Agent A Foreign Agent B Cognitive Rules Interaction Interpretation Local Agent Display / Actuator Future Work

Context Aware (3) Commercial Cut and Video Summarization (2) Auto Translation (1) Face and Pose Recognition (3) Region of Interest Variable Bit Rate Codec Multi-Resolution Display (3) Motion Platform (3) Cross Language Query Translation (1) Cross Language Query Translation (1) Embedded System (4) Ontology (1)