Using GPU Rendering - Achieving Animation Production in Hours 王銓彰 Media Lab, Next Media Animation October 22, 2010

NVIDIA Confidential Objectives What We Do and Why Classic Animation Production Pipeline Concept Next Media Animation Pipeline What We Have Learned and Will Do with GPU

NVIDIA Confidential 新聞動畫 Animate the “Missing Image” inside the News Our Objectives Within Two Hours Finishing One Animation From Story Board to Broadcasting At least 20 sets of News Animation per Day Famous People Must Look Like Themselves No Quality Sacrificed Mission Impossible Regular Animation Pipeline Not Working Now Some Technical Creativity Needed

NVIDIA Confidential 新聞動畫 We Integrate the Game Development with the Computer Animation Utilizing GPU Computing Power to Solve the Problems Mission Completed !

NVIDIA Confidential 新聞動畫 You Can See the 蘋果動新聞 at YouTube 壹電視 Next TV

NVIDIA Confidential Next Media Animation 壹傳媒動畫 From August, 1 st, Animation Production Staff Production Capacity 30 Animations / Day, 30-second Animation Each 100 min. Animation / Week Major Customers 蘋果日報、壹電視、路透社、 BBC 、 Turner Medial Lab R&D Team in Next Media Animation

NVIDIA Confidential 3D Animation Production Pipeline Visual Development Sketches Storyboarding Pre- production Shot Production Delivery Modeling Texture Paint Pre-lighting Rigging Camera track Match Movie Animation Layout Animation Animation Cleanup Tech Animation Lighting Effects Rendering Composite

NVIDIA Confidential 3D Animation Production Pipeline Visual Development Sketches Storyboarding Pre- production Shot Production Delivery Modeling Texture Paint Pre-lighting Rigging Camera track Match Movie Animation Layout Animation Animation Cleanup Tech Animation Lighting Effects Rendering Composite For 30-sec Animation : ?? days ?? Days/hours ?? hours

NVIDIA Confidential Our Solution 1 st Step No More CPU Rendering No Rendering Farm GPU Rendering Shaders Next Gen Game Production Spec. Keeping in “OK” Quality Graphics Workstation = Rendering Machine Final Rendering Quality When Editing WYSWYG

NVIDIA Confidential Next Gen. Game Rendering

NVIDIA Confidential Our Solution 2 nd Step Building Up a high Efficient Motion Capture Pipeline 50 Vicon Cameras In-house Motion Retargeting Technique We Capture 300 Motion Clips Every Day. 10 min. Data Processing Time for Each Motion Clip before Delivering to Animators Facial Motion Capture for Facial Expression Synthesis Facial Mocap Demo

NVIDIA Confidential Our Solution 3 rd Step In-house Animation Software 70% Animation Done by Our Own Tools 95% Rendering Work Done by GPU A 3dsMax Real-time Renderer Plugin Procedural Animation Game AI Technologies Physics Simulation Integrate PhysX with Our Game Engine Real-time Renderer + Post-processing AT Demo

NVIDIA Confidential Our Solution 4 th Step Graphics Asset Database and Search Engine 3D Models Characters Textures Motion Clips Animation Templates Recycling Mechanism Workflow Management System

NVIDIA Confidential Our Pipeline Visual Development Sketches Storyboarding Pre- production Shot Production Delivery Models/Characters in Database Camera track Game AI Motion from MoCap Physics Enigne Lighting Effects (Game Engine) Real-time 3D Rendering By Game Engine Composite For 30-sec Animation : 20 min. 30 min.5 min hour 20 min.

NVIDIA Confidential What We Have Learned GPU Rendering Is the Most Important Successful Key for News Animation GPU Is Not Only for Graphics Real-time Rendering Facial Expression Synthesis in Real-time (20fps) Computer Vision Physics Simulation Computational Geometry GPU Provides Us Super-computing Power R&D Is Very Important

NVIDIA Confidential What We Will Do NVIDIA CUDA

NVIDIA Confidential What We Will Do Setup a Hybrid Programming Environment GPU + Multi-Core New Projects GPU-based Global Illumination Renderer GPU Rendering Farm New Hair and Fur Solution New Skin Deformation with Muscle and Fascia

NVIDIA Confidential Thanks Light Stage Next Media Animation, Media Lab