CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel Francesco Carucci

Slides:

Advertisements

Similar presentations

CRYTEK © 2010 Crytek GmbH BRINGING STEREO TO CONSOLES Nicolas Schulz, R&D Graphics Engineer GDC Europe 2010, AAA Stereo-3D in CryENGINE.

Advertisements

CRYTEK © 2010 Crytek GmbH - CONFIDENTIAL - AAA STEREO-3D IN CRYENGINE 3 Jens Schobel Francesco Carucci

Accelerating Real-Time Shading with Reverse Reprojection Caching Diego Nehab 1 Pedro V. Sander 2 Jason Lawrence 3 Natalya Tatarchuk 4 John R. Isidoro 4.

Miroslav Hlaváč Martin Kozák Fish position determination in 3D space by stereo vision.

Exploration of advanced lighting and shading techniques

POST-PROCESSING SET09115 Intro Graphics Programming.

CS123 | INTRODUCTION TO COMPUTER GRAPHICS Andries van Dam © 1/16 Deferred Lighting Deferred Lighting – 11/18/2014.

Parallax-Interpolated Shadow Map Occlusion

Frame Buffer Postprocessing Effects in DOUBLE-S.T.E.A.L (Wreckless)

Ray tracing. New Concepts The recursive ray tracing algorithm Generating eye rays Non Real-time rendering.

Object Space EWA Surface Splatting: A Hardware Accelerated Approach to High Quality Point Rendering Liu Ren Hanspeter Pfister Matthias Zwicker CMU.

Soft Particles Petter Börjesson, Mattias Thell. Particle Effects Smoke, fire, explosions, clouds, etc Camera-aligned 2D quads – Gives the illusion of.

The Importance of Color Accessibility Greg Kraus, North Carolina State University Wayne Dick, California State University, Long Beach.

Week 7 - Monday.  What did we talk about last time?  Specular shading  Aliasing and antialiasing.

Render Cache John Tran CS851 - Interactive Ray Tracing February 5, 2003.

Fast Volume Rendering Using a Shear-Warp Factorization of the Viewing Transformation Philippe Larcoute & Marc Levoy Stanford University Published in SIGGRAPH.

Fast GPU Histogram Analysis for Scene Post- Processing Andy Luedke Halo Development Team Microsoft Game Studios.

Anahita: A System for 3D Video Streaming with Depth Customization

Highlights Lecture on the image part (10) Automatic Perception 16

1 Image filtering

1 Lecture 11 Scene Modeling. 2 Multiple Orthographic Views The easiest way is to project the scene with parallel orthographic projections. Fast rendering.

Hundreds of thousands of polygons! Hundreds of thousands of polygons! Painstaking detail for the artist to create. Painstaking detail for the artist to.

CS248 Midterm Review. CS248 Midterm Mon, November 5, 7-9 pm, Terman Aud Mon, November 5, 3-5 pm, Gates 392 Mostly “short answer” questions Covers through.

Painterly Rendering for Animation Barbara J. Meier Walt Disney Feature Animation SIGGRAPH 96.

02/14/02(c) University of Wisconsin 2002, CS 559 Last Time Filtering Image size reduction –Take the pixel you need in the output –Map it to the input –Place.

02/12/02 (c) 2002 University of Wisconsin, CS 559 Filters A filter is something that attenuates or enhances particular frequencies Easiest to visualize.

Light Field. Modeling a desktop Image Based Rendering  Fast Realistic Rendering without 3D models.

Joshua Smith and Garrick Solberg CSS 552 Topics in Rendering.

Stereoscopic images Several methods: –Anaglyph –Polarization –Timesequential (shutterglasses) –Lenticular L A Rønningen/ E Heiberg, Item 2008.

3D Stereo Video Coding Heejune AHN Embedded Communications Laboratory Seoul National Univ. of Technology Fall 2013 Last updated

3D/Multview Video. Outline Introduction 3D Perception and HVS 3D Displays 3D Video Representation Compression.

Aaron Schultz. Idea: Objects close to a light shadow those far away. Anything we can see from the light’s POV is lit. Everything hidden is dark. Distance.

Filtering Approaches for Real-Time Anti-Aliasing /

Analog and Digital Cameras  History of Digital cameras  Advantages and Disadvantages / Similarities and Differences of both types of cameras  Types.

CAP4730: Computational Structures in Computer Graphics 3D Concepts.

UW EXTENSION CERTIFICATE PROGRAM IN GAME DEVELOPMENT 2 ND QUARTER: ADVANCED GRAPHICS Visual quality techniques.

Antialiasing CAP4730: Computational Structures in Computer Graphics.

Vector vs. Bitmap

Computer Graphics Lecture 1 July 11, Computer Graphics What do you think of? The term “computer graphics” is a blanket term used to refer to the.

Presenter: Pia Maffei Autostereoscopy and Film Pre-Viz and Promotion.

Filtering and Color To filter a color image, simply filter each of R,G and B separately Re-scaling and truncating are more difficult to implement: –Adjusting.

Advanced Computer Graphics Depth & Stencil Buffers / Rendering to Textures CO2409 Computer Graphics Week 19.

Week 6 - Wednesday.  What did we talk about last time?  Light  Material  Sensors.

Computer Graphics The Rendering Pipeline - Review CO2409 Computer Graphics Week 15.

CS332 Visual Processing Department of Computer Science Wellesley College Binocular Stereo Vision Region-based stereo matching algorithms Properties of.

Stereo Viewing Mel Slater Virtual Environments

Real-Time rendering Chapter 4.Visual Appearance 4.4. Aliasing and antialiasing 4.5. Transparency,alpha,and compositing 4.6. Fog 4.7. Gamma correction

Hardware-accelerated Rendering of Antialiased Shadows With Shadow Maps Stefan Brabec and Hans-Peter Seidel Max-Planck-Institut für Informatik Saarbrücken,

Efficient Methods for Ambient Lighting Tamás Umenhoffer Balázs Tóth László Szirmay-Kalos.

Pixmotor: A Pixel Motion Integrator Ivan Neulander Rhythm & Hues.

Immersive Rendering. General Idea ► Head pose determines eye position  Why not track the eyes? ► Eye position determines perspective point ► Eye properties.

Single Pass Point Rendering and Transparent Shading Paper by Yanci Zhang and Renato Pajarola Presentation by Harmen de Weerd and Hedde Bosman.

Real-Time Relief Mapping on Arbitrary Polygonal Surfaces Fabio Policarpo Manuel M. Oliveira Joao L. D. Comba.

(c) 2002 University of Wisconsin, CS 559

WORKING WITH SELECTIONS MASKS and CHANNELS 3D IMAGES LAYER BASICS PHOTO.

1 2D TO 3D IMAGE AND VIDEO CONVERSION. INTRODUCTION The goal is to take already existing 2D content, and artificially produce the left and right views.

Shuen-Huei Guan Seminar in CMLab, NTU

© ExplorNet’s Centers for Quality Teaching and Learning 1 Objective % Understand digital graphics production methods, software, and hardware.

Real-Time Soft Shadows with Adaptive Light Source Sampling

Vector vs. Bitmap.

Week 11 - Wednesday CS361.

The Graphics Rendering Pipeline

Announcements Project 2 out today (help session at end of class)

UMBC Graphics for Games

UMBC Graphics for Games

Computer Graphics Practical Lesson 7

Filtering Images Work in the spatial domain

Chapter XV Shadow Mapping

Presentation transcript:

CRYTEK © 2010 Crytek GmbH AAA STEREO-3D IN CRYENGINE 3 Jens Schobel Francesco Carucci

CRYTEK © 2010 Crytek GmbH 2 Research project

CRYTEK © 2010 Crytek GmbH 3 Research project

CRYTEK © 2010 Crytek GmbH 4 Depth Perception Research project

CRYTEK © 2010 Crytek GmbH 5 Popping out of the screen Research project

CRYTEK © 2010 Crytek GmbH POPPING OUT OF THE SCREEN 6 Your health is important

CRYTEK © 2010 Crytek GmbH POPPING OUT OF THE SCREEN 7 Your health is important

CRYTEK © 2010 Crytek GmbH CASE STUDY: HUD 8 WHERE DO WE PLACE IT?

CRYTEK © 2010 Crytek GmbH CASE STUDY: HUD Feels natural Depth violations INSIDE THE SCREEN 9

CRYTEK © 2010 Crytek GmbH CASE STUDY: HUD Feels cool More tiring for the eyes OUT OF THE SCREEN 10

CRYTEK © 2010 Crytek GmbH CASE STUDY: CONVEYING MOOD Color palette Depth of field Atmospheric effects IN A 2D WORLD 11

CRYTEK © 2010 Crytek GmbH CASE STUDY: CONVEYING MOOD Stereo effect strength Convergence distance IN A STEREO 3D WORLD 12

CRYTEK © 2010 Crytek GmbH CASE STUDY: CONVEYING MOOD Stereo effect strength Convergence distance Change depth perception IN A STEREO 3D WORLD 13

CRYTEK © 2010 Crytek GmbH CASE STUDY: CONVEYING MOOD 14 STEREO 3D AS A COMMUNICATION TOOL

CRYTEK © 2010 Crytek GmbH 15 VS

CRYTEK © 2010 Crytek GmbH %

CRYTEK © 2010 Crytek GmbH 30 fps per Eye for acceptable quality RENDERING TWICE 17 STEREO IMAGE GENERATION

CRYTEK © 2010 Crytek GmbH 30 fps per Eye for acceptable quality dramatically reduced quality RENDERING TWICE 18 STEREO IMAGE GENERATION

CRYTEK © 2010 Crytek GmbH 30 fps per Eye for acceptable quality dramatically reduced quality lower resolution less special effects RENDERING TWICE 19 STEREO IMAGE GENERATION

CRYTEK © 2010 Crytek GmbH RENDERING TWICE 20 STEREO IMAGE GENERATION Not an option

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION SCREEN SPACE RE-PROJECTION 21 single pass pixel shader

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION SCREEN SPACE RE-PROJECTION 22 single pass pixel shader fully gather-based approach no warped grid no point sampling

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION SCREEN SPACE RE-PROJECTION 23 single pass pixel shader fully gather-based approach no warped grid no point sampling surprising depth strength possible

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION SCREEN SPACE RE-PROJECTION 24 single pass pixel shader fully gather-based approach no warped grid no point sampling surprising depth strength possible full implementation by Nicolas Shulz (RnD)

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION HIGH LEVEL 25 re-project pixel into left/right camera

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION HIGH LEVEL 26 re-project pixel into left/right camera in screen space

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION HIGH LEVEL 27 re-project pixel into left/right camera in screen space offset based on pixel depth

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION HIGH LEVEL 28 re-project pixel into left/right camera in screen space offset based on pixel depth stereo parameters for adjusting

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION HIGH LEVEL 29 re-project pixel into left/right camera in screen space offset based on pixel depth stereo parameters for adjusting resample backbuffer with bilinear filtering

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 30 great quality with positive parallax DOES IT LOOK GOOD?

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 31 great quality with positive parallax no artifacts for opaque objects transparent objects look acceptable slight stretching at screen edges (easy to solve) DOES IT LOOK GOOD?

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 32 good quality for negative parallax (popping out) DOES IT LOOK GOOD?

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 33 good quality for negative parallax (popping out) if no steep parallax gradient (no parallax change) DOES IT LOOK GOOD?

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 34 good quality for negative parallax (popping out) if no steep parallax gradient (no parallax change) artifacts for steep parallax gradient DOES IT LOOK GOOD?

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION DOES IT LOOK GOOD? 35 good quality for negative parallax (popping out) if no steep parallax gradient (no parallax change) artifacts for steep parallax gradient smooth out depth to solve

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION 36

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION OUTPUTTING LEFT/RIGHT 37 PS3Native HDMI 1.4 support

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION OUTPUTTING LEFT/RIGHT 38 PS3Native HDMI 1.4 support XBOX360no native stereo support frame-compatible format (SBS, LBL,...) encode output format in a final pass

CRYTEK © 2010 Crytek GmbH SCREEN SPACE RE-PROJECTION AUTOSTEREOSCOPIC 39 Natively supported! Output color and depth separation buffers

CRYTEK © 2010 Crytek GmbH Nicolas Schulz- RnD Michael Kopietz- RnD Marco Corbetta- Crysis 2 THANKS TO…

CRYTEK © 2010 Crytek GmbH STEREO IMAGE GENERATION QUESTIONS ? 41 ASK NOW