3DTV technologies and challenges LINK LINK

stereo is usefull - generates emotions - captures attention - we often get more info when data is stereo perceived : diagrams figures maps drawings... but... stereo de crisp as colourfull... so two types of display googles? eye projection? neural connection? UPV/EHU2Alex Garcia-Alonso

Contents 1.Introduction 2.Visual perception: eyes+brain  perception 3.3DTV 4.Image production UPV/EHU3Alex Garcia-Alonso

Introduction UPV/EHU4Alex Garcia-Alonso

First steps & expectations Year 1889 Friese-Greene Star Wars UPV/EHU5Alex Garcia-Alonso

Expectations may become true “Crazy” user expectations (25 years ago) Engineer (watching shaded images first time) : Nice image, … would you move it in real time? UPV/EHU6Alex Garcia-Alonso

Expectations may become true “Crazy” user expectations (25 years ago) Journalist (first PC & Mac had just appeared in the market) : new media… it is nice … I want a foldable display, like the newspaper UPV/EHU7Alex Garcia-Alonso

Holographic displays Desired “display” UPV/EHU8Alex Garcia-Alonso

surrounding outside spectator surrounding Immersive displays corner 20 years old not in consumer market UPV/EHU9Alex Garcia-Alonso

3DTV (2012) Stereoscopic displays Active Passive Auto 3DTV Movies Advertising UPV/EHU10Alex Garcia-Alonso

Towards a new media Many companies have entered the market – Philips, Mitsubishi, Sony, Vizio, Sharp, LG, Panasonic, Samsung, Hyundai, JVC, ACER, Optoma, DepthQ, Toshiba, Viewsonic, Sanyo … New requirements creating MM content – TV vs. Radio Cinema vs. Theater – Studio floor, event broadcast, commercials, film- series, animation, gaming, … Required knowledge – Perception – Technologies UPV/EHU11Alex Garcia-Alonso

Visual perception Goal : review basic concepts, focus on  Binocular vision  Depth perception UPV/EHU12Alex Garcia-Alonso

Scholars studied the topic years ago Euclid Ptolemy Aristotle Galen Plato Leonardo DaVinci al-Haytham (Alhazen) UPV/EHU13Alex Garcia-Alonso

Alhazen ( ) Alhazen ( ) and Galileo ( ) UPV/EHU14Alex Garcia-Alonso Abū ʿAlī al-Ḥasan ibn al-Ḥasan ibn al-Haytham أبو علي، الحسن بن الحسن بن الهيثم Born : Basra (965) البصرة ‎ Book of Optics written from 1011 to 1021

Visual perception Components – Light – “Eyes” perceive light, generate signals – Signals transmit data from receptors to processors – Signals are processed by the brain, … Many perception theories UPV/EHU15Alex Garcia-Alonso

Visual perception Color, depth, brightness, motion, … Foveal and peripheral vision Binocular vision Context UPV/EHU16Alex Garcia-Alonso

Binocular vision Properties – Field of view – Convergence – Stereopsis (2 imagenes distintas, dan info de profundidad) – Binocular fusion (vemos 1 imagen, no 2) – etc. One “spare” eye ? UPV/EHU17Alex Garcia-Alonso

Field of view Humans : = 200º PigeonOwl Binocular Monocular UPV/EHU18Alex Garcia-Alonso

Convergence 10m. (acommodation 2m.) UPV/EHU19Alex Garcia-Alonso

Stereopsis : depth perception Stereopsis (two views from different positions) Left eye viewRight eye view UPV/EHU20Alex Garcia-Alonso

Binocular fusion UPV/EHU21Alex Garcia-Alonso

Distance, depth perception Occlusion Perspective (distance) nearer objects are larger Relative size of similar objects Expected size of objects Shadows and lighting Texture Atmospheric blurring (distance fog) Stereopsis (different image in each eye ) Accommodation (2 m.) Convergence (10 m.) Etc … wiki UPV/EHU22Alex Garcia-Alonso

Very far Farther Front Occlusion Perspective Relative size UPV/EHU23Alex Garcia-Alonso

Texture Lighting “Fog” UPV/EHU24Alex Garcia-Alonso

Stereopsis UPV/EHU25Alex Garcia-Alonso

PERCEPTION ILLUSION : Palazzo Spada, Francesco Borromini, 8 meters in length looks like 35 m. The floor of the hallway slopes upward, the ceiling and walls converge. The "hedges" at the end of the hall are scaled down, as is the sculpture in placed in the end PERCEPTION ILLUSION : It has been often used in movies UPV/EHU26Alex Garcia-Alonso

2D image 3D percived - depth illusion UPV/EHU27Alex Garcia-Alonso

Shape illusion sebastien kuntz ( cb.nowan.net/blog )cb.nowan.net/blog UPV/EHU28Alex Garcia-Alonso

motion - depth cue sebastien kuntz ( cb.nowan.net/blog )cb.nowan.net/blog UPV/EHU29Alex Garcia-Alonso

Swapping images - stereo illusion sebastien kuntz ( cb.nowan.net/blog )cb.nowan.net/blog UPV/EHU30Alex Garcia-Alonso

3DTV UPV/EHU31Alex Garcia-Alonso

Stereo for consumer market Consumer market – Active stereo system – Passive stereo – Autoestereo Other – anaglyph images – immersive projection goggles (+ contact lenses, eye projection) – holographic UPV/EHU32Alex Garcia-Alonso

Active stereo Emitter : shutter-image synchronization Higher “refresh” rate UPV/EHU33Alex Garcia-Alonso

Passive stereo (polarization) UPV/EHU34Alex Garcia-Alonso

Linear polarization wikipedia UPV/EHU35Alex Garcia-Alonso

Circular polarization wikipedia UPV/EHU36Alex Garcia-Alonso

Autostereo UPV/EHU37Alex Garcia-Alonso

Autostereo UPV/EHU38Alex Garcia-Alonso

Autostereo (SeeReal sketch) UPV/EHU39Alex Garcia-Alonso

Autostereo Perception improves with screen size 8, 16 “positions” Other techniques UPV/EHU40Alex Garcia-Alonso

Advertising UPV/EHU41Alex Garcia-Alonso

Autostereo & 3D recording The LG Optimus 3D launched in Dubai, sept 2011 Creates content UPV/EHU42Alex Garcia-Alonso

Shutter glasses – Some people notice flicker – Glasses much more expensive, need batteries – Up to 2011 lack of compatibility Polarized glasses – Perception tends to be worse – Attenuate brightness (half “black”) – Monitor must polarize In a nutshell – Both technologies continue improving – One might overcome the other one – However, comparing them is not the core target Active vs passive UPV/EHU43Alex Garcia-Alonso

Hardware challenges Tilt creates problems – the highest in autostereo and linear polarized – fewer in circular polarized – the highest tilt can be achieved with active Afterglow, Light Leakage  double images – Fast Switching Phosphor – High-Speed Shutters UPV/EHU44Alex Garcia-Alonso

Unsolved perception challenges Presently no “viewer selected”: – Convergence – Accommodation “Revolutionary” hw/sw solutions are required Proper MM content production may alleviate user discomfort UPV/EHU45Alex Garcia-Alonso

MM content production UPV/EHU46Alex Garcia-Alonso

Viewing vs. Watching vs. Inmmersion Accommodation and convergence – Viewing real world Conscious control (also unconscious reflex) Focus, accommodation We see reality as we want to see – Watching displays (TV, PC) We see reality as we are shown Some vision mechanisms cannot actuate Immersion (as in virtual worlds, games) means more : interaction UPV/EHU47Alex Garcia-Alonso

UPV/EHU48Alex Garcia-Alonso

UPV/EHU49Alex Garcia-Alonso

UPV/EHU50Alex Garcia-Alonso

Field of view & aspect ratio z y α y x z UPV/EHU51Alex Garcia-Alonso

UPV/EHU52Alex Garcia-Alonso