Reducing the Operational Complexity of Stereoscopic Production Camera Systems Michael Bergeron Panasonic Broadcast Hollywood Post Alliance Tech Retreat 2010

What is 3D? 3D Describes graphics or animation where images are rendered from 3 dimensional modeling 3D Describes any display system with an appearance of depth 3D is possible without glasses but this is a very different kind of technology For this discussion…. 3D = Stereo Video i.e., We need a left eye image and a right eye image Hollywood Post Alliance Tech Retreat 2010

How does one display stereo as 3D? Must have a left eye image and a right eye image Left eye must only see left eye image Right eye must only see the right image You could use goggles with displays in them But for this discussion…. 3D = 3D Glasses Hollywood Post Alliance Tech Retreat 2010

Passive Glasses: projector Two independent left and right projectors Orthogonal polarization blacks left picture from right eye and right from left Projectors must have twice the illumination Left Right Left and right eye filters match the projectors screen Orthogonal* polarizers, or specialized color separation filters** *e.g., For RealD ”Orthogonal” means different angles **Dolby 3D uses Wavelength multiplex visualization Hollywood Post Alliance Tech Retreat 2010

Passive Glasses: single projector Left and right frames alternate from projector (more than twice per frame) Switched polarizer is synched with the projector Same passive glasses can be used as two projector system Alternating orthogonal* polarizers, or specialized color separation filters** Left and right eye filters match the projectors L, R, L, R, L, R… screen *e.g., For RealD ”Orthogonal” means different angles **Dolby 3D uses Wavelength multiplex visualization e.g., 144 Frames per second Hollywood Post Alliance Tech Retreat 2010

Passive Glasses: Flat Panel (Micropolarized) Left and right image appear on the display simultaneously Micropolarizing film on the display polarizes left image in same direction on alternating lines, and right image is polarized the other direction on the opposite lines Passive polarizing glasses block left image from right eye and right image from left eye 3D Image is ½ resolution of the display Hollywood Post Alliance Tech Retreat 2010

Active Shutter Glasses Left right frames alternate on 120 fps Panel IR emitter sends sync signal from the display Active glasses block left and right eye with LCD shutter as right and left images are displayed 3D Image is Full HD Resolution Full HD = 1080i for each eye, 720p 60 for each eye or p for each eye. Display is capable of p but there is no content HDMI 1.4 LeftRight Left Right Left Right Left IR Signal Hollywood Post Alliance Tech Retreat 2010

To Produce Stereo Content With a Camera System… System must link 2 cameras (i.e., align them and control in parallel) 1. System must link 2 cameras (i.e., align them and control in parallel) System must manage parallax of two images 2. System must manage parallax of two images System must correct optical or parallax errors for “good 3D 3. System must correct optical or parallax errors for “good 3D Regardless of display system to be used Hollywood Post Alliance Tech Retreat 2010

Lens servos must be Linked HC1800 Right Eye camera Left Eye camera Lens Servo System Lens Servo System A Camera Rig Locks Two 2D Cameras together on a rigid frame Focus, Zoom and Iris Imagers synchronized Time-code matched System must link 2 cameras (i.e., align them and control in parallel) 1. System must link 2 cameras (i.e., align them and control in parallel) Hollywood Post Alliance Tech Retreat 2010

System must manage parallax of two images 2. System must manage parallax of two images Hollywood Post Alliance Tech Retreat 2010

Converge behind Converge in front Lch Rch Lch Rch Lch Rch Convergence Plane Can Be adjusted Hollywood Post Alliance Tech Retreat 2010

When editing or switching convergence plane must be consistent with perspective Wide Shot Medium Shot Close Up Hollywood Post Alliance Tech Retreat 2010

IO too narrow Inter-ocular distance impacts scale perspective & comfortable 3D viewing IO too wide Disparity is too little Lch Rch Disparity is too much Lch Rch 3D is imperceptible 3D is painful Hollywood Post Alliance Tech Retreat 2010 ??!!

Inter-related factors impacting disparity Imager Inter-ocularfocalconvergence size distancelengthangle closest most distant object Display sizeviewing distanceviewer inter-ocular Hollywood Post Alliance Tech Retreat

Side By Side Rig Minimum inter-ocular > 0 Tight close up is a problem Minimum inter-ocular depends on camera/lens size Wider Inter-ocular is possible Good for shooting distant objects L R Top View io Hollywood Post Alliance Tech Retreat 2010

Minimum inter-ocular = 0 Camera can be any size Good for shooting close objects Beam-splitter acts as a polarizer Additional alignment challenges L L R R Side View Front View io Beam-splitter rig Hollywood Post Alliance Tech Retreat 2010

LeftRightLeftRight Left RightLeftRight Vertical convergence error Distortion error Focal length mismatch error Regardless of individual left and right picture quality. L/R Mismatches lead to BAD 3D Variable picture quality can be forgiven. Bad 3D ? GOOD 3D System must correct optical or parallax errors for “good 3D Hollywood Post Alliance Tech Retreat 2010 !!

Ways to correct 3D Errors Optical/Mechanical most expensive Not necessarily possible Post production Most common Not useful for live production expensive Real time processing expensive Hollywood Post Alliance Tech Retreat 2010

Can I scale the system down? System must link 2 cameras (i.e., align them and control in parallel) 1. System must link 2 cameras (i.e., align them and control in parallel) Lower cost systems tend to have looser alignment specifications System must manage parallax of two images 2. System must manage parallax of two images Can this be done without a 2 person crew 3. System must correct optical or parallax errors for “good 3D Additional post 3D correction will erase any cost savings 3D Rigs represent quite a bit of engineering excellence and operator skill Hollywood Post Alliance Tech Retreat 2010 These 2 oppose one another

Operation should move From “Guitar Hero” Easy… To “Guitar Hero” Medium Iris Focus Zoom Iris Focus Zoom Convergence ? Hollywood Post Alliance Tech Retreat 2010

HC1800 Right Eye camera Left Eye camera Parallax adjust Lens Servo System Focus, Zoom and Iris Can We Integrate Lenses and Cameras? Parallax adjust Hollywood Post Alliance Tech Retreat 2010 Lens Servo System

Advantages of small format fixed lens form factor Small imager permits side by side configuration with >2.5” inter-ocular Lenses assembled tracked and optimized with imagers during assembly Integrated servo controlled optics employ look up tables for accurate tracking User interface can support an additional convergence control on camera and on remote Can take advantage of in-camera electronic optical correction for 3D correction Hollywood Post Alliance Tech Retreat 2010

HJ17x7.6 compensation circuit calculate the amount of the compensation HJ22x7.6 Lens positioning data Lens model number CAC database IRIS/FOCUS/ZOOM Gch Rch Bch Y Pb Pr lens compensation circuit Camera Processing HA22x7.8 HA16x6.3 Lens model A Position (I,F,Z ) P1 P2 P3 Aberration Spacial Position Compensated Aberration *CAC activate in real time adaptively with lens condition such as zoom, iris and focus position. Chromatic Aberration Compensation CAC Employ same type of LSI Convergence added to LUT Correct for L/R lens differences Can adjust for distortion as well as chroma aberrations Hollywood Post Alliance Tech Retreat 2010

Why This Camera First? Hollywood Post Alliance Tech Retreat 2010

Complimentary Product This was the biggest hole in the market Small Format means small format If you could shoot project with 2D small format camera this camera may be perfect Fixed Inter-ocular impacts camera placement The rules of shooting good 3D still apply(so you still must learn them) This camera is meant to help you learn them! Hollywood Post Alliance Tech Retreat 2010

Under Study L R Maximum convergence angle? Inter-ocular < 2.5” but how much smaller? sensitivity? This is often determined late in development Zoom Range? Impacted by If/how automatic convergence is accomplished Goal is to minimize bad 3D

AG -3DA1 What We Know - LensUnder review - Recording Media2 x SD card *L / R each recorded to one card - Rec. FormatAVCHD PH mode 1080/60i, 50i, 30p, 25p 24p(Native) 720/60p, 50p(Native) - Lens AdjustmentFocus, zoom, iris, Convergence - VF, LCD L,R, or Mix (Overlay) - MicrophoneInternal Stereo Mic XLR (optional: AG-MYA30G) - Meta Data TBD - Weight(Target) Under 3.0kg - Power Consumption 16W - PowerBattery, AC Adapter 1. Twin Lens (2 Optical Components) 2. Lightweight and Compact 3. Easy Operation lenses matched during manufacturing Hollywood Post Alliance Tech Retreat 2010

BT -3DL2550 BC &Professional 25.5-inch 3D LCD Monitor - Panel25.5-inch IPS panel WUXGA (1920x1200) - 3D Filter TypeXpol polarizing filter - Color SpaceSame as New FunctionPixel-to-pixel for 720P displaying - 3D InterfaceHD-SDI x 2 *w/ 2: L, R simultaneous *w/ 1: *Line-by-line, Side-by-side DVI-Dx1 *Line-by-line, Side-by-side - Power SupplyDC24V - Dimensions599(W) x 410(H) x 100(D) mm - Std. Accessory3D polarizing glasses (2) AC adapter 1. Professional 3D LCD Monitor 2. Using Xpol Polarizing Filter 3. Professional I/F Support HD-SDI x 2 for simultaneous L,R 3D signals Hollywood Post Alliance Tech Retreat 2010

1. With new professional 3D monitor HD-SDI x 2 *L,R simultaneous 2. With other 3D monitors HD-SDI x 2 *L, R simultaneous 3. With external recording device 3. With consumer TV (PDP) Astro Design BT-3DL2550 JVC HDMI Ver.1.4 Ver.1.3 HD-SDI x 2 *L,R simultaneous HD-SDI x 2 *L,R simultaneous *S-two, Codex, KG, SR P2HD (L, R dual card rec.) HDMI Ver.1.4 *Field/Frame sequential Consumer TV i.e. 3D-PDP ? Hollywood Post Alliance Tech Retreat 2010