1. RAW Workflows : Impacts on Acquisition and Post
9/20/2018 2:49 AM
RAW Workflows : Impacts on Acquisition and Post
David Newman
Mark Pedersen
February 2007
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

2. What is a digital RAW workflow?
9/20/2018 2:49 AM
What is a digital RAW workflow?
Bridges workflow between digital acquisition and post
Raw sensor image data is stored directly
Avoids camera processing to preserve latitude
Destructive operations (WB, color matrix, “looks”) stored as metadata
“Digital Negative” analogous to film negative
Image developed in post, NOT in camera
Traditional HD camera processing now becomes non-destructive filter operations in post
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

3. Traditional In-Camera Processing
Destructive, Non-reversible
Image Sensor(s)
White Balance
Color Matrix
YUV
Conversion
In-Camera
Compression
HDCam
DVCPRO HD
HDV o
In-camera processing is destructive
Sensor range greater than YUV / RGB gamut
WB / Color matrix processing can clip sensor data
Non-recoverable in post
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

4. Shooting RAW : Single Sensor Cameras
Large Bayer pattern imaging sensor
Super 16 or 35 imaging surface
Better DOF control (longer optics for the same FOV)
Greater latitude
Lower data rates vs 3CCD
Simplified optical path
Uses film-style lenses
Image digitally developed in post - not in camera (“Digital Negative”)
Cameras optimized for cinema rather than broadcast.
(Photo Courtesy of Wikipedia)
Current RAW cameras:
Dalsa Origin
Arriflex D20
Panavision Genesis
Silicon Imaging SI-2K
RED One
Shipping
2007
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

5. RAW Data from Camera to Post
Traditional Issues for RAW workflows
No post support for RAW files  No standards
Expensive disk RAIDs  No tape acquisition
Incompatible colorspace  Neither YUV nor RGB
Compute-intensive demosaic  Images must be “developed” prior to NLE/compositor usage
Necessary Solution for practical RAW workflows
Minimal compression  Low-cost disk acquisition systems
Compressed RAW media  Broad industry usage support in existing post tools
Post control over image  WB, color matrix, “look” development parameters:
Long-term archive solution  Preservation of master images
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

6. CineForm RAW Workflow Minimal compression, Rich Metadata
9/20/2018 2:49 AM
CineForm RAW Workflow
Works with existing tools
QuickTime / AVI compatible (Adobe / Apple / Autodesk, etc)
Decoding Engine translates RAW to RGB/YUV as needed
Online real-time performance within select applications
Re-adjust WB, color matrix, LUT in post (non-destructive)
Minimal compression, Rich Metadata
CineForm RAW
10/12-bit blockless wavelet
Visually lossless
VBR compressed (up to 5:1)
Low data rates
24p MB/sec
24p MB/sec
.AVI or .MOV support
5-6X less compute intensive than JPEG2000
CineForm RAW
Compression
Rich Metadata - WB, Color Matrix, 1D/3D-LUT
Freeform Clip/User Information
Decoding rules (Rosetta stone)
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

7. Archive of Compressed Media
9/20/2018 2:49 AM
Archive of Compressed Media
Goal: “Lifetime” ability to decode and reconstruct image and metadata, independent of
HW, OS, applications, player tool, or propriety
Compressed RAW has great archive value
Size: ≤ 20:1 advantage over traditional uncompressed RGB
Camera source - “Digital Negative” master
Most digital archive techniques recommend uncompressed images
Uncompressed 4K files are massive (2.7 TB/hour)
Compressed files have been problematic
CineForm embeds decoder source in all data files
Extract
Source
Build
Decoder
Decode and
Reconstruct
data file
Uncompressed
Image +
Metadata
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

8. SI-2K and CineForm RAW Collaboration for optimized workflow
9/20/2018 2:49 AM
SI-2K and CineForm RAW
Collaboration for optimized workflow
RAW Shoot followed immediately by RT RAW editing
Camera metadata designed for flexible post
Readjust camera parameters in post
SI-2K is Bayer Pattern Camera
2K (2048 x 1152) and HD (1080p / 720p)
Super 16 sensor uses film lenses
Integrated or tethered (to laptop) recording
CineForm RAW works with any Bayer camera
Configurations up to 4K at 12-bit precision
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

9. In Summary…. RAW cameras and workflows are rapidly emerging
Post workflow can be problematic
CineForm addresses both recording and RT online post
Showing in demo room:
SI-2K with CineForm RAW
Prospect 2K online, real-time RAW workflow
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

10. 9/20/2018 2:49 AM
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

11. 9/20/2018 2:49 AM
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

12. CineForm RAW Camera Processing
Traditional In-Camera Processing - Destructive
Image Sensor(s)
White Balance
Color Matrix
YUV
Conversion
In-Camera
Compression
HDCam
DVCPRO HD
HDV o
CineForm RAW™ Camera Processing – Non-Destructive
Bayer Pattern
Image Sensor
CineForm
RAW
Encode
CineForm RAW files:
- 2K: MB/sec
4K: 25–35 MB/sec
Flexible Metadata structure
Infinite Archive Stream
AVI, MOV (soon), MXF (later)
Metadata
White Balance
Color Matrix
3D LUT
File Deconstruction Rules
Shot Parameters
Other….
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM

13. CineForm RAW in Post 9/20/2018 2:49 AM © Copyright 2007 CineForm, Inc.
Post-Production with Prospect HD
Maintain CineForm RAW Digital Negative as base layer
During editing, apply de-Bayer filter and color matrix as RT effects, but don’t “flatten” layers 0 and 1
After desired look is achieved, then “flatten” the layers (“develop” the images)
Layer 2
RT Effects & Transitions
Layer 1
De-Bayer and
Color Matrix
Layer 0
CineForm RAW Digital Negative
In-Camera Processing
- Digital Negative -
Post-Production
Distribution
CineForm
RAW
Coding
“Large”
Bayer Sensor
NLE
Premiere Pro
Distribute using
traditional formats
Prospect HD
Prospect HD
Real-time, multi-stream editing on CineForm RAW digital negative
Includes color correction, transitions, titles, etc
Final step  Images are “developed” by flattening the layers – applying de-Bayer filter and color matrix
“Developed” images are presented in traditional formats: CineForm, YUV, RGB, Cineon, etc.
© Copyright 2007 CineForm, Inc.
9/20/2018 2:49 AM