© Copyright Khronos Group, Page 1 NAB 2004 Briefing Neil Trevett Senior VP Market Development, 3Dlabs President, Khronos Jean-Luc Dery Product Development Manager, Discreet Chairman, OpenML Working Group

© Copyright Khronos Group, Page 2 OpenML – Market Catalyst For Media Authoring Opportunity Falling costs of media authoring hardware and software by moving from custom designs to off-the-shelf components Problem No open, cross platform standards to enable interoperability dmSDK OpenGL Evolution Open Source Programs, Adopters Programs, Specification evolution Solution The OpenML standard provides software interoperability between Platforms, Operating systems, Hardware devices OpenML 1.0 SDK announced here at NAB 2004! OpenML 1.0 brings key technologies into open standards Deployment OpenML 1.0 SDK enables and encourages widespread industry implementation

© Copyright Khronos Group, Page 3 Open standards body Creating royalty-free API standards Leveraging OpenGL-related technologies Building markets for dynamic media Small footprint 3D graphics API for embedded systems Media API for Dynamic Media Authoring MEDIA AUTHORING MEDIA DELIVERY

© Copyright Khronos Group, Page 4 Khronos Member Momentum 50 member companies and growing Promoting Members Contributing Members

© Copyright Khronos Group, Page 5 Dynamic Media Programming Synergistic integration of OpenML and OpenGL What OpenGL is to GRAPHICS - 2D, 3D and image processing… …OpenML is to MEDIA - video and audio processing OpenML and OpenGL together create a unified programming environment -With seamless integration of graphics and media Tightly integrated graphics, video and audio = DYNAMIC MEDIA Workstation 3D graphics Professional video and audio authoring OpenML enables interoperability of media authoring applications across: Platforms, Operating Systems, Hardware devices

© Copyright Khronos Group, Page 6 ? The OpenML Digital Media Solution Programming Environment Applications Window System System OpenGL ® MLdcML Synchronization OpenGL Extensions 2D Graphics3D GraphicsDisplays Video Audio

© Copyright Khronos Group, Page 7 Technical Strategy for OpenML 1.0 Move PROVEN technologies into Open Standards UST/MSC Synchronization #4: Synchronization of diverse media streams (graphics, audio, video) SGI’s dmSDK Digital Media Handling #1: Configure and control the Input/Output and processing of video and digital audio ML OpenGL Extensions Integrating graphics and video #3: Enable OpenGL hardware to add more value to the media authoring workflow SGI’s Xdc extension to X11 Display Control #2: Configure and control display devices MLdc Problem Solution

© Copyright Khronos Group, Page 8 Adopter Packages Consortium Participation Model Promoters Contributors Adopters Ratified Specifications Members Implementers Participation and vote in Working Groups Conformance Tests etc. Fee for access – fees waived for members Anyone can download specifications and SDKs and implement royalty-free products Conforming products can use trademark Openly and publicly distributed – free of charge Any organization can join. All work is done in WORKING GROUPS: WGs Produce Final Specifications and other products. WGs open to ANY member. All work-in- progress is Confidential to the membership Contributor rights PLUS guaranteed seat on the Board. The Board decides on strategy: what Working Groups, how spend the budget, ratification of Final Specifications SDKs Libraries, utilities and examples. Licensed for commercial use – free of charge

© Copyright Khronos Group, Page 9 OpenML 1.0 SDK Release Enabling and encouraging OpenML Adoption Executable ML and MLdc libraries and utilities to run OpenML applications for IRIX, Linux and Windows ML and MLdc library source and header files to enable new OpenML applications to be built Source code for example audio and video device modules with full documentation Source code for example OpenML applications with full documentation SDK Available today at Free of charge for commercial use under Khronos licensing agreement Can be used as a starting point for building commercial applications

© Copyright Khronos Group, Page 10 OpenML Future Development Encouraging widespread industry adoption OpenML 1.0 SDK OpenML Open Source Program OpenML 1.0 Adopters Package OpenML 2.0 Specification NAB 2004SIGGRAPH 2004IBC 2004NAB 2005 Utilities, libraries and source code to enable rapid implementation To enable the industry to co-develop support for many devices across all platforms Conformance Tests to enable conformant products to use the OpenML trademark Next generation Media Library Specifications

© Copyright Khronos Group, Page 11 Possible OpenGL/OpenML Roadmap OpenGL 1.2 Pbuffers for off-screen storage. Imaging Library for Filtering, Color correction, Blending, Image enhancement, Color space conversion OpenML 1.0 OpenGL extensions for: Synchronization, Interlace processing, Chroma resampling, Flexible alpha processing. ML MLdc UST/MSC OpenGL 2.0 High-level shaders for flexible and powerful image and video processing OpenML 2.0 Enhanced media synchronization, extended video format and color space processing OpenGL 2.1 Advanced memory management and synchronization

© Copyright Khronos Group, Page 12 OpenML Outreach and Engagement Industry Involvement will drive momentum SDK Released - OpenML Forums at -Adopters can request, discuss programming and the evolution of OpenML and the SDK OpenML - for multimedia application vendors -Complete software environment for advanced media on wide selection of systems and devices OpenML – for hardware vendors -Gives more ISVs better access to hardware device capabilities OpenML - for end users -Better functionality across a wider range of platforms at cheaper prices The Khronos Group encourages your participation to help grow the dynamic media market!

© Copyright Khronos Group, Page 13 Any Questions? OpenGL is a registered trademarks of Silicon Graphics, Inc., and OpenML is a trademark of Silicon Graphics, Inc., used with permission by the Khronos Group. All other product names, trademarks, and/or company names are used solely for identification and belong to their respective owners.

© Copyright Khronos Group, Page 14 OpenML 1.0 Technical Overview

© Copyright Khronos Group, Page 15 ? The OpenML Digital Media Solution Programming Environment Applications Window System System OpenGL ® MLdcML Synchronization OpenGL Extensions 2D Graphics3D GraphicsDisplays Video Audio

© Copyright Khronos Group, Page 16 OpenML’s “ML” API Media device control interface API to configure/control video/audio device input, output and processing -Low level - provides device independence without imposing policy Perfect environment for implementing higher-level software -Such as QuickTime OpenInventorQuickTime OpenGLML Low level (ioctl interface) 3DMedia

© Copyright Khronos Group, Page 17 OpenML’s “ML” API Market-proven audio/video processing ML enables abstracted query and control of media processing devices -E.g. IEEE1394 cameras, video transcoders, OSS audio processors ML is used to setup processing pipelines between I/O and devices -With optimized buffering and synchronization between devices and the application -Asynchronous communication between application and media devices Application Media Input JacksMedia Output Jacks Transcoder Control over input/output parameters such as data format and quality levels Control over transcoder operation Buffered, synchronized message-based data communication Synchronization and control

© Copyright Khronos Group, Page 18 MLModules Device Driver Framework ML Application ML MLmodules user kernel h/w Audio oss Oss audio Oss audio Video V4l video V4l video 1394 camcorder 1394 S/W Xcoders S/W Xcoders Higher-level library Creates device independent abstractions

© Copyright Khronos Group, Page 19 OpenML’s “MLdc” API Abstracted display control Allows an application to control what is displayed on monitors -Sophisticated level of control beyond most windowing systems MLdc sets up channels to drive each display screen -Channels that are driven from sections of physical frame buffers -Number and type of supported channels depends on the display device Properties that can be controlled include: -The number of channels and where their display data is derived -Interrogating monitor information -Precise video positioning -Video format query and settings -Vertical retrace rate -Interlaced vs. progressive -Gamma ramp control -Video sync sources -Genlock state notification Frame Buffers Progressive Scan Computer Monitor Progressive Scan Computer Monitor Progressive Scan HDTV Monitor Progressive Scan HDTV Monitor Interlaced Video Monitor Interlaced Video Monitor Channels

© Copyright Khronos Group, Page 20 Media Synchronization A critical part of any authoring environment Need to ensure that all media streams start at the same time -And stay in synch Non-trivial problem to solve -Devices from various manufacturers -Device latencies are unpredictable -OS scheduling latencies Audio Device A Video Device A Audio Device B Gfx Device B Gfx Device A Application Do all the streams come out in sync?

© Copyright Khronos Group, Page 21 The UST/MSC/SBC Solution Accurate media synchronization UST - Unadjusted System Time – time reference for software and devices -64-bit monotonic counter with nanosecond resolution, microsecond system-wide accuracy MSC - Media Stream Counter - incremented for each channel sample -i.e. Video - per frame, Graphics - per retrace, audio - per audio sample, e.g. 44.1KHz SBC – Swap Buffer Count - incremented on graphics buffer swap -Not necessarily in synch with retrace UST Graphics devices Digital audio/ video devices SBC OpenGL ML MSC Output graphic Frames/ samples Video/Audio IO samples

© Copyright Khronos Group, Page 22 Using UST/MSC/SBC Robust Synchronization – even on non real-time OS Every media sample is time-stamped -Timestamp can be accessed through OpenGL and ML APIs for temporal analysis and control Application can synchronize output events to UST -Enabling precise timing and synchronization in non-real-time operating systems Applications can detect dropped samples -And take corrective action

© Copyright Khronos Group, Page 23 OpenML’s OpenGL Extensions Video imaging and 3D graphics integration OpenML is built around OpenGL OpenML and OpenGL: A tight and synergistic integration

© Copyright Khronos Group, Page 24 OpenML and OpenGL Tight and synergistic integration Compliant OpenML assumes a robust OpenGL implementation -OpenGL with GLX 1.3 (Linux/UNIX) or WGL (Windows) OpenML extends OpenGL with video primitives and DCC rendering features -Defines a set of OpenGL extensions that OpenML compliant hardware must implement Pbuffers are the fundamental method of integrating graphics and video -Enables buffering and off-screen processing of video data OpenGL imaging extensions are used to process video streams -Filtering, color correction, blending, image enhancement, color space conversion Significant opportunity for OpenGL hardware vendors to add more value -Use OpenGL graphics hardware for 3D and video acceleration

© Copyright Khronos Group, Page 25 OpenML’s OpenGL Extensions Bringing together the worlds of 3D and video Synchronization control -Primitives to control UST/MSC synchronization from OpenGL -Functions added: WaitForMSC, SwapBuffersMSC, GetSyncValues Interlace support -Based on two previous extensions: SGIX_interlace, INGR_interlace_read Enables reading and writing of the frame buffer while skipping every other line -Enables processing (e.g., convolution) on interlaced video streams Texture color mask management to enable advanced compositing -Enables independent loading of RGB images and Alpha masks in texture memory -Recently promoted from an SGI extension to an ARB extension -Works for textures like the OpenGL color mask works for the color buffer Chroma resampling to support pixel formats such as YCrCb -Upsampling and downsampling when converting between YCrCb and RGB -Sampling options are: Replicate, Zero fill, Average