1. Future Directions In Graphics David Blythe Software Architect Windows Graphics Microsoft Corporation

2. The Vision Windows delivers unparalleled graphics and multimedia experience in all application areas Games Workstation (CAD, Content Creation,…) PresentationImagingVideo Eagerly driving new technologies together with our hardware and software partners

3. This Session Overview major technology parts Provide context for more detailed sessions Point out interactions between components Describe where we are going longer term

4. Session Outline Windows Graphics Big Picture Windows Display Driver Model Rendering APIs (Direct3D, OpenGL, GDI) Device APIs (DXGI) Desktop Window Manager Media APIs (DirectX Video Acceleration) Presentation APIs (WPF) Future

5. Big Picture Simplified WDDM DXVA XPDM GDI+ Direct3DGDI MIL Games (Oblivion) DXGI Workstation (Inventor) Imaging (PhotoViewer) Video (MediaPlayer) Presentation (Office) … User Windows Presentation Foundation OpenGL Media Foundation PIX Desktop Window Mgr Windows Color System Print Terminal Server Remote Assistance … DShow Shell

6. Graphics Core In Windows Vista DXG Kernel Kernel-Mode Driver User Mode Kernel Mode IHV-writtencodeMicrosoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDIDXGI PIX WPF DWM

7. Windows Display Driver Model Bedrock upon which all graphics are built Fundamental principle Graphics Just Works Re-architect entire driver stack Consolidate 10 years of evolution New driver model delivers StabilitySecurity Availability (application virtualization) Performance

8. Windows Display Driver Model Staged evolution of driver model WDDM 1.0 model supports current hardware E.g., pre-Windows Vista hardware Advanced model (WDDM 2.x) utilizes new hardware features Post Windows Vista More efficient virtualization Old Windows XP driver model still supported for compatibility No new features

9. Windows Display Driver Model For more information: WDDM v2 and Beyond, Steve Pronovost, et al.

10. Rendering APIs Lots to choose from GDI/GDI+DirectDraw Direct3D [3..10] OpenGL (Windows Presentation Foundation) Break into categories Legacy Mainstream (GDI, Direct3D 9/9Ex) New (Direct3D 10)

11. Legacy APIs DXG Kernel Kernel-Mode Driver User Mode Kernel Mode IHV-writtencode Microsoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDIDXGI PIX WPF DWM

12. Legacy APIs Older Direct3D immediate mode APIs supported D3DRM (retained mode) API retired Map older runtimes onto Direct3D 9 DDIs E.g., runtimes ≤ Direct3D 8, DirectDraw Fixed-function onto shaders, etc. Direct3D9 interface matches DirectX 9.0c Same behavior as Direct3D 9 on Windows XP Maintain application compatibility

13. Direct3D9Ex DXG Kernel Kernel-Mode Driver IHV-writtencodeMicrosoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDIDXGI PIX WPF DWM User Mode Kernel Mode

14. Direct3D9Ex Enhanced version of Direct3D 9 Also known as “DX9.L” Cross-process shared surfaces “Unlimited memory” All memory resources are “managed” Resource management controls Prioritization of resources Antialiased text rendering support Monochrome texture filter with large kernel size No more “device lost” Less frequent “device removed”

15. OpenGL DXG Kernel Kernel-Mode Driver User Mode Kernel Mode IHV-writtencodeMicrosoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDIDXGI PIX WPF DWM

16. OpenGL Three options for Windows Vista Developers OpenGL 1.1 software implementation XP driver model OpenGL ICDs Not DWM-compatible, DWM shuts off 3rd party WDDM OpenGL ICDs DWM compliant Limited inbox support for application compatibility Using Direct3D 9

17. GDI/GDI+ Workhorse for Windows Presentation/UI, device control, etc. Reduced hardware acceleration in Windows Vista Necessary to accomplish WDDM implementation Continue to tune before release Continue to invest in GDI in future Protect API investment Enhance where feasible

18. Direct3D 10 And DXGI DXG Kernel Kernel-Mode Driver User Mode Kernel Mode IHV-writtencodeMicrosoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDIDXGI PIX WPF DWM

19. Direct3D 10 Next Version of Direct3D Supported in Windows Vista Proposed Premium Logo requirement Major improvements in Hardware consistency Rigorous specification, elimination of capability bits Programmer expressiveness Unified, more capable, shader programming model Flexible memory model New pipeline stages WDDM + Direct3D 10 are fundamental improvement to the Windows gaming platform

20. Direct3D 10 Additional information: DirectX Graphics: Direct3D 10 and Beyond, Sam Glassenberg

21. DXGI Separate rendering from device management DXGI (eventually) does Adapter management Display mode management Present to monitor Output management Gamma/Color Improvements of GDI 256 entry table Monitor controls Long term, subsumes functionality from GDI Currently only works with Direct3D 10

22. Desktop Window Manager New desktop experience using WPF and DirectX Uses new D3D9Ex interfaces Desktop Window Manager (DWM) Composited desktop Window movement without repainting underlying windows No more dragging garbage Client areas from applications GDI, Direct3D, WPF Video Non-client areas from the Window Manager Allows different views of application windows

23. Desktop Window Manager Supports high-dpi displays Composition with magnification Supports video playback Takes advantage of Direct3D 9 shaders For non-client areas, transitions Animated transitions, etc. New D3D9Ex cross-process shared surfaces Allows DWM to access application back buffers Turns off when certain application types running Overlay planes, front buffer rendering,…

24. Desktop Window Manager surface Desktop Window Manager WPF Application D3D Application GDI Application surface

25. Full Screen Exclusive, Multimon, And DWM Continue to allow apps to have exclusive monitor access Control video mode, gamma, etc… Desktop window manager disappears Other applications can continue to run May bump the priorities of the output-exclusive app Applications should recognize case where client area is occluded Background processing on the GPU Multiple monitors independent Composited desktop image per monitor Exclusive output independent for each monitor

26. Media APIs DXG Kernel Kernel-Mode Driver User Mode Kernel Mode IHV-writtencodeMicrosoft- written code OpenGL ICD User-Mode Driver Legacy D3D APIs Direct3D 10 D3D9OpenGL MIL Common pipeline (DDI) D3D9 Ex DX VA Media Foundation Win32 Kernel GDI DXGI PIX WPF DWM

27. Imaging Hardware accelerated photo experience 12-16Mpix @ 60 fps Builds on Direct3D 9 API Uses texture mapping + shading for image processing Rely on Shader Model 2.0 capabilities Float16 processing Lots of accelerator memory Large texture images (> 2Kx2K)

28. Video Acceleration Relies on more specialized hardware support Decode: IDCT, motion compensation Processing: Deinterlace, denoise, scale, mixing Content protection of high value data OPM, Protected Video Path Supported through DirectX Video Acceleration (DXVA) APIs Media Center and Media Player use same pipeline

29. Video Acceleration Additional information: Windows Vista Video Pipeline Architecture and Implementation, Glenn Evans; How to Implement Windows Vista Content Output Protection, Dave Marsh

30. Windows Presentation Foundation Highly integrated stack Layout, text, video, audio, imaging Builds on other parts of stack Media Foundation Imaging Direct3D 9 WCS

31. DWM And WPF Additional information: Desktop and Presentation Impact on Hardware Design, Kam Vedbrat

32. Future Technologies Warning: These are directions not commitments Continue the vision Rich graphics and media experience Available all the time to all applications Robust, efficient, applications don’t interfere Scales across mobile, desktop,… Seamless print, remote, terminal server

33. Windows Display Driver Model Lots of areas to address Move to preemptive context switching and page-level memory management ASAP WDDM 2.1 Flexible multi-GPU, linked adapters (LDA) Graphics multiprocessing Power management Boot video, VGA, ACPI/BIOS Virtual Machine support

34. Display/Device Technologies Color managed desktop Hi-def color (float16) Consumer Electronics (TV) devices Greater format coverage Multimon Improve the fullscreen/windowed experience Multi-desktop support Magnification Monitor controls DDC/CI Rationalize GDI/DXGI device control

35. Rendering Technologies Game applications Higher-def, procedural content Surface tessellation, order-independent transparency Shader expressiveness Presentation technologies Move to Direct3D 10 base by 2009? Text, antialiasing, 2D rendering Rendering quality Multicore CPU investments Process or move data faster

36. Media Technologies Imaging Direct3D 10 provides ideal base Move to “HDR” (actually 16-bit MDR) Minor improvements for additional image formats 16-bit fixed in addition to 16-bit float Video Content Protection (Protected Video Path) Glitch-resilience Preemptive context switching in WDDM 2.1 is key Hardware Encode/Analysis Background transcoding Processing HD-DVD compositing scenarios

37. General Compute (GPGPU) GPU rapidly generalizing Good at high-bandwidth, data-parallel compute Image processing, video processing, physics,… 100 GB/s, 300+ GFlops Looking at more generalized infrastructure Don’t draw triangles to trigger computations Enabled by Hardware implementation consistency Fast CPU ↔ GPU data transfer Multi-GPU support

38. Call To Action Windows Vista Hardware-accelerated graphics all the time WDDM 1.0 Direct3D 9/9Ex is everywhere – now Rapid adoption of Direct3D 10 – it delivers the future DXVA, content protection, glitch reduction Next WDDM 2.1 – efficient GPU virtualization Direct3D 10.1 – incremental changes to 10 Hi-def color, HD-DVD Greater generalization of GPU capabilities

39. Additional Resources Email: Related Sessions WDDM v2 and Beyond DirectX Graphics: Direct3D 10 and Beyond Desktop and Presentation Impact on Hardware Design How To Support Windows Color System in Printers, Displays, and Image Capture Devices DXVA 2.0: A New Hardware Video Acceleration Pipeline for Windows Windows Vista Video Pipeline Architecture and Implementation How to Implement Windows Vista Content Output Protection Directx @ microsoft.com

40. Questions?

41. © 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.