1. Graphics Hardware and Graphics in Video Games COMP136: Introduction to Computer Graphics

2. Outline n History of PC graphics cards n Current PC graphics cards n Where things are going n Games, how do they do that?

3. Graphics Pipeline TransformLightingClipping Perspective DivideViewport Transform Shading and Texturing RasterizationImage

4. n 2005 – Madden 06 n 2004 – Doom 3 n 2003 – SimCity 4 n 2002 – Madden 2003 n 2000 – Madden 2001 n 1999 – Quake 3 n 1998 – Soul Calibur n 1997 – Wing Commander Prophecy n 1996 – Quake n 1995 – Wing Commander IV n 1994 – Doom 2 n 1993 – Doom n 1992 – Wolfenstein 3D n 1991 – Wing Commander 2 n 1985 – Super Mario Bros n 1983 – Star Wars arcade n 1981 – Pac man n 1978 – Space Invaders n 1972 – Pong

5. ‘72

6. ‘72

7. ‘81

8. ‘83

9. ‘85

10. ‘90

11. ‘92

12. ‘93

13. ‘94

14. ‘95

15. ‘96

16. ‘97

17. ‘98

18. ‘99

19. ‘00

20. ‘02

21. ‘03

22. ‘04

23. ‘05

24. 2006

25. ‘08

26. n 2005 – Madden 06 n 2004 – Doom 3 n 2003 – SimCity 4 n 2002 – Madden 2003 n 2000 – Madden 2001 n 1999 – Quake 3 n 1998 – Soul Calibur n 1997 – Wing Commander Prophecy n 1996 – Quake n 1995 – Wing Commander IV n 1994 – Doom 2 n 1993 – Doom n 1992 – Wolfenstein 3D n 1991 – Wing Commander 2 n 1985 – Super Mario Bros n 1983 – Star Wars arcade n 1981 – Pac man n 1978 – Space Invaders n 1972 – Pong

27. Graphics History n Utah – Texturing, BSP trees, lighting n Mainly non-interactive graphics n Interactive graphics –Initially done all in software –Dedicated hardware n Framebuffer – 1 MB, $500k n SGI n Pixel Planes – 1982 (4 x 64 processors) n Pixel Planes 4 – 512 x 512 processors n Pixel Planes 5 – 1280x1024 processors

28. PC History n Software Renderer n Graphics APIs –DOS –Windows - DirectX n v1-3 were pretty unused for 3D n v5 - people started using it for 3D n currently v10 –OpenGL n Currently 2.0 n UNIX workstation n Migrated to the PC, mainly because of QuakeGL

29. DirectX vs. OpenGL n Evolution time n Multiplatform

30. PC Graphics History n till 1994 (ATI, Matrox, etc) –accelerated 2D –some 3D acceleration, though non-standard n 1995 –3dfx released the Voodoo chip (~1 million triangles per second). –Graphics “co-processor” (you still had a 2d card) –Hardware accelerated rasterization –Textures, shading, etc. –Increased texture filtering, resolution, textures, models –GLIDE API –16 bit color and framebuffer (how does this affect things?)

31. PC Graphics History n 1996 –Quake was released –Brought OpenGL to the masses! (How?) –nVidia, ATI, 3DLabs, 3dfx, Intel –How could each one of these companies compete? –DirectX 5.0!

32. PC Graphics History n 1998 –3dfx releases Voodoo 2 (3 million triangles per second) –Two texture units. Why? Single pass multitextures! –Three major APIs: OpenGL, DirectX, GLIDE –All games now are hardware accelerated –Quake2 released –nVidia releases TNT, ATI focuses on retail, Matrox –single card solutions –32 bit color for everything (except voodoo2)

33. PC Graphics History n 1999: –3dfx Voodoo 3000 (they buy out STB) –nVidia TNT2 (300 Mpixels, 5? Million triangles) –Matrox G400 (bump mapping, etc). –How do you add features to a standard? –Late 1999: Quake 3 is released –APIs standardize: OpenGL and DirectX –Pros and Cons of each

34. 2000 n 2000: –nVidia releases GeForce and GeForce2 cards (25 million triangles per second) n 4 texture units n Hardware Transform, Clipping, and Lighting! n Per vertex shading –ATI releases Radeon n adds additional features like bump mapping, vertex skinning, 3 texture units –3dfx releases Voodoo 5500 n Full Screen Antialiasing

35. 2006 n Remaining Companies: –ATI –nVidia n Scientific Viz (High-end) –3dLabs –SGI n Consumer Market: –Billion $$$ industry –$500-600 top end card n ATI Radeon X1900 XT n GeForce 7900 GTX, SLI –$200-300 highest margins –DirectX 9.0

36. What happens on a glVertex? n Your code calls a glVertex n opengl32.dll (vendor specific) takes the command and communicates it to the card via the graphics bus n Is there hardware T,L, and C? –Yes: the vertex data is sent across the bus and the hardware pushes the vertex through the graphics pipeline –No: the CPU transforms, lights, and clips the data and THEN sends it to the card via the bus. n Why only now do we have hardware T&L&C? n What are the bottlenecks for an application? –How can we alleviate some of the bandwidth concerns? –Store vertices ON the card (or in compiled form) –Different data types like triangle fans and strips

37. Vertex and Pixel Shaders n What is limitation how the quality of CG? –Speed n What’s the fix? –Realism n What do we mean by that? n Solution? n What if we could change the functions being executed in the graphics pipeline?

38. Graphics Pipeline TransformLightingClipping Perspective DivideViewport Transform Shading and Texturing RasterizationImage

39. n Vertex Shader –A graphics processing function, which manipulates vertex data values on an X (length), Y (height) and Z (depth) 3D plane through mathematical operations on an object. n Written in assembly-like language (ex. Cg)

40. Pixel Shaders n Pixel Shaders –Programs written for pixel calculation

41. Vertex and Pixel Shaders

42. Things to consider n Memory bandwidth and speed n Framebuffer memory type n AGP, PCI-Express bus n mobile 3d graphics n Loading models and textures n Designing “family” of cards n How can we get more out of a current design? –Increase memory speed –Increase core clock speed –Driver improvements

43. Looking Forward n Per Pixel Shaders n Full screen antialiasing n Parallel Processing n Animation assistance –Skinning –Interpolation n Curved Surfaces n Collision Detection n Level of Detail n Culling n More texture units n Higher bit depths! Why would we want this?

44. Benchmarks n Triangles n Fill Rate n Refresh rate n color depths n buffer bit depth –framebuffer –z buffer –stencil buffer n Resolution capabilities –How does high refresh rate and resolutions affect the chip and memory design?

45. Cycle of development n Single Purpose n Multi-purpose

46. Tricks! How would you do: n Shafts of light n Blood n Sparks n Many lights n Trees n Forest n Flashlights n Movie projectors n Bullet holes n Rain/Snow n Motion Blur n Depth of focus n Cue Ball reflections n Airplane damage n Lens flares n Water n Skin n Clothes n Faces n Shadows

47. Let’s Examine Some Games

54. Shadows

55. Mirrors