CSE5900: Introduction to MM Computing -- Lecture Multimedia Production: Top Down & Bottom Up

CSE5900: Introduction to MM Computing -- Lecture Multimedia Development Isn’t Like IT Development We will look at –The organisation and logistics of multimedia production –The computer tools which are used to create and assemble the different parts of the production Typically, multimedia does not follow the standard IT production cycles The way a film is produced is a better model

CSE5900: Introduction to MM Computing -- Lecture IT Development –The SDLC/Waterfall/Spiral/Incremental development models are appropriate –There are a small number of roles in IT system development, which are closely related in tools used and knowledge required Manager Data modeller Systems analyst Programmer User interface specialist Tester Documenter –These roles tend to be sequential in time –Creativity is limited, both in extent and to a few of the roles –(Creativity is much less important than other aspects of the process)

CSE5900: Introduction to MM Computing -- Lecture IT Development, 2 The tools used are small in number –Perhaps a modelling/diagramming product –DBMS –Project planning/documenting software –Word processor –Programming language(s) with IDE –Version control software Again, the tools are closely related in the knowledge required to use them. While people specialise in different roles, a career tends include a number of different roles –Programmer  analyst  manager

CSE5900: Introduction to MM Computing -- Lecture IT Development, 3 –There are only a few specialist roles: Data communications specialist Sometimes consultant data modeller Sometimes consultant analyst Sometimes an interface/interaction consultant

CSE5900: Introduction to MM Computing -- Lecture MM Development, 1 Contrast this to the roles in MM –Script writer –Actor/Character/Motion Capture Actor –Voice over –Video creation director –Video editor –Composer –Musician (manual or electronic) –Sound and music editor –Graphic Designer –Computer artist -- 2D –Computer artist -- 3D and/or animation –Non linear editor –Director –Producer –And most of the IT roles given earlier!!!!!

CSE5900: Introduction to MM Computing -- Lecture MM Development, 2 Note that most of these roles do not overlap –Many roles require a unique skill set –Many of the processes overlap, happen in parallel –Many of the roles provide a small, discrete contribution –The problems of organisation, coordination and supervision are enormous. All this sounds more like a movie, rather than a computer system!

CSE5900: Introduction to MM Computing -- Lecture MM Development, 3 The credits for a movie are in the reverse order of importance –Last comes the director –Next to last is the producer (But this sequence is just to keep the director happy. Directors are hired and supervised by the producer!) –Very late the following come: Writer Art director Cinematographer Editor –Even earlier come the more technical roles (What’s a “best boy”? A “gaffer”? A “grip”? A “wrangler?” A “Foley artist”? A “Set Dresser”? A “Focus Puller”?)

CSE5900: Introduction to MM Computing -- Lecture MM Development, 4 Multimedia productions (with the exception of games) cost a lot less than films. –Games cost as much as “independent” (cheap) films Many of the roles are combined. Most of them are “farmed out” In my company we had: –A director/producer/writer (who is overloaded) –A 2D artist –A programmer/analyst (me!) –All the other roles weree “farmed” (contracted) out

CSE5900: Introduction to MM Computing -- Lecture MM Development, 5 In a typical production, we hired: –A 3D/animation company –A video studio with cameraman –Actors or clients who do the presentation –An editing company using a nonlinear editing suite –An editing company to assemble the product, including music Our primary roles were: –Creative Design, write, schedule and coordinate the production Create cover art and coordinate printing, pressing and packaging Work with our customer to make sure we did what they wanted –Programming Standalone components linked in code to presentation Integrated code which is part of the presentation

CSE5900: Introduction to MM Computing -- Lecture MM Development, 6 Note: –Our productions were small scale, usually costing less than $100k, not counting the costs of pressing the CDs –Often we created two versions For in house use For public distribution –We dealt with some areas (like music) by buying off-the-shelf canned product. Jargon: –The bits and pieces assembled together are called assets in the business. This is because They cost money! You’d like to be able to reuse them!

CSE5900: Introduction to MM Computing -- Lecture The Tools 2D Art –Vector art Adobe Illustrator, Freehand, Corel Draw Flash –Raster art Adobe Photoshop 3D Art/Animation –Pro Am 3D Studio Max – aka 3dsmax ($5,000 + add ons) Lightwave 3D ($3,000 + add ons) –Pro Desktop Alias Wavefront Maya ($4,000/$15,000 + add ons) –Pro Movies Renderman –Note: all these prices are per workstation. Most products require enough add ons to triple the price at least

CSE5900: Introduction to MM Computing -- Lecture The Tools, 2 For Reference –Silicon Graphics Reality Engine $2,000,000 in 1992 Size of refrigerator –Far less graphics power than the current Nvida graphics card Specialised Silicon Graphics machines –Were the tools of necessity –Now are almost unwanted Pixar Renderman –Software of choice for motion picture animation –Can run on multiple computers –Toy Story #1 averaged 7 hours rendering per frame (Some frames up to 90 hours) –Shrek = 800k polygons per character

CSE5900: Introduction to MM Computing -- Lecture Tools, 3 Non-Linear Editors –Media 100 –Avid –Used Macintosh hardware plus special video capture hardware, super SCSI disks, etc., etc. What is a non-linear editor? –Can take lots of chunks of video, music and sound –Put them all onto hard disk (big hard disk) –Assemble them together –(Non-linear because of the way you used to have to do it, splicing together bits of film or video tape. All the chunks were linear, as was the process.) With increase of desktop power, price of NLE suites in freefall.

CSE5900: Introduction to MM Computing -- Lecture Tools, 4 Further Standard Video Tools –Adobe After Effects –Adobe Premier –Final Cut Pro –Media Cleaner These both supplement and replace Avid and/or Media 100. The future: –[I can do a whole lecture on the last 3 slides if you want]

CSE5900: Introduction to MM Computing -- Lecture Some Common 3D Graphics Jargon Bézier Curve B-spline NURB –Nonuniform rational B-spline (ghasp!) Sub-d: –Subdivision Surfaces