SOUND AND FUNCTION: “THE FIFTH DIMENSION OF FILM” Music in Multimedia

Major Aspects  Sound and noise  Linear media and sound  Literal and non-literal sounds  Functions of sound

Sound and Noise  Both are audible vibrations  Sound has purpose  Noise is random  Audible vibrations are considered sound in media vibrationnoise

Linear Media and Sound  Film/TV: considered a visual medium whereby sound is an accompaniment  Music Video: incorporates sound as important – “sweetening” tracks with postproduction

Literal and Non-literal sounds  Literal is diegetic sound – convey a specific literal meaning. Conversations and traffic noise are common examples as referenced by action of the scene. Diegesis – telling a story  Non-literal is nondiegetic sound or sound that comes from outside the story space boings, whams, etc. Non-literal sounds can describe space, time, light, quality and events. A musical score / soundtrack outside of the location  Mix literal and non-literal to increase magnitude of screen event

Function of Sound: Information  INFORMATION: communicate specific information dialogue: between characters direct address: speaks directly to viewer narration: background story, fills in the gaps of visual, common in video documentaries

Function of Sound: Outer Orientation  OUTER ORIENTATION: space, time, to situation and to external event conditions  Space or environment (spatial characteristics) as in environmental sounds like streams or clashing dishes; effects that emphasize the space ; identifies the location, using sound dimensions (or binaural) – simulates how we hear  Time - sounds associated with clock time and the seasons; predictive sound (segues from party music to dark or somber music creates anticipation of imminent danger to viewer) leitmotiv (short musical phrase that leads the audience to expect a recurring phenomenon)  Situation – sound that reinforces a scene (irregular breathing with shocked view of a physician’s face)  External Event – sounds indicates the characteristic of a character, object or scene: size, texture, location, quality (old or new), and speed

Function of Sound: Inner Orientation  INNER ORIENTATION: includes sounds related to mood, internal condition, energy and structure  Mood – directly influenced by choice of music; musical cues override visual field ---- mother kissing a child – upbeat music implies happy feel; haunting music indicates fear and that something terrible will happen to either child or mother  Internal Condition – reflect emotional state of person or scene --- with background audio or with effects that strengthen the feel  Energy – music and non-literal sounds increase the aesthetic energy of a scene. Think of sound effects used in a video game and how they make the experience more relevant.  Structure – Maintain a rhythmic structure with a continuity of beats or pace

WHAT ARE THE OTHER VISUAL DIMENSIONS? 1. Light and Color 2. Area as two dimensional space; static and dynamic 3. Depth of field: Z axis. 4. Time in relation to motion and continuity Excerpts from Herbert Zettl: Sight Sound Motion; Applied Media Aesthetics – Chapters 17 and 18 Purchase individual chapters: