1. newMediaImages newMediaImages IAT 202 2007 Class Instructor: Susan Clements-Vivian Teaching Assistant: TBA Room: TBA

2. newMediaImages Audio-Visual Analysis Used to understand the ways in which a film or video sequence works in its use of sound combined with its use of images.

3. newMediaImages The Audio-Visual Contract The combined effect of image and sound is not simply additive. Image and Sound exist as separate entities but work together. The Audio-Visual Contract remains a juxtaposition while creating a combination.

4. newMediaImages Seeing and Hearing Words help us to better understand and classify sound. Using exact words helps us confront and compare perceptions. For example: “Crackling”, “Rumbling”, or “Tremolo” denote specific sounds that can be easily discussed.

5. newMediaImages Masking A method for isolating sound and image from each other. Enables us to hear the sound unaltered and undisguised by the image. Enables us to see the image before it is recreated by the audio.

6. newMediaImages Masking: How it works Audio and Visual elements are listened to separately. After several screenings of both elements separately, you play them together. You must have an isolated sound environment removed from outside noises. You must be willing to concentrate!

7. newMediaImages Forced Marriage 1 Film/Video Sequence + Numerous Audio Accompaniments Look for synchronization points and interesting or comical juxtapositions. Only after listening to all the “wrong” audio tracks can you play the original audio back. An experimental technique to explore the audio-visual contract and its underlying potential.

8. newMediaImages Writing an Analytical Description 1.Itemize the Audio elements that are present 2.Describe the Consistency 3.Locate Synchronization Points 4.Do a Comparison

9. newMediaImages …Writing an Analytical Description Itemize the Audio elements that are present: Speech? Music? Noise?

10. newMediaImages …Writing an Analytical Description Describe the Consistency: Characterize the general quality of the sound and the degree of interaction of the various audio elements. Consistency had three components: 1.The balance of sound elements 2. The Degree of Reverberation 3. The amount and kinds of sound masking

11. newMediaImages …Writing an Analytical Description Locate Synchronization Points: These will affect the meaning and dynamics of the entire sequence.

12. newMediaImages …Writing an Analytical Description Do a Comparison: How do the audio and video compliment, contradict or duplicate each other? 1. Compare the density of image and sound 2. Compare the use of Scale, Depth and Distance 3. Identify any Audio Illusions 4. Look for Figurative Comparisons What do I see of what I hear? - Negative Images What do I hear of what I see? - Negative sounds

13. newMediaImages Retrospective Illusions Perceptual Sound: The recalled tone or content of an audio element is affected by a visual element. Suggested Sound: Remembering having heard something that was only depicted as an image. Disappearance: An element is not recalled as having existed at all. (Usually sound). Synchronization: When the audio is recalled as shifting in time with a visual element.

14. newMediaImages Pitfalls Remember that analysis is a descriptive exercise: At this point you don’t need to justify the use of the audio or its intended psychological, social or political meaning. Use precise and unambiguous language. Descriptions of audio are difficult, but the more you consider your word use the better you will covey your ideas.

15. newMediaImages An Outline for Audio-Visual Analysis Locating the dominants Locating Points of Synchronization Narrative Analysis Comparison The Audio-Visual Canvas

16. newMediaImages …An Outline for Audio-Visual Analysis Locating the dominants: What are the most important audio elements in the sequence? Music, Speech, Noise? Deren’s “Meshes of the afternoon” 1943 (4 stills)

17. newMediaImages …An Outline for Audio-Visual Analysis Locating Points of Synchronization: When does the audio match up with specific visual elements? Brakhage’s “Night Music” 1986

18. newMediaImages …An Outline for Audio-Visual Analysis Narrative Analysis: How do the stories told by the sound and image elements compare? Scott’s “Blade Runner” 1982

19. newMediaImages …An Outline for Audio-Visual Analysis Comparison: How do the form and texture of the sound and image compare? Tarlovsky’s “Stalker” 1979

20. newMediaImages …An Outline for Audio-Visual Analysis The Audio-Visual Canvas: What is the overall effect created by the audio-visual interplay? Bergman’s “Persona” 1966