Presentation is loading. Please wait.

Presentation is loading. Please wait.

27th Tonmeistertagung 2012 22nd November 2012, Cologne

Published byJonas Reeves Modified over 6 years ago

Similar presentations

Presentation on theme: "27th Tonmeistertagung 2012 22nd November 2012, Cologne"— Presentation transcript:

1 A Hybrid Acquisition Approach for the Recording of Object-Based Audio Scenes
27th Tonmeistertagung 2012 22nd November 2012, Cologne Christian Hartmann1, Michael Weitnauer1, Chungeun Kim2 1Institut für Rundfunktechnik / 2University of Surrey A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

2 Topic Overview The ROMEO project Object-based audio transmission
Object-based capturing techniques A hybrid recording concept for ROMEO A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

3 The Partners in The ROMEO project Project partners
A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

4 ROMEO project goals - Get P2P and broadcast in sync
The ROMEO project Project goals ROMEO project goals DVB transmission - Get P2P and broadcast in sync - Provide 3D multi-view video and spatial audio for diverse playback systems P2P transmission a/v-media A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

5 ROMEO audio concept The ROMEO project ROMEO audio concept
basic service DVB low-performance end unser terminals with rather slow network connection basic service channel based audio fallback solution additional service P2P additional service object oriented audio high-performance end user terminal with high bandwidth network connection A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

6 conventional audio signal
Object-based audio transmission Object oriented audio Object oriented audio transmission audio information . . . audio information spatial information clean audio signal conventional audio signal transmission spatial information . . . metadata position directivity object trajectories . . . A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

7 Technical implementation
Object-based audio transmission Technical implementation Technical implementation A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

8 Benefits of object oriented audio
Object-based audio transmission Benefits of object oriented audio Benefits of object oriented audio - Ease of scalability - object-oriented data is adaptable to almost every playback system - Objects can be encoded separately and dependent on their importance (QoE) - Higher information level – channel based audio can easier be gained from object oriented original data than vice versa. - High effort to capture complex acoustic scenes with multiple or moving sound sources A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

9 Temporal components of the sound field
Object based capturing techniques Temporal components of the sound field Temporal components of the sound field Components of the sound field [Theile, Wittek 2011] A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

10 Data based capturing Object based capturing techniques
spherical loudspeakers DAW source 1 source 2 source 3 source 4 IR measurement with microphone array repetition for every sound source stimulus (MLS, sweep, white- or pink noise) wave field extrapolation or plane wave decomposition convolution with clean audio signals microphone array for IR capturing A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

11 Model based capturing Object based capturing techniques
algorithmic creation of early reflections and reverberation convolution with clean audio signals 3D room simulation A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

12 Stereophonic capturing methods for ambient sound
Object based capturing techniques Stereophonic capturing methods Stereophonic capturing methods for ambient sound conventional recording after stereophonic principle tagging as ambient source free field rendering A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

13 Venue of the field trial
A hybrid recording concept for ROMEO Venue of the field trial Venue of the field trial - Studio 3 of Bayerischer Rundfunk (BR), Munich - “Trio sonata in c minor” by Georg Phillip Telemann - Dimensions of the room: 7,2m x 15m x 8,75m - Reverberation time (200Hz Hz): Tm = 0,95sec - Reverberation radius: ca. h = 1, 8m. A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

14 Spot microphones A hybrid recording concept for ROMEO Spot microphones
A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

15 Spot microphones A hybrid recording concept for ROMEO Spot microphones
A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

16 Virtual listening area
A hybrid recording concept for ROMEO MARVIN Spatial mixing of main microphones virtual acoustics modelled virtual source 1 violin Recording area Virtual listening area Recording principle Mixing principle A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

17 Virtual Panning Spots (VPS)
A hybrid recording concept for ROMEO Virtual Panning Spots Virtual Panning Spots (VPS) A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

18 Virtual Panning Spots (VPS)
A hybrid recording concept for ROMEO Virtual Panning Spots Virtual Panning Spots (VPS) source end user terminal source stereophonic mix audio objects listening zone A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

19 Advanced main microphone techniques
A hybrid recording concept for ROMEO Main microphone techniques Advanced main microphone techniques A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

20 Advanced main microphone techniques
A hybrid recording concept for ROMEO Main microphone techniques Advanced main microphone techniques IRTs spherical surface microphone “MARVIN” optimized cardioid triangle with 9 channels (OCT9) A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

21 Virtual listening area
A hybrid recording concept for ROMEO MARVIN Spatial mixing of main microphones free field sources 8 Recording area Virtual listening area Recording principle Mixing principle A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

22 Surround microphone techniques
A hybrid recording concept for ROMEO Surround microphone techniques Surround microphone techniques A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

23 Surround microphone techniques
A hybrid recording concept for ROMEO Surround microphone techniques Surround microphone techniques Hamasaki Square for capturing natural reverberation A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

24 Virtual listening area
A hybrid recording concept for ROMEO Surround microphone techniques Spatial mixing of surround microphones Recording area Virtual listening area 11 atmo sources Recording principle Mixing principle A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

25 Monitoring and post-production
A hybrid recording concept for ROMEO Monitoring and post-production Monitoring and post-production - Use of IRTs own Motion Tracked Binaural system for monitoring during the recording session - First attempts of object based mixing and rendering with the help of SoundScape Renderer framework - First experiments show: Hybrid recording and rendering approach leads to competitive mixing results A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

26 Public licensed content for spatial audio mixing
A hybrid recording concept for ROMEO Public licensed content Public licensed content for spatial audio mixing - 40 microphone tracks; all kind of microphone setups - Detailed documentation for mixing purposes - free for non-commercial use - available in the coming days A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

27 http://romeo-3daudio.irt.de/ ROMEO Redmine
A hybrid recording concept for ROMEO ROMEO Redmine ROMEO Redmine A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

28 Thank you for your attentention!
Christian Hartmann Production Systems Audio Institut für Rundfunktechnik Floriansmühlstraße 60 80939 Munich, Germany Phone: +49-(0) Fax: +49-(0) The slides / documents are subject to the copyright and other laws for the protection of intellectual property. Copying, editing and dissemination requires the explicit written agreement of the author. This Copyright marking may not be removed or altered. A Hybrid Acquisition Approach for Object-Based Audio Scenes 22nd November 2012 © IRT – Christian Hartmann

Download ppt "27th Tonmeistertagung 2012 22nd November 2012, Cologne"

Similar presentations

© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.

© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
Fundamentals of Audio Production. Chapter 16 1 Fundamentals of Audio Production Chapter Sixteen: Sound for Pictures.

Fundamentals of Audio Production. Chapter 16 1 Fundamentals of Audio Production Chapter Sixteen: Sound for Pictures.
3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.

3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.
 Speech  Narration—also called voice overlay or voice track  Dialogue—between two or more characters  Direct Address—talking straight at the camera.

 Speech  Narration—also called voice overlay or voice track  Dialogue—between two or more characters  Direct Address—talking straight at the camera.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.

Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
Slide title 44 pt Text and bullet level 1 minimum 24 pt Bullets level 2-5 minimum 20 pt Characters for Embedded font: !#$%&'()*+,-./0123456789:;

Slide title 44 pt Text and bullet level 1 minimum 24 pt Bullets level 2-5 minimum 20 pt Characters for Embedded font: !"#$%&'()*+,-./ :;
Reflections Diffraction Diffusion Sound Observations Report AUD202 Audio and Acoustics Theory.

Reflections Diffraction Diffusion Sound Observations Report AUD202 Audio and Acoustics Theory.
Motivation Application driven -- VoD, Information on Demand (WWW), education, telemedicine, videoconference, videophone Storage capacity Large capacity.

Motivation Application driven -- VoD, Information on Demand (WWW), education, telemedicine, videoconference, videophone Storage capacity Large capacity.
Audio Basic Concepts. Audio in Multimedia Digital Audio: Sound that has been captured or created electronically by a computer In a multimedia production,

Audio Basic Concepts. Audio in Multimedia Digital Audio: Sound that has been captured or created electronically by a computer In a multimedia production,
Copyright © 2010 Pearson Education InternationalChapter 7 - 1 Crafting Messages for Electronic Media.

Copyright © 2010 Pearson Education InternationalChapter Crafting Messages for Electronic Media.
A Framework for Haptic Broadcasting Presented by Cong Ly CMPT-820 March 16, 2009 Jongeun Cha, Ian Oakley, Yo-Sung Ho, Yeongmi Kim, and Jeha Ryu.

A Framework for Haptic Broadcasting Presented by Cong Ly CMPT-820 March 16, 2009 Jongeun Cha, Ian Oakley, Yo-Sung Ho, Yeongmi Kim, and Jeha Ryu.
Project Presentation: March 9, 2006

Project Presentation: March 9, 2006
1 Dong Lu, Peter A. Dinda Prescience Laboratory Computer Science Department Northwestern University Virtualized.

1 Dong Lu, Peter A. Dinda Prescience Laboratory Computer Science Department Northwestern University Virtualized.
1 Ambisonics: The Surround Alternative Richard G. Elen The Ambisonic Network.

1 Ambisonics: The Surround Alternative Richard G. Elen The Ambisonic Network.
CHAPTER 7 SOUND. CHAPTER OBJECTIVES Examine the role of Sound in Video Production; Survey the tools for Sound Recording and Design; Explore the process.

CHAPTER 7 SOUND. CHAPTER OBJECTIVES Examine the role of Sound in Video Production; Survey the tools for Sound Recording and Design; Explore the process.
1/19 Philip Coleman, Philip J. B. Jackson, Marek Olik Centre for Vision, Speech and Signal Processing, University.

1/19 Philip Coleman, Philip J. B. Jackson, Marek Olik Centre for Vision, Speech and Signal Processing, University.
Bus. Computer Applications Supervised by: t. Ahmed Abu msameh Prepared by Mohammed fathi al – amawi ID :120090010 CCTV systems.

Bus. Computer Applications Supervised by: t. Ahmed Abu msameh Prepared by Mohammed fathi al – amawi ID : CCTV systems.
L INKWITZ L AB Accurate sound reproduction from two loudspeakers in a living room 13-Nov-07 (1) Siegfried Linkwitz.

L INKWITZ L AB Accurate sound reproduction from two loudspeakers in a living room 13-Nov-07 (1) Siegfried Linkwitz.
Tricaster STUDIO TM An easy tool to promote knowledge! 1.

Tricaster STUDIO TM An easy tool to promote knowledge! 1.
Campus Technology 08 Shootout! Bracing for the Next-Gen Student Wave: Myth or Mandate? Next-Gen Students “Speak Up” – Are we listening? Julie Evans Project.

Campus Technology 08 Shootout! Bracing for the Next-Gen Student Wave: Myth or Mandate? Next-Gen Students “Speak Up” – Are we listening? Julie Evans Project.

Similar presentations

Ads by Google