1. The X170 protocol as a vehicle for 3D sound control Presented by Shane Haw Supervisor: Professor Richard Foss Email: g08h4123@campus.ru.ac.za

2. 1.A Brief Overview of my Research. 2.Object Orientated Approach 3.System Design 4.Demonstration 5.Future Work 6.Questions

3. Brief Overview 3D Sound Control or Sound Localization Combination of 3 technologies: – HCI (Human Computer Interaction) : A capturing of 3D coordinates – Computer Graphics: A displaying of 3D coordinates – Real-time Multimedia: converting the distances between coordinates to volumes

4. Object Oriented Approach Cyclic Approach: – Use Case Diagram – Requirements Specification – Textual Scenarios – Noun Derivations – Class Diagram / Object Model – Sequence Diagrams

5. System Design Technologies used: – HCI: The Microsoft Kinect with the Microsoft Kinect SDK (beta). – Computer Graphics: Google Sketchup with its Ruby API – Real-time Multimedia: AES-X170 Protocol

6. Overall Structure

7. Audio Networking The AES-X170 Protocol is a control protocol – Allows the accessing and setting of remote parameters, which allows the volume levels of channels to be set. – The volume parameters within the evaluation box are found at the crosspoints between the 1 st and 2 nd Bus.

8. Audio Networking

11. Computer Graphics Google Sketchup provides the means of displaying the 3D coordinates A simple, click and drag approach to building models Google Sketchup provides a Ruby API Plugin Folder Scripts can then be interacted with through the use of tcp sockets

12. Computer Graphics

13. Human Computer Interaction Microsoft Kinect The SDK released on the 24 th of June 2011 Provides skeletal tracking – Provides the 3 dimensional coordinates of several preset skeletal joints

14. Human Computer Interaction

15. Demonstration

16. Future Work The ability to edit portions of old saves Gesture recognition for track selection rather than GUI interface The adding of further speakers and some effects such as reverberation for better sound localization

17. Questions ?