Mobile Agents Using Sound Daniel Hägglund

Agenda Background System concept Design Implementation Summary Questions

Background Mobile agents Audio analysis

Mobile Agents Mobile code Autonomous Reactive

Audio Analysis Sound matching Speech recognition

System Concept Track a moving sound source by listening to the sounds it emits and migrate through the network in order to always stay close to it.

System Concept

Record sounds Identify a particular sound Determine the closest listener Activate listeners on adjacent hosts

Design Activate Report sound Nearest Adjacent Sound

Implementation Java Grasshopper 2 IBM ViaVoice

Implementation

Graphical display Start button Selected Adjacent

Implementation Status bar Current Region Hosts Nearest host

Implementation Manual set-up Recognises predefined words Distributed identification of sounds Uses volume to choose nearest host Migrates through the network What It Does

Implementation Cannot handle dynamic networks Does not recognise anything but words Unable to send audio data over network Inaccurate estimation of nearest host What It Doesn’t

Implementation 20 classes and interfaces 2,000 lines of code

Summary Possible Somewhat limited functionality

Questions?