Yakir Dahan Vitali Sepetnitsky Royi Freifeld
Project Goals Challenges Main Steps Technologies Schedule
Sightless navigation by sensory substitution › Development of an application that allows a person to navigate, relying primarily on the sense of hearing Development of spatial auditory environment Providing a flexible testing environment for future research
3D sound generation › Choosing / generating sound samples that on one hand will reveal as much information as possible about the visual objects and on the other hand will be intuitive (easily interpreted). Image analysis › Applying a reliable object tracking mechanism
Shapes detection Objects tracking Sounds creation (according to a 3D image) Human subject research
Image processing › OpenCV 3D sound generation and processing › Binaural spatialization using HRTF datasets › OpenAL (Creative Labs / Rapture3D) › JavaSound3D › DirectSound3D
Summer 2010 – Theoretic research › Learning and testing 3D sound & image technologies October – November › Choosing technologies › System architecture › Application Requirements Document draft December – January 2011 › Final version of ARD › Working on prototype
February – March › Final prototype › Application Design Document draft › Application development April - May › Final version of ADD › Application testing and experiments conduction June › Preparation to the Projects day