Real Time Remote Player Tutors: Dr. Shlomo Dubnov Etan Fisher Presented by: Ofer Weissblum Adar Paz
Project Goal To be able to play music with a colleague over a computer network
Architecture (First Try) Challenges: Real Time Real Time Quality of Sound Quality of Sound Synchronization Synchronization
Architecture (Second Try) MIDI/UDP Pitch to Midi Real Time Synthesis Off line Analysis SDIF
In Other Words Sound Analysis – LORIS Sound Analysis – LORIS –(SDIF – Sound Description Interchange Format). Pitch to Midi (Not Done Yet) Pitch to Midi (Not Done Yet) Transmission - MIDI over UDP Transmission - MIDI over UDP Sound Synthesis (Real Time Algorithms). Sound Synthesis (Real Time Algorithms). Stream Player (SDL). Stream Player (SDL). Off Line Real Time
How do we Analyze an Acoustic Instrument? OtherPhaseAmplitudeFrequencyIndex e e e Analysis to SDIF Record to the Computer Analysis
OtherPhaseAmplitudeFrequencyIndex e e e Synthesis – Sum up The Partials Synthesis From SDIF
Adding Up Sine Waves
Can You Tell the Difference? Original Piano RecordingSynthesized Partials
Shifting The Frequency CDEFGAB C#D#F#G#A# C# = C * for each half tone B= C * (1.0595) (11)
Synthesizer Real Time System Sender Receiver UDP/IP Frequency – MIDI (1Byte) Amplitude – MIDI (1Byte) MIDI to “ Shift ” Queue Stream Player
Challenges to Take on Pitch to Midi More than One Instrument at Once Server Client Architecture