Real Time Remote Player Tutors: Dr. Shlomo Dubnov Etan Fisher Presented by: Ofer Weissblum Adar Paz.

Slides:



Advertisements
Similar presentations
Computer Fundamentals Multimedia MSCH 233 Lecture 10.
Advertisements

Part A Multimedia Production Rico Yu. Part A Multimedia Production Ch.1 Text Ch.2 Graphics Ch.3 Sound Ch.4 Animations Ch.5 Video.
IntroductionIntroduction Most musical sounds are periodic, and are composed of a collection of harmonic sine waves.Most musical sounds are periodic, and.
AN INTRODUCTION TO MAX/MSP Medialogy, Aalborg University Copenhagen. Niels Böttcher,
Audio 1 Subject:T0934 / Multimedia Programming Foundation Session:8 Tahun:2009 Versi:1/0.
SWE 423: Multimedia Systems Chapter 3: Audio Technology (2)
Sound Sensation Lab SPARK Saturdays Hui Jun Tay & Ameya Kamat.
Harmonic Series and Spectrograms 220 Hz (A3) Why do they sound different? Instrument 1 Instrument 2Sine Wave.
Sound: Audio & Music B.Sc. (Hons) Multimedia ComputingMedia Technologies.
Digital audio and computer music COS 116: 2/26/2008.
Spring 2002EECS150 - Lec13-proj Page 1 EECS150 - Digital Design Lecture 13 - Final Project Description March 7, 2002 John Wawrzynek.
BY CHRIS ANDERSON Creating a MIDI Generator Program.
A brief introduction of Real Time Streaming Protocol
Spectrum Analysis Sound AnalysisSound Analysis What are we going to do?What are we going to do? Record a soundRecord a sound recorded sound analog-to-digital.
PH 105 Dr. Cecilia Vogel Lecture 12. OUTLINE  Timbre review  Spectrum  Fourier Synthesis  harmonics and periodicity  Fourier Analysis  Timbre and.
Andrew Welds Music Technology BTEC. Examples MIDI-Karaoke (which uses the ".kar" file extension) files are an "unofficial" extension of MIDI files, used.
© 2010 Pearson Education, Inc. Conceptual Physics 11 th Edition Chapter 21: MUSICAL SOUNDS Noise and Music Musical Sounds Pitch Sound Intensity and Loudness.
Unit 01 - Set up and operate a digital audio workstation’
Harmonics, Timbre & The Frequency Domain
IGCSE ICT Communicating Ideas 2.  identify the advantages and disadvantages of using common applications to communicate ideas:  Multimedia presentations.
infinity-project.org Engineering education for today’s classroom 53 Design Problem - Digital Band Build a digital system that can create music of any.
Making a MIDI Keyboard Bob Wayne Bell, Jr. Nov. 15, 2002 EE281.
A chord is two or more notes played at the same time. For the Blues, we are going to be using a triad, which is three notes of the chord. C- C, E, G F-
By: Joel Rodriguez.  International student from Mexico  Delicias, Chihuahua Mexico  Spanish  Sports and Music.
MIDI. A protocol that enables computers, synthesizers, keyboards, and other musical devices to communicate with each other. Instead of storing actual.
Multimedia Technology Digital Sound Krich Sintanakul Multimedia and Hypermedia Department of Computer Education KMITNB.
COMP Representing Sound in a ComputerSound Course book - pages
Harmonic Series and Spectrograms
CHAPTER SEVEN SOUND. CHAPTER HIGHLIGHTS Nature of sound – Sine waves, amplitude, frequency Traditional sound reproduction Digital sound – Sampled – Synthesized.
Physics 1251 The Science and Technology of Musical Sound Unit 4 Session 37 MWF Synthesizers Unit 4 Session 37 MWF Synthesizers.
AUDIO MEDIA 1 Created } “Borrowed” } Microphone MIDI keyboard CD’s & flash drives Internet Audio Sources 2.
Signal Digitization Analog vs Digital Signals An Analog Signal A Digital Signal What type of signal do we encounter in nature?
Chapter 13: Sound & Music. Pitch and Rhythm Pitch Rhythm Pitch: how high or low we hear frequency Pitch and frequency mean the same thing, but can sound.
Sound or Audio, whichever you prefer –MIDI Files.midi or.mid (Musical Instrument Digital Interface) use for instrumental music. –This format is supported.
Introduction to Computing and Programming in Python: A Multimedia Approach Chapter 8: Making Sounds by Combining Pieces.
Creating Web Documents alt attribute Good and bad uses of ‘multimedia’ Sound files Homework: Discuss with me AND post announcement of Project II. Forms.
Wave Superposition & Timbre
Sound element Week - 11.
CH. 21 Musical Sounds. Musical Tones have three main characteristics 1)Pitch 2) Loudness 3)Quality.
Expanding Your Horizons: Physics of Music Hints
Audio / Sound INTRODUCTION TO MULTIMEDIA SYSTEMS Lect. No 3: AUDIO TECHNOLOGY.
MULTIMEDIA INPUT / OUTPUT TECHNOLOGIES INTRODUCTION 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology.
Sound Representation Digitizing Sound Sound waves through Air Different Voltages Voltage converted to numbers.
DATA AND FILE FORMATS. RTF TIFF MIDI JPEG DIB MPEG
SuperCollider Sounds, Interactive Visuals By Simon Katan For Openlab Workshops
Addison Wesley is an imprint of © 2010 Pearson Addison-Wesley. All rights reserved. Engineering Computation with MATLAB Second Edition by David M. Smith.
Constructive Interference – Result is a larger amplitude When Two Waves Meet…  Destructive Interference – Result is a smaller amplitude  Waves pass through.
Chapter 21 Musical Sounds.
Sound in Multimedia Psychology of sound what do you use it for? what techniques for its communication exist? Science of sound why does it exist? how it.
CS434/534: Mobile Computing and Wireless Networks Y. Richard Yang 08/30/2012.
Interactive Multimedia Sound Mikael Fernström. Data sources Microphones and transducers –Sample acoustic reality Synthesis –Simulate reality (and beyond.
Sound (analogue signal). time Sound (analogue signal) time.
Sound Quality.
1 Digital Audio Turning sound into bits, and bits back into sound.
12.7 Graphing Trigonometric Functions Day 1: Sine and Cosine.
Basic Acoustics. Sound – your ears’ response to vibrations in the air. Sound waves are three dimensional traveling in all directions. Think of dropping.
Data Link Layer Part I: Encoding. Network Architecture application transport network link physical message segment packet frame signal.
 Wave energy depends on amplitude, the more amplitude it has, the more energy it has.
Perceptual Scheduling in Real-time Music and Audio Applications PhD Dissertation Amar Chaudhary Lawrence A. Rowe and David Wessel, Co-Chairs University.
Lecture # 23 Sound Synthesis & Sound Arithmetic A “ sound font ” dog Jane knows Fred Ralph the loves Jane lovesFred.
Intro to Fourier Series BY JORDAN KEARNS (W&L ‘14) & JON ERICKSON (STILL HERE )
Garage Band For MAC. What is it? A digital audio workstation that can record and play back multiple tracks of audio. Is a software application for OS.
XP Practical PC, 3e Chapter 14 1 Recording and Editing Sound.
Evolution music engine Alfred E. Heggestad OPLUG 1 February 2006.
By Kyle Tatum.  MIDI (or Musical Instrumental Digital Interface) is an industry-standard protocol, first defined in 1982 by Gordon Hall, that enables.
CSC 320 – Music Instrument Digital Interface (MIDI) and Digital Audio, Spring 2017 April 2017 Dr. Dale Parson.
Timbre & Waveforms (Acoustics) Dr. Bill Pezzaglia Physics CSUEB
Lab 6: Sound Analysis Fourier Synthesis Fourier Analysis
Ms Jennifer - Senior 4 - Data Representation Introduction
Musical Notes and Sine Waves
Presentation transcript:

Real Time Remote Player Tutors: Dr. Shlomo Dubnov Etan Fisher Presented by: Ofer Weissblum Adar Paz

Project Goal To be able to play music with a colleague over a computer network

Architecture (First Try) Challenges: Real Time Real Time Quality of Sound Quality of Sound Synchronization Synchronization

Architecture (Second Try) MIDI/UDP Pitch to Midi Real Time Synthesis Off line Analysis SDIF

In Other Words Sound Analysis – LORIS Sound Analysis – LORIS –(SDIF – Sound Description Interchange Format). Pitch to Midi (Not Done Yet) Pitch to Midi (Not Done Yet) Transmission - MIDI over UDP Transmission - MIDI over UDP Sound Synthesis (Real Time Algorithms). Sound Synthesis (Real Time Algorithms). Stream Player (SDL). Stream Player (SDL). Off Line Real Time

How do we Analyze an Acoustic Instrument? OtherPhaseAmplitudeFrequencyIndex e e e Analysis to SDIF Record to the Computer Analysis

OtherPhaseAmplitudeFrequencyIndex e e e Synthesis – Sum up The Partials Synthesis From SDIF

Adding Up Sine Waves

Can You Tell the Difference? Original Piano RecordingSynthesized Partials

Shifting The Frequency CDEFGAB C#D#F#G#A# C# = C * for each half tone B= C * (1.0595) (11)

Synthesizer Real Time System Sender Receiver UDP/IP Frequency – MIDI (1Byte) Amplitude – MIDI (1Byte) MIDI to “ Shift ” Queue Stream Player

Challenges to Take on Pitch to Midi More than One Instrument at Once Server Client Architecture