Evolution music engine Alfred E. Heggestad OPLUG 1 February 2006.

Slides:



Advertisements
Similar presentations
Multimedia: Digitised Sound Data Section 3. Sound in Multimedia Types: Voice Overs Special Effects Musical Backdrops Sound can make multimedia presentations.
Advertisements

Audio Programming With Python Copyright © Software Carpentry 2011 This work is licensed under the Creative Commons Attribution License See
Sound in multimedia How many of you like the use of audio in The Universal Machine? What about The Universal Computer? Why or why not? Does your preference.
4.1Different Audio Attributes 4.2Common Audio File Formats 4.3Balancing between File Size and Audio Quality 4.4Making Audio Elements Fit Our Needs.
GCSE Computing#BristolMet Session Objectives#10 MUST define the term sample rate COULD explain how sound can be sampled and stored in digital form SHOULD.
1 Multimedia on the Web: Issues of Bandwidth Bandwidth is a measure of the amount of data that can be sent through a communication pipeline each second.
Chapter 4: Representation of data in computer systems: Sound OCR Computing for GCSE © Hodder Education 2011.
Int 2 Multimedia Revision. Digitised Sound Analogue sound recorded from person, or real instruments.
I Power Higher Computing Multimedia technology Audio.
CHAPTER 16 Audio © 2008 Cengage Learning EMEA. LEARNING OBJECTIVES In this chapter you will learn about: – –The fundamentals of sound – –DirectX Audio.
Eee116j1 1 Digital Information Engineering Science EEE116J1 Prof Paul Maguire w.
31/1/2002Brunel University - BEng Final Year Project1 Hospital Radio Interactive Play-out System Jonathan Hart Supervisor: Dr John Cosmas.
Image and Sound Editing Raed S. Rasheed Digital Sound Digital sound types – Monophonic sound – Stereophonic sound – Quadraphonic sound – Surround.
Digital audio recording Kimmo Tukiainen. My background playing music since I was five first time in a studio at fourteen recording on my own for six months.
Audio Basic Concepts. Audio in Multimedia Digital Audio: Sound that has been captured or created electronically by a computer In a multimedia production,
Image and Sound Editing Raed S. Rasheed Sound What is sound? How is sound recorded? How is sound recorded digitally ? How does audio get digitized.
Content-Based Classification, Search & Retrieval of Audio Erling Wold, Thom Blum, Douglas Keislar, James Wheaton Presented By: Adelle C. Knight.
EE442—Multimedia Networking Jane Dong California State University, Los Angeles.
BPC: Art and Computation – Summer 2007 Digital Media – Audio, part 2 Robert Putnam
Java Audio.
Chapter 1: Introduction Business Data Communications, 4e.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
5. Multimedia Data. 2 Multimedia Data Representation  Digital Audio  Sampling/Digitisation  Compression (Details of Compression algorithms – following.
Chapter 9 Audio.
Digital Audio Multimedia Systems (Module 1 Lesson 1)
CoachTurner Vontay Graves DIGITAL AND ANALOG AUDIO.
2 Outline Digital music The power of FPGA The “DigitalSynth” project –Hardware –Software Conclusion Demo.
Representation of Data in Computer Systems
Digital Sound and Video Chapter 10, Exploring the Digital Domain.
Introduction to Interactive Media 10: Audio in Interactive Digital Media.
MIDI. A protocol that enables computers, synthesizers, keyboards, and other musical devices to communicate with each other. Instead of storing actual.
COMP Representing Sound in a ComputerSound Course book - pages
Audio. Why Audio Essential tool for – Interface – Narrative – Setting & Mood.
CHAPTER SEVEN SOUND. CHAPTER HIGHLIGHTS Nature of sound – Sine waves, amplitude, frequency Traditional sound reproduction Digital sound – Sampled – Synthesized.
Analogue vs Digital. Analogue  Lots of different frequencies, lots of different amplitudes  Wave recorded as it is.
Signal Digitization Analog vs Digital Signals An Analog Signal A Digital Signal What type of signal do we encounter in nature?
Sound on the Web. Using Sound on a Web Site Conveying information  pronounce a word or describe a product Set a mood  music to match the web page scene.
Creating Web Documents alt attribute Good and bad uses of ‘multimedia’ Sound files Homework: Discuss with me AND post announcement of Project II. Forms.
Multimedia Technology and Applications Chapter 2. Digital Audio
Sound element Week - 11.
MULTIMEDIA INPUT / OUTPUT TECHNOLOGIES INTRODUCTION 6/1/ A.Aruna, Assistant Professor, Faculty of Information Technology.
© 2011 The McGraw-Hill Companies, Inc. All rights reserved Chapter 4: Sound.
Peer to Peer Network Design Discovery and Routing algorithms
Interactive Multimedia Sound Mikael Fernström. Data sources Microphones and transducers –Sample acoustic reality Synthesis –Simulate reality (and beyond.
Expanding Moodle ’ s multimedia capabilities MoodleMoot 2010 Hakodate Paul Daniels Kochi University of Technology.
Glencoe Introduction to Multimedia Chapter 8 Audio 1 Section 8.1 Audio in Multimedia Audio plays many roles in multimedia. Effective use in multimedia.
How to Create a Podcast. Podcasting “is the distribution of audio or video files, such as radio programs or music videos, over the Internet using either.
Multimedia Systems Dr. Wissam Alkhadour.
INTERNET PROTOCOL TELEVISION (IP-TV)
Chapter 8 Sound FX Composition. Chapter 8 Sound FX Composition.
Chapter 15 Recording and Editing Sound
Objective % Explain concepts used to create digital audio.
Image and Sound Representation
Multimedia: Digitised Sound Data
Data Compression.
Food Inventory Tracker
Objective % Explain concepts used to create digital audio.
                      Digital Audio 1.
Multimedia: making it Work
Lecture 28 Closing it Out.
Data Representation Keywords Sound
Overview What is Multimedia? Characteristics of multimedia
Chapter 4: Representing sound
Populations Change Over Time through Natural Selection
Recap In previous lessons we have looked at how numbers can be stored as binary. We have also seen how images are stored as binary. This lesson we are.
Objective Explain concepts used to create digital audio.
Digital Audio Application of Digital Audio - Selected Examples
Chapter 9 Audio.
For Podcasts and Other Media
Presentation transcript:

Evolution music engine Alfred E. Heggestad OPLUG 1 February 2006

TOC ● OPLUG ● Sound theory ● Evolution ABC ● P2P Networking ● The idea ● Discussion

OPLUG ● Oslo Pils and Linux User Group ● Founded october 2002 by richard and alfredh ● Meets 1 st Wednesday every month in a pub ● Open forum for creative ideas ● No political agenda, no budget ;) ● More info at

Sound theory ● Sound waves ● Sine waves, square waves, triangular waves ● Tones: sine waves of different frequency ● Digital music: N-samples of varying amplitude ● CD quality is 44.1 kHz 16-bit

Sound therory ● Basic two types: - raw sound (samples) - synthesized sound (e.g. midi) ● Raw sound - large files with samples (low-level) - can describe anything !!! ● Synthesized sound - smalled files descring tones (high-level) - limitation to what can be described (e.g. speech)

Evolution ● Charles Darwin theory ● Survival of the fittest ● Genetic fingerprint (DNA) describe building blocks ● DNA passed on to next generation (iterations) ● Mutations lead to variations ● Is evolution global or universal? ● Can it be applied to other fields?

P2P networking ● Distributed networks ● Direct client-to-client communication ● No centralized server ● NAT issues? ● Data storage

Combine these: The idea ● Evolution music engine... ● An application or device ● Communicates with other peers through TCP/IP ● Bi-directional sound streaming with feedback ● Adaptive algorithms for evolutionary selection ● General statistics and information

Architecture

Architecture - details

Modules - sampler ● Samples audio from microphone in real-time ● Length is up to the user ● Audio fragment gets a global unique ID and descr. ● Sent uplink to network cloud

Modules – audio generator ● Generates random audio of varying length ● Audio fragment sent uplink to network cloud ● Can also be located in network ● What about a random MIDI generator?

Module – playback ● Very simple playback module! ● Plays the audio broadcast on your speaker ● Compressed broadcast (ogg vorbis?)

Module – feedback module ● Provide feedback from user to network ● Feedback sources: - keyboard (e.g. Space=good ESC=bad) - mouse - volume control (up=good, down=bad) - no feedback (listener fell asleep...zzz...) ● Feedback on current broadcast

Concepts ● Mixing and source selection is done in network ● Design should not limit client implementation: - new adaptive algorithms can be implemented on the client ● Audio stream fragments are stored and reused: - tagged with global unique ID - genetic mixing and feedback - iterative rounds in evolutionary cycles

Issues ● Storage - after some time the amount of data accumulated will be immense! ● Audio formats? ● Real-time encoding? ● Copyright? (DRM!)

Extending features ● Multiple channels (profiles) ● User identity distribution ● Financial reward – click to pay NOK 1,-

Use cases ● Party function

Other fields ● Evolutionary recipes? - generate a random recipe - make the food - send feedback to system

Discussion ● thanks for listening the whole talk was recorded and broadcasted via EME...