The Mazurka Project Science and Music Seminar University of Cambridge 28 Nov 2006 Craig Stuart Sapp Centre for the History and Analysis of Recorded Music.

Slides:



Advertisements
Similar presentations
Patient information extraction in digitized X-ray imagery Hsien-Huang P. Wu Department of Electrical Engineering, National Yunlin University of Science.
Advertisements

The organization of sound in time
Chapter 2: Rhythm and Pitch
ACT Test Prep Reading Strategies with Mr. Boesch.
Software Development Languages and Environments. Programming languages High level languages are problem orientated contain many English words are easier.
Recording-based performance analysis: Feature extraction in Chopin mazurkas Craig Sapp (Royal Holloway, Univ. of London) Andrew Earis (Royal College of.
Introducing the Mazurka Project Nick Cook and Craig Stuart Sapp Music Informatics research group seminar School of Informatics, City University, London.
I Power Higher Computing Multimedia technology Audio.
LMMS is a digital audio workstation that allows you to produce instrumental songs. LMMS stands for Linux MultiMedia Studio. The software was originally.
The frequency spectrum
Outline Introduction Music Information Retrieval Classification Process Steps Pitch Histograms Multiple Pitch Detection Algorithm Musical Genre Classification.
Mazurka Project Update Craig Stuart Sapp CHARM Symposium Kings College, University of London 26 January 2006.
Reverse Conducting Slides Mazurka Project Presentation Materials Version: 14 November 2005.
Audio to MIDI Converter Team Obama Advisor: Dr. William Hunt Adnan Burkic Sean Earley Jon Kump Brian Tyson Georgia Institute of Technology 4/27/2010.
Look Ma, No Keyboard user interface: Tools for music pre-production Current Developments Applying the principles to other music instruments Continuing.
 Guido d’Arezzo was the first to create music notation  Finale version 1.0 was created in 1988.
Automatic Camera Calibration for Image Sequences of a Football Match Flávio Szenberg (PUC-Rio) Paulo Cezar P. Carvalho (IMPA) Marcelo Gattass (PUC-Rio)
GarageBand Basics: “Getting the Band Back Together” Nick Gogno Technology Applications for the Classroom Nick Gogno Technology Applications for the Classroom.
CHARM Advisory Board Meeting Institute for Historical Research, School of Advanced Study, UL Senate House, London 12 Dec 2006 Craig Stuart Sapp Centre.
What are graphic scores?
IGCSE ICT Communicating Ideas 2.  identify the advantages and disadvantages of using common applications to communicate ideas:  Multimedia presentations.
infinity-project.org Engineering education for today’s classroom 53 Design Problem - Digital Band Build a digital system that can create music of any.
Computer Science : Information Systems Design and Development Unit Web Sites - National 4 / 5 St Andrew’s High School-Revised January 2013 Slide 1 St Andrew’s.
Similarity Measurements in Chopin Mazurka Performances Craig Stuart Sapp C4DM Seminar, 11 July 2007 Queen Mary, University of London.
Course 4: Using AdvancedWell Editor Tools. Log curves are resampled.
Beat-level comparative performance analysis Craig Stuart Sapp CHARM Friday the 13 th of April 2007 CHARM Symposium 4: Methods for analysing recordings.
컴퓨터 전자음악 입문 10 주차 Tutorials 4 Editing MIDI. Tutorial Tutorial 1 - Basics Tutorial 2 - Recording MIDI Tutorial 3 - Recording Digital Audio Tutorial 4 -
Performance Authenticity: A Case Study of the Concert Artist Label Association of Recorded Sound Collections Conference Stanford University 28 March 2008.
The Mazurka Project Craig Stuart Sapp Centre for the History and Analysis of Recorded Music Royal Holloway, Univ. of London Universiteit van Amsterdam.
WHAT IS TRANSCRIBE! ? Transcribe! is computer software that was designed to help people transcribe music from recordings. Transcribe- Learning to play.
Applications Statistical Graphical Models in Music Informatics Yushen Han Feb I548 Presentation.
MCM Technical Presentation1 Sal Ledezma, Jimar Garcia, Gene Wie, Cayci Suitt.
Song Pro Retro Alex Harper. Contents of Presentation Inspiration Basic Concept Speaker Module.sng file structure Song Pro Retro: Light Song Pro Retro:
Paper by Craig Stuart Sapp 2007 & 2008 Presented by Salehe Erfanian Ebadi QMUL ELE021/ELED021/ELEM021 5 March 2012.
Digital recording software Presented by Andrew Littlefield.
Super Power BTE A great new Trimmer Family. The new & complete, fully digital Trimmer family ReSound is proud to introduce the complete new trimmer family,
FlowString: Partial Streamline Matching using Shape Invariant Similarity Measure for Exploratory Flow Visualization Jun Tao, Chaoli Wang, Ching-Kuang Shene.
JSymbolic Cedar Wingate MUMT 621 Professor Ichiro Fujinaga 22 October 2009.
11 Applications of Machine Learning to Music Research: Empirical Investigations into the Phenomenon of Musical Expression 이 인 복.
ENOMA - European Network of Online Musical Archives ENOMA Workshop – The Grieg Academy, UiB 26 May 2006 Leif Arne Rønningen and Lars Erik Løvhaug NTNU.
Elements of Music. MELODY  Melody is the part of the music you can sing. To play or sing a melody, there can only be one note at a time. It is also known.
CHARM Symposium Kings College London 6 January 2006 The Mazurka Project.
Using Traveling Salesman Problem Algorithms to Determine Multiple Sequence Alignment Orders Weiwei Zhong.
Mazurka Project 29 June 2006 CHARM Symposium Craig Stuart Sapp.
Polyphonic Transcription Bruno Angeles McGill University - Schulich School of Music MUMT-621 Fall /14.
Unit 01- setting up and operate a digital audio workstation By Alfie fennemore.
NON-NEGATIVE MATRIX FACTORIZATION FOR REAL TIME MUSICAL ANALYSIS AND SIGHT-READING EVALUATION Chih-Chieh Cheng, Diane J. Hu, and Lawrence K. Saul, UC San.
James Hornsby Connor Bradshaw 1168 Unit 1. Unit Unit  I will use Garageband because it has simple user interface, it is easy to use.
Copyright © 2003 Pearson Education, Inc. Chapter 6 – Slide 1 by Michael Kay The Web Wizard’s Guide to Flash.
By Cheyenne Morgan Unit 1- Set up and operate a DAW.
V ISUALIZING E XPRESSIVE P ERFORMANCE IN T EMPO -L OUDNESS S PACE Presented by Vinoth Kulaveerasingam QMUL ELE021/ELED021/ELEM021 5 Mar 2012 Paper by Jorg.
MMDB-8 J. Teuhola Audio databases About digital audio: Advent of digital audio CD in Order of magnitude improvement in overall sound quality.
Computational Performance Analysis Craig Stuart Sapp CHARM 25 April 2007 CCRMA Colloquium.
Issues in Automatic Musical Genre Classification Cory McKay.
For use with WJEC Performing Arts GCSE Unit 1 and Unit 3 Task 1 Music Technology Technical issues.
Transcription Software Amazing Slow Downer & Transcribe! Rick Lollar Amazing Slow Downer & Transcribe! Rick Lollar.
15 Nov Visualization of Music Donald Byrd School of Informatics & Jacobs School of Music Indiana University Updated 15 Nov Copyright © ,
Elements of Music By: Montana Miracle. Pitch  The highness or lowness of a tone.  The position of a note determines the element of music.  It may be.
Audio Fingerprinting MUMT 611 Philippe Zaborowski March 2005.
Braille Music Production at DZB Leipzig Matthias Leopold DaCapo.
Garage Band For MAC. What is it? A digital audio workstation that can record and play back multiple tracks of audio. Is a software application for OS.
KS3 End of Year Exams Music Revision.
Musical Information 1B Music 253/CS 275A Stanford University
Rosetta Stone of Musical Data
Elements of Music.
Analytical uses of Humdrum Tools
The Spatiotemporal Organization of the Striatum Encodes Action Space
Prefrontal Neurons Coding Suppression of Specific Saccades
Enhance your Recording and Mixing Skills by Grayspark Audio Academy
The Audio Notetaker Workspace Explained
Presentation transcript:

The Mazurka Project Science and Music Seminar University of Cambridge 28 Nov 2006 Craig Stuart Sapp Centre for the History and Analysis of Recorded Music Royal Holloway, University of London

Some facets of music CompositionPerformanceListen ComposerPerformerAudience Music Theory Cognitive Psychology ? fields of generation fields of analysis Instrument Maker Instrument Acoustics

Performance data extraction Reverse conducting Align taps to beats Automatic feature extraction tempo by beat off-beat timings individual note timings individual note loudnesses Listen to recording and tap to beats. Tap times recorded in Sonic Visualiser by tapping on computer keyboard. Reverse conducting is real-time response of listener, not actions of performer. Adjust tap times to correct beat locations. A bit fuzzy when RH/LH do not play in sync, or for tied notes.

Reverse conducting Mazurka project using an audio editor called Sonic Visualiser (SV): In SV, you can mark points in time while the audio is playing:

Beat alignment Taps from reverse conducting are not exactly aligned with the performance. How to adjust to actual note attacks? Can be difficult to do by eye in audio editor. Very time-consuming to do by ear. Solution: audio markup plugins in SV to help locate note attacks: such as: primarily due to constant changes in tempo

Beat alignment (2) With visual aid of markup, correction becomes easy to do by eye: = tapped times = aligned to beats Example:

Automatic feature extraction Beat times are used to create a simulated performance from the score r 4ee =1 =1 = r 8.ff ee A 4d 4f 4dd A 4d 4f 4ff =2 =2 = r 2ff A 4c 4f A 4c 4e 4ee =3 =3 = r 24dd ee dd cc# E 4G# 4d 8dd dd# E 4G# 4d 8ee b =4 =4 =4 beat times left hand right hand interpolated off-beat times Score data is in the Humdrum format:

Automatic feature extraction (2) r 4ee =1 =1 = r 8.ff ee A 4d 4f 4dd A 4d 4f 4ff =2 =2 =2 Data is translated to a Matlab-friendly format. note onsetnotated durationpitch (MIDI)metric levelmeasureabsbeathand Automatic alignment and extraction of note onsets and loudnesses with program being developed by Andrew Earis

Dynamics & Phrasing all at once: rubato

Tempo graphs

Timescapes Examine the internal tempo structure of a performances Plot average tempos over various time-spans in the piece Example of a piece with 6 beats at tempos A, B, C, D, E, and F: average tempo for entire piece plot of individual tempos average tempo of adjacent neighbors 3-neighbor average 4-neighbor average 5-neighbor average

Timescapes (2) average tempo of performance average for performance slower faster phrases

Comparison of performers 6

Same performer

Correlation Pearson correlation: Measures how well two shapes match: r = 1.0 is an exact match. r = 0.0 means no relation at all.

Overall performance correlations Biret Brailowsky Chiu Friere Indjic Luisada Rubinstein 1938 Rubinstein 1966 Smith Uninsky BiLuBrChFlInR8R6SmUn

Correlation network

Correlation tree

Correlation tree (2)

Correlation scapes Who is most similar to a particular performer at any given region in the music?

Same performer over time 3 performances by Rubinstein of mazurka 17/4 in A minor (30 performances compared)

Same performer (2) 2 performances by Horowitz of mazurka 17/4 in A minor plus Biret 1990 performance. (30 performances compared)

Correlation to average

Individual interpretations Idiosyncratic performances which are not emulated by other performers. (or I don’t have performances that influenced them or they influence)

Possible influences

Student/Teacher Francois and Biret both studied with Cortot, Mazurka in F major 68/3 (20 performances compared)

Same source recording The same performance by Magaloff on two different CD releases Philips Philips /29-2 Structures at bottoms due to errors in beat extraction or interpreted beat locations (no notes on the beat). mazurka 17/4 in A minor

Purely coincidental Two difference performances from two different performers on two different record labels from two different countries.

For further information

Extra Slides

Average tempo over time Performances of mazurkas slowing down over time: Friedman 1930 Rubinstein 1966 Indjic 2001 Slowing down at about 3 BPM/decade Laurence Picken, 1967: “Centeral Asian tunes in the Gagaku tradition” in Festschrift für Walter Wiora. Kassel: Bärenreiter,

Reverse Conducting Orange = individual taps (multiple sessions) which create bands of time about 100 ms wide. Red = average time of individual taps for a particular beat

MIDI Performance Reconstructions MIDI file imported as a note layer in Sonic Visualiser: Superimposed on spectrogram Easy to distinguish pitch/harmonics Legato; LH/RH time offsets “straight” performance matching performers tempo beat-by-beat: tempo = avg. of performance (pause at beginning)

Input to Andrew’s System Scan the score Convert to symbolic data with SharpEye Tap to the beats in Sonic Visualiser Convert to Humdrum data format Create approximate performance score Simplify for processing in Matlab