An Abstract Control Space for Communication of Sensory Expressive Intentions in Music Performance Canazza, S., De Poli, G., Roda, A., Vidolin, A. Presented.

Slides:



Advertisements
Similar presentations
1 Ganesh Iyer Perceptual Mapping XMBA Session 3 Summer 2008.
Advertisements

Expressive Tangible Acoustic Interfaces Antonio Camurri, Corrado Canepa, and Gualtiero Volpe InfoMus Lab, DIST-University of Genova, Viale Causa 13, Genova,
Mario Baroni Expression: a controversial and elusive concept. Can we find any definition of it?
Content-based retrieval of audio Francois Thibault MUMT 614B McGill University.
Slideshow P4: Drawing a line graph. Features of a good line graph A 'line of best fit' can sometimes be drawn to show the pattern of the plotted points.
Non-linear Dimensionality Reduction CMPUT 466/551 Nilanjan Ray Prepared on materials from the book Non-linear dimensionality reduction By Lee and Verleysen,
Unsupervised Clustering in Multimodal Multiparty Meeting Analysis.
Wednesday, 24 June rd UKIBNET Workshop1 Distributing Cognition in the design of ubiquitous computers Chris Baber Pervasive Computing Group The University.
Understanding and Organizing User Generated Data Methods and Applications.
Jan 15-16, 2009CreativeIT PI Meeting1 Exploring Meaning and Intention in Conducting Roger B. Dannenberg with Dan Siewiorek and Noel Zahler Carnegie Mellon.
Texture Mapping using Surface Flattening via Multi-Dimensional Scaling G.Zigelman, R.Kimmel, N.Kiryati IEEE Transactions on Visualization and Computer.
Careers in Cognitive Psychology Michael Kaschak. Cognitive Science How does the mind work? How is this instantiated in the brain? Attention, perception,
PRINCIPLES OF DESIGN PHOTOGRAPHY. BALANCE Visual center is above geometric center. Visual weight is determined by many variables Size Darkness – A strong.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Data Mining Techniques
Classes and objects Practice 2. Basic terms  Classifier is an element of the model, which specifies some general features for a set of objects. Features.
Virtual Reality Design and Representation. VR Design: Overview Objectives, appropriateness Creating a VR application Designing a VR experience: goals,
Scale / Proportion ppt Lilli Kayes. Voice Tunnel by Rafael Lozano-Hemmer.
Output Thomas W. Davis. What is Output? Output it data that has been processed into a useful form Output includes: Monitors Printers Speakers Etc.
Physical and Chemical Changes
To High School and Beyond: Career Explorations in the Middle School Classroom Alonia M. Johnson, M.Ed., M.S. Technology Instructor.
Educational Software using Audio to Score Alignment Antoine Gomas supervised by Dr. Tim Collins & Pr. Corinne Mailhes 7 th of September, 2007.
KOHONEN SELF ORGANISING MAP SEMINAR BY M.V.MAHENDRAN., Reg no: III SEM, M.E., Control And Instrumentation Engg.
© H. Hajimirsadeghi, School of ECE, University of Tehran Conceptual Imitation Learning Based on Functional Effects of Action Hossein Hajimirsadeghi School.
Marker-Based Augmented Reality
Whither Linguistic Interpretation of Acoustic Pronunciation Variation Annika Hämäläinen, Yan Han, Lou Boves & Louis ten Bosch.
APML, a Markup Language for Believable Behavior Generation Soft computing Laboratory Yonsei University October 25, 2004.
Polyphonic Music Transcription Using A Dynamic Graphical Model Barry Rafkind E6820 Speech and Audio Signal Processing Wednesday, March 9th, 2005.
INTERACTION DESIGN. Today’s objectives Understanding & conceptualizing interaction Control Design Challenge.
Ruizhu Yang 04/25/2014. Otari G V, Kulkarni R V. A Review of Application of Data Mining in Earthquake Prediction[J] Dzwinel W, Yuen D A, Boryczko.
The 11 th International one-month Summer Workshop on Multimodal Interfaces Aug 10 th – Sept 4 th 2015, Mons, Belgium A. Camurri, M. Mancini, G. Volpe,
Point Source in 2D Jet: Radiation and refraction of sound waves through a 2D shear layer Model Gallery #16685 © 2014 COMSOL. All rights reserved.
Extracting Melody Lines from Complex Audio Jana Eggink Supervisor: Guy J. Brown University of Sheffield {j.eggink
Mind power The power of music Music can make you feel happy, confident and inspired to work hard. For example...
Thursday AM  Presentation of yesterday’s results  Factor analysis  A conceptual introduction to: Structural equation models Structural equation models.
Emotion in Music Presented by: Jennifer Pepper & Mina Fan.
1 The 3 keys to making online GIS friendly & intuitive for a public audience Joy Bonaguro, Interface Designer/Research Analyst.
V ISUALIZING E XPRESSIVE P ERFORMANCE IN T EMPO -L OUDNESS S PACE Presented by Vinoth Kulaveerasingam QMUL ELE021/ELED021/ELEM021 5 Mar 2012 Paper by Jorg.
4 November 2000Bridging the Gap Workshop 1 Control of avatar gestures Francesca Barrientos Computer Science Division UC Berkeley.
Theme: Multimedia Sound ProductionUFCFY Multimedia Sound Production.
Uncovering Clusters in Crowded Parallel Coordinates Visualizations Alimir Olivettr Artero, Maria Cristina Ferreiara de Oliveira, Haim levkowitz Information.
The Communication of Musical Expression Roger A. Kendall & Edward C. Carterette University of California, Los Angeles Reviewed by Erdem Unal.
Multidimensional Scaling By Marc Sobel. The Goal  We observe (possibly non-euclidean) proximity data. For each pair of objects number ‘i’ and ‘j’ we.
1 What the body knows: Exploring the benefits of embodied metaphors in hybrid physical digital environments Alissa N. Antle, Greg Corness, Milena Droumeva.
Musical Terms for Choir Make sure you know how these are used!!!
ENTERFACE’08 Multimodal Communication with Robots and Virtual Agents mid-term presentation.
Thesis Presentation IV – Fall Midterm Review NewMediaArts art 127 :: graphic symbolism week 3 :: b.
Components of Computer. Output The data that has been processed into useful information is called output. Types –Screen – soft copy –Printer – hard copy.
Out of sample extension of PCA, Kernel PCA, and MDS WILSON A. FLORERO-SALINAS DAN LI MATH 285, FALL
A Self-organizing Semantic Map for Information Retrieval Xia Lin, Dagobert Soergel, Gary Marchionini presented by Yi-Ting.
Non Verbal Communication. Program Objectives (1 of 2)  Hone your interpersonal advantages while interacting with others.  Recognize how the eyes, face,
MIT Artificial Intelligence Laboratory — Research Directions Intelligent Perceptual Interfaces Trevor Darrell Eric Grimson.
Automatic Transcription of Polyphonic Music
Database management system Data analytics system:
Music and Audio Computing I A
The Elements of Design.
Clustering (3) Center-based algorithms Fuzzy k-means
Machine Learning Feature Creation and Selection
From Experiments in Musical Intelligence to Emily Howell
إعداد المشرفة التربوية نجلاء الجارد
Compositions of Light – the development of a concept
التدريب الرياضى إعداد الدكتور طارق صلاح.
EE513 Audio Signals and Systems
Timbre and Mood Introduction
Nikolaus Kriegeskorte, Rogier A. Kievit  Trends in Cognitive Sciences 
Nearest Neighbors CSC 576: Data Mining.
Media, Graphics, Space.
Statistical comparison of metabolites and analysis of differential metabolites and key metabolic pathways. Statistical comparison of metabolites and analysis.
The Elements of Art.
Presentation transcript:

An Abstract Control Space for Communication of Sensory Expressive Intentions in Music Performance Canazza, S., De Poli, G., Roda, A., Vidolin, A. Presented by Aaron Yang

Path of Expressive Music ComposerScorePerformer Acoustic Signal Listener

Conceptualizing Expressive Intentions Categorical Categorical Dimensional Dimensional PerformanceWorm (Goebl 2002) Loudness and tempo

Understanding Musical Performance (Camurri et al., 2001) Layer 1 – Physical Signals: audio data Layer 1 – Physical Signals: audio data Layer 2 – Low-level features and statistical parameters Layer 2 – Low-level features and statistical parameters Layer 3 – Mid level features and maps Layer 3 – Mid level features and maps Layer 4 – Concepts and structures Layer 4 – Concepts and structures

The Test Mozart’s K 622 Concerto for Clarinet in A major Mozart’s K 622 Concerto for Clarinet in A major Performed: Performed: Light Light Heavy Heavy Soft Soft Hard Hard Bright Bright Dark Dark Natural Natural

The Analysis Double Factor Analysis Double Factor Analysis Matrix of replies and factor score Matrix of replies and factor score Multi-Dimensional Scaling (MDS) Multi-Dimensional Scaling (MDS) Cluster Analysis Cluster Analysis Space of Musical Expression Space of Musical Expression Robinson’s agreement index

Experiment 1 Performer plays the piece with the six adjectives in mind Performer plays the piece with the six adjectives in mind Performances are recorded Performances are recorded Listeners rate the performances on a scale based on the adjectives Listeners rate the performances on a scale based on the adjectives 2 groups- 2 groups- 12 post graduate from a music conservatory 12 post graduate from a music conservatory 12 with no musical training 12 with no musical training

Matrix of Euclidian distances

Multidimensional Scaling of adjectives

Factor Loadings

Factor Plot

Cluster Analysis

Experiment 2 – New adjectives nero (black), greve (oppressive), grave (serious), tetro(dismal), massiccio (massive), rigido (rigid), soffice(mellow), tenero (tender), dolce (sweet), aereo (airy), lieve(gentle), spumeggiante (effervescent), vaporoso (vaporous), fresco (fresh), brusco (abrupt), netto (sharp).

Experiment 2

Cluster Analysis

Human Computer Interfaces Graphic panel – user learns how to use it Graphic panel – user learns how to use it Multimodal – through movements and non-verbal communication. The interface determines what the human intention is. Multimodal – through movements and non-verbal communication. The interface determines what the human intention is.

Expressive Human-Computer Interaction Energy (x axis) Energy (x axis) Kinetics (y axis) Kinetics (y axis) Ktempo (z axis) Ktempo (z axis)

Once upon the time