A Game-Based Approach for Collecting Semantic Music Annotations Douglas Turnbull, Rouran Liu, Luke Barrington, Gert Lanckriet Computer Audition Lab UC.

Slides:



Advertisements
Similar presentations
Description At My Studiyo you can create interactive quiz content for your website or blog quickly and easily.
Advertisements

Social Media.
Audio Retrieval David Kauchak cs160 Fall 2009 Thanks to Doug Turnbull for some of the slides.
A Music Search Engine Built upon Audio-based and Web-based Similarity Measures P. Knees, T., Pohle, M. Schedl, G. Widmer SIGIR 2007.
Bring Order to Your Photos: Event-Driven Classification of Flickr Images Based on Social Knowledge Date: 2011/11/21 Source: Claudiu S. Firan (CIKM’10)
Library Lovers Day 2011 New Library Services
Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.
Results Audio Information Retrieval using Semantic Similarity Luke Barrington, Antoni Chan, Douglas Turnbull & Gert Lanckriet Electrical & Computer Engineering.
Berenzweig - Music Recommendation1 Music Recommendation Systems: A Progress Report Adam Berenzweig April 19, 2002.
CounterMeasures: An Interactive Game for Security Training Advised by: Mark Claypool Kathi Fisler Craig Jordan (IMGD) Matt Knapp (CS) Dan Mitchell (CS)
Helping Students Succeed at Identifying Organic Compounds: Optimizing Location and Content of a Guide to the Literature Susan K. Cardinal & Kenneth J.
People use words to describe music
A Supervised Approach for Detecting Boundaries in Music using Difference Features and Boosting Douglas Turnbull Computer Audition Lab UC San Diego, USA.
Identifying Words that are Musically Meaningful David Torres, Douglas Turnbull, Luke Barrington, Gert Lanckriet Computer Audition Lab UC San Diego ISMIR.
Semantic Similarity for Music Retrieval Luke Barrington, Doug Turnbull, David Torres & Gert Lanckriet Electrical & Computer Engineering University of California,
Information Filtering LBSC 796/INFM 718R Douglas W. Oard Session 10, November 12, 2007.
You can contact your parents so they know where you are and you can extend your time out. You can take photos and videos and share them with family and.
The innovative way to take Notes!! *You can get it at Best Buy for $150 for 1G=100 hrs of audio or 2G for 200$=200 hrs.
Touching is Good Game Design for the Nintendo DS Nick Balogh Computer Science Senior Project Union College Prof. Burns.
POTENTIAL RELATIONSHIP DISCOVERY IN TAG-AWARE MUSIC STYLE CLUSTERING AND ARTIST SOCIAL NETWORKS Music style analysis such as music classification and clustering.
Wang YuQing Liu Zihao Tran Quoc Cuong Testing Plan for Bellews Game – Year of Eden School of Business and Information Management Oulu University of Applied.
CS598CXZ Course Summary ChengXiang Zhai Department of Computer Science University of Illinois, Urbana-Champaign.
Marie-Luce Bourguet Projects in the areas of: Multimedia processing Multimedia / Web design.
Class Info Website for materials available at: – We’ll use Moodle for turning in assignments, grades, s, blog.
Rutherford Appleton Laboratory SKOS Ecoterm 2006 Alistair Miles CCLRC Rutherford Appleton Laboratory Semantic Web Best Practices and Deployment.
Ian Addison Primary School Teacher. Didn’t have PCs at school Owned my first PC at 16 Studied BTEC IT at college – this included breaking (and fixing)
Patterns in game design
23 Participants Average years in education = Average age = males; 14 females Most used applications = Events; Social Networks; Music Least.
Content Analysis Techniques to Ease Browsing with Handhelds Jalal Mahmud Yevgen Borodin I.V. Ramakrishnan Department of Computer Science State University.
DAS Game DAS game Distributed Annotation System A game to settle down the concept of DAS Game cards available in:
Podcasts Spring, 2008 By Linda Kenney Modified Feb. 6, 2008.
Music Recommendation A Data Mining Approach Daniel McEnnis 2nd year PhD Daniel McEnnis 2nd year PhD.
No Title, yet Hyunwoo Kim SNU IDB Lab. September 11, 2008.
Leisure time Hobbies and Interests (Volný čas – koníčky, záliby)
Web 2.0 Tools By: Jon McCabe. Podcast A podcast is an audio or video program formatted to be played on the iPod and made available for free or for purchase.
 Text Representation & Text Classification for Intelligent Information Retrieval Ning Yu School of Library and Information Science Indiana University.
Audio and Video Chris McConnell Department of Radio-TV-Film November 30, 2006.
WEB SEARCH PERSONALIZATION WITH ONTOLOGICAL USER PROFILES Data Mining Lab XUAN MAN.
Class Usability Experience User slides are in BLUE.
Cooperative Learning in the Classroom
YouTunes TAU – Google Technologies for Web Development Noam Soel Omri Sharabi Tamar Weiser Rotem Arnon.
Gaming in Libraries Idea Overview. Ideas at Conference Why Games Are Important to Libraries Educational Value of Games Gaming Programs in Libraries.
CS315 Search and Retrieval of Multimedia P. Takis Metaxas.
Combining Audio Content and Social Context for Semantic Music Discovery José Carlos Delgado Ramos Universidad Católica San Pablo.
How To Podcast Mike McIntee Timescape Media
Evidence of Quality of Textual Features on the Web 2.0 Flavio Figueiredo David FernandesEdleno MouraMarco Cristo Fabiano BelémHenrique.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
Automatic Video Tagging using Content Redundancy Stefan Siersdorfer 1, Jose San Pedro 2, Mark Sanderson 2 1 L3S Research Center, Germany 2 University of.
TODAY’S GOALS Understand the analysis and evaluation processes Analyze podcasts as a genre Practice creating criteria for evaluation.
International “Road Warriors” or individual in businesses use audio called “On- Point Cell Cast” as a tool for creating and distributing surveys, assessments.
1 SharePoint 2013 Advanced Training Accelebrate Except as noted, all content copyright © by Accelebrate.
Human computation Jakub Šimko Slovak University of Technology in Bratislava, Faculty of Informatics and Information Technologies,
User Modeling and Recommender Systems: Introduction to recommender systems Adolfo Ruiz Calleja 06/09/2014.
HTML 5 The Future of Web Development. What is HTML5? “HTML5 is a specification of how the web’s core language, HTML, should be formatted and utilized.
Social Information Processing March 26-28, 2008 AAAI Spring Symposium Stanford University
The Benefit of Using Tag-Based Profiles Claudiu Firan, Wolfgang Nejdl, Raluca Paiu 5 th Latin American Web Congress, 2007.
Mining Tag Semantics for Social Tag Recommendation Hsin-Chang Yang Department of Information Management National University of Kaohsiung.
Topic: Travelling Microtopic: My favourite kind of transport.
Computers as Learning Tools Amanda Cantafio. ADVANTAGES OF USING COMPUTERS IN THE CLASSROOM ▪ Students gain word processing skills when learning to type:
Big6 Research and Problem Solving Skills 6 th Grade Project Creating a Travel Brochure.
Potential for Personalization Transactions on Computer-Human Interaction, 17(1), March 2010 Data Mining for Understanding User Needs Jaime Teevan, Susan.
SEMANTIC WEB Presented by- Farhana Yasmin – MD.Raihanul Islam – Nohore Jannat –
How do italian students spend their free time? During the afternoon the 25% of the students use to study more than doing other activities, 55% of them.
SEMINAR ON INTERNET SEARCHING PRESENTED BY:- AVIPSA PUROHIT REGD NO GUIDED BY:- Lect. ANANYA MISHRA.
Information Retrieval in Practice
Homework 1.1 Answers Intro Stats
Multimedia Training Kit
Approaching an ML Problem
Wikis Can only have 100 users, unlimited pages in the free version
Personalization Personalized System Traditional System 3 2 1
Presentation transcript:

A Game-Based Approach for Collecting Semantic Music Annotations Douglas Turnbull, Rouran Liu, Luke Barrington, Gert Lanckriet Computer Audition Lab UC San Diego ISMIR September 27, 2007

2 Introduction Automatic audio content analysis helps to organize, search, recommend, retrieve and describe huge - and growing - music collections Computer audition systems require significant amounts of high-quality semantic labels for audio content Collecting this data can be difficult, expensive, slow, boring and inaccurate If only we could get someone else to do it...

3 Sources of Semantic Information 10 2 Quality Quantity web mine id3 tags

4

5 Sources of Semantic Information 10 2 Quality Quantity CAL500 human tags web mine id3 tags

6

7 Sources of Semantic Information 10 2 Quality Quantity CAL500 Pandora Last.fm Web mine id3 tags Human Computation

8 Human Computation Many problems that are hard for computers can be easily solved by humans Many humans spend lots of time solving problems that are of little use How can we put these “gray cycles” to use?

9 Music Games Multi-player Music is social Music can be subjective Use group consensus... but allow personal variations Collaborative There are no “right answers” But agreed-on answers earn more points... Fun Need to excite players in order to collect lots of data Sacrifice data collection in favor of a compelling game

players have played at least 1 game 30,000 song-word associations collected ISMIR deadline

11 Evaluation Evaluate the quality of collected semantic annotations by using them to train an automatic music retrieval system [SIGIR07] 0.705CAL Words 0.609AllMusic 317 Words Retrieval ROC AreaDataset 0.609AllMusic 317 Words Retrieval ROC AreaDataset 0.661Listen Words 0.705CAL Words 0.609AllMusic 317 Words Retrieval ROC AreaDataset

A Game-Based Approach for Collecting Semantic Music Annotations Douglas Turnbull, Rouran Liu, Luke Barrington, Gert Lanckriet Computer Audition Lab UC San Diego ISMIR September 27, 2007

15 Annotating Music Web mining Cheap, collect lots of data Noisy data, not necessarily related to music content Surveys / Hand-labelling e.g. Music Genome Project, LastFM tags, CAL500 Reliable, can be tailored to applications Expensive, slow, boring, unfocused, free vocabulary Games Engage users, free, offer new, social music interaction Need lots of players!