Access to News Audio User Interaction in Speech Retrieval Systems by Jinmook Kim and Douglas W. Oard May 31, 2002 19th Annual Symposium and Open House.

Slides:



Advertisements
Similar presentations
Qualitative Data:Preparation and Use John Southall Senior Qualitative Data & Support Services Officer Qualidata.
Advertisements

A Human-Centered Computing Framework to Enable Personalized News Video Recommendation (Oh Jun-hyuk)
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Observing users Chapter 12. Observation ● Why? Get information on.. – Context, technology, interaction ● Where? – Controlled environments – In the field.
Virtual University - Human Computer Interaction 1 © Imran Hussain | UMT Imran Hussain University of Management and Technology (UMT) Lecture 43 Information.
Possible Research Sources Stage #2 Which resources are the best to use for my topic or project?
Dialogue – Driven Intranet Search Suma Adindla School of Computer Science & Electronic Engineering 8th LANGUAGE & COMPUTATION DAY 2009.
Publishing qualitative studies H Maisonneuve April 2015 Edinburgh, Scotland.
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.
Speech and Music Retrieval LBSC 796/CMSC828o Session 12, April 19, 2004 Douglas W. Oard.
Using the NASA Thesaurus to Support the Indexing of Streaming Media Gail Hodge, Janet Ormes & Patrick Healey NASA Goddard Space Flight Center Library.
MALACH Multilingual Access to Large spoken ArCHives Survivors of the Shoah Visual History Foundation Human Language Technologies IBM T. J. Watson Research.
Information Retrieval Interaction CMSC 838S Douglas W. Oard April 27, 2006.
Reference Collections: Task Characteristics. TREC Collection Text REtrieval Conference (TREC) –sponsored by NIST and DARPA (1992-?) Comparing approaches.
DIVINES – Speech Rec. and Intrinsic Variation W.S.May 20, 2006 Richard Rose DIVINES SRIV Workshop The Influence of Word Detection Variability on IR Performance.
How To Find Annual Seminar Educational Sessions in the Security Database & Library Catalog.
Primary data Collection: Using semi-structured, in-depth and group interviews Lecture 18 th.
Multilingual Access to Large Spoken Archives Douglas W. Oard University of Maryland, College Park, MD, USA.
IB Internal Assessment Design. Designing an Experiment Formulate a research question. Read the background theory. Decide on the equipment you will need.
MRIDULA JOSHI ASSOCIATE PROFESSOR PGGCG-11 BUSINESS REPORT WRITING.
The Evolution of Shared-Task Evaluation Douglas W. Oard College of Information Studies and UMIACS University of Maryland, College Park, USA December 4,
Using the NASA Thesaurus to Support the Indexing of Streaming Media Gail Hodge Information International Associates, Inc. Janet Ormes & Patrick Healey.
Real-Time Speech Recognition Subtitling in Education Respeaking 2009 Dr Mike Wald University of Southampton.
Qualitative Analysis Information Studies Division Research Workshop Elisabeth Logan.
Interaction Design Session 12 LBSC 790 / INFM 718B Building the Human-Computer Interface.
Literature Review. General Format  Typed, Double Spaced on standard paper  12 point Times New Roman Font  1 inch margin on all sides of the paper 
The PrestoSpace Project Valentin Tablan. 2 Sheffield NLP Group, January 24 th 2006 Project Mission The 20th Century was the first with an audiovisual.
Hello! Welcome to Saksham’s Knowledge Management System (KMS) Hello! Welcome to Saksham’s Knowledge Management System (KMS)
Gathering User Data IS 588 Dr. Dania Bilal Spring 2008.
November 15, 2003CLIS Alumni Chapter Talking to the Future: The MALACH Project Douglas W. Oard Joanne Archer, Ammie Feijoo, Xiaoli Huang College of Information.
Producción de Sistemas de Información Agosto-Diciembre 2007 Sesión # 8.
Laboratory for Automation Psychology and Decision Processes Kent L. Norman, University of Maryland, USA (Catherine Plaisant, University of Maryland, USA)
Web-Assisted Annotation, Semantic Indexing and Search of Television and Radio News (proceedings page 255) Mike Dowman Valentin Tablan Hamish Cunningham.
©2006 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Researching Your Message.
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials: Informedia.
Prof. Thomas Sikora Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Integration Activities in “Tools for Tag Generation“
Enabling Access to Sound Archives through Integration, Enrichment and Retrieval Annual Review Meeting - Introduction.
Speech and Music Retrieval INST 734 Doug Oard Module 12.
1 Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP Reporter: 林浩棟.
Image and Video Retrieval INST 734 Doug Oard Module 13.
Select Online Databases. Select Science in Context.
Evaluation INST 734 Module 5 Doug Oard. Agenda Evaluation fundamentals Test collections: evaluating sets Test collections: evaluating rankings Interleaving.
Basic Reference Resources Park View High School Library Media Center Prepared by Candace Main Rush Library Media Specialist.
Home Page Searching the SHARE-Catalog From the Home Page, you can search the SHARE catalog, find information in online databases, search other library.
Natural Language and Speech (parts of Chapters 8 & 9)
Subject Access to Your Information Sandy Tucker Texas A&M University Libraries August 1, 2006 Second International Symposium on Transportation Technology.
Searching and Using Electronic Literature III. Research Design.
6th Grade Science Fair A Sample Notebook. Cover Page Title Picture(s) Name School Science teacher Classroom teacher Date Title Picture(s) Name School.
How to search for relevant information. Preparing to search: PLAN WHAT am I looking for? WHY do I want it? WHEN? Time period? HOW? Document type? What.
1 Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002 Howard Wactlar, Carnegie Mellon Yiming Yang, Carnegie Mellon Herb Gish,
Message Source Linguistic Channel Articulatory Channel Acoustic Channel Observable: MessageWordsSounds Features Bayesian formulation for speech recognition:
Chapter 7 Researching Your Speech. Researching your speech: Introduction Researching your topic and providing strong evidence for your claims can make.
A POCKET GUIDE TO PUBLIC SPEAKING 4 TH EDITION Chapter 9 Locating Supporting Material.
Search and Annotation Tool for Oral History INTER-VIEWS Henk van den Heuvel, Centre for Language and Speech Technology (CLST) Radboud University Nijmegen,
Using Library Resources Making the Library Work for You Kate Wise Spring 2008.
Conducting Research. Finding Resources Online Library Local govt. offices Field research.
Organization of Information LSIS Summer II (2005)
This is a “Results” page from a search done on our card catalog. This page shows us many things.
Multi-Source Information Extraction Valentin Tablan University of Sheffield.
Small Business Reference Center
Topic: Problem with Sampling Reading: Baker, Stephen (2009)
Digital Video Library - Jacky Ma.
Author(s) Affiliation(s)
Semi-structured interviews and focus groups
Supplementary Table 1. PRISMA checklist
A SPEAKER’S GUIDEBOOK 4TH EDITION CHAPTER 9
CREATING DISTRIBUTION IDS IN details Online
Content Augmentation for Mixed-Mode News Broadcasts Mike Dowman
A HCL Proprietary Utility for
Ethnographic Research Template
Presentation transcript:

Access to News Audio User Interaction in Speech Retrieval Systems by Jinmook Kim and Douglas W. Oard May 31, th Annual Symposium and Open House Human-Computer Interaction Lab University of Maryland

Research Questions 1.What relevance criteria do searchers rely on when selecting spoken word materials? 2. What attributes of the recordings do searchers use as a basis for assessing relevance?

Search Systems NPR Online  Manually prepared transcripts  Human cataloging SpeechBot  Automatic Speech Recognition  Automatic indexing

NPR Online

SpeechBot

Qualitative Study Design 5 students in a graduate seminar on Visual and Sound Materials Searched both systems  3 started with NPR, 2 with SpeechBot Three search topics  Two given by the investigator  One developed by the participant

Data Collection Observation Think-aloud Semi-structured interview

Findings: Relevance Criteria NPR OnlineSpeechBot Topicality Time range Type Novelty Recency Listening time Place Authority Topicality Time range Novelty Type Accessibility

Findings: Attributes NPR OnlineSpeechBot Story title Story summary Detailed story summary Date Audio Speaker name Program title Story length Mention of a location Speaker’s affiliation Extract from transcript Longer extract from transcript Audio Date Highlighted terms in transcript Program title

Some Takeaway Messages Recognition errors may not bother the system, but they do bother the user! Segment-level indexing can help to provide effective access