CS315 Multimedia Search and Retrieval. Types of Multimedia Multimedia: Beyond text communication Stored in a variety of formats Audio Today most popular.

Slides:



Advertisements
Similar presentations
Multimedia Components (Develop & Delivery System)
Advertisements

MASTERY OBJECTIVE: Learn parts of an html document Learn basic html tags HTML-An Introduction.
THE ESP GAME, & PEEKABOOM LUIS VON AHN CARNEGIE MELLON UNIVERSITY.
Ying Wang EDN 303 Fall Objectives Explain the role of an operating system and list the main operating systems used on today’s computers Define and.
AN IMPROVED AUDIO Jenn Tam Computer Science Dept. Carnegie Mellon University SOAPS 2008, Pittsburgh, PA.
Sunita Sarawagi.  Enables richer forms of queries  Facilitates source integration and queries spanning sources “Information Extraction refers to the.
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.
CAPTCHA Presented By Sayani Chandra (Roll )
Chapter Concepts Review Markup Languages
Lecture 26: Vision for the Internet CS6670: Computer Vision Noah Snavely.
1 CS 502: Computing Methods for Digital Libraries Lecture 20 Multimedia digital libraries.
Peekaboom: A Game for Locating Objects in Images
Human Computation CSC4170 Web Intelligence and Social Computing Tutorial 7 Tutor: Tom Chao Zhou
1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,
Application Software Productivity Tools for Educators
Software and Multimedia
Multimedia By: Hector.Grijalva Period.1. What is meant by multimedia? Multimedia is media and content that uses a combination of different content forms.
Web Programming Language Dr. Ken Cosh Week 1 (Introduction)
Mrs. Beth Cueni Carnegie Mellon
CP2022 Multimedia Internet Communication1 HTML and Hypertext The workings of the web Lecture 7.
Exploration Seminar 3 Human Computation Roy McElmurry.
Section 17.1 Add an audio file using HTML Create a form using HTML Add text boxes using HTML Add radio buttons and check boxes using HTML Add a pull-down.
Business Software What is database software? p. 145 Allows you to create, access, and manage data Add, change, delete, sort, and retrieve data Next.
 Commercial- to sell or promote company products  Portal- provide a variety of everyday services  Informational- provide useful info & news  Educational-
1 CS 430 / INFO 430 Information Retrieval Lecture 23 Non-Textual Materials 2.
Web Programming : Building Internet Applications Chris Bates CSE :
Ideas Session Willer Travassos, Jan. 24th. GWAP Games with a purpose (GWAP) uses the computational power of humans to perform tasks that computers are.
After you have registered in your course, logged in and used the Installation Wizard, to check your computer you can take advantage of all the resources.
Spoken Dialog Systems and Voice XML Lecturer: Prof. Esther Levin.
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials: Informedia.
CS315 Search and Retrieval of Multimedia P. Takis Metaxas.
by Maria Rita Marruganti DIFFERENT WAYS OF SENDING INFORMATION Passive e.g. newspapers, radio, television. You don’t produce, just receive information.
Internet for Teaching and Learning. Understanding the Web The Web is A collection of publicly accessible pages (web sites) on the Internet All use the.
Multimedia streaming Application Anandi Giridharan Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India Querying.
WEB MINING. In recent years the growth of the World Wide Web exceeded all expectations. Today there are several billions of HTML documents, pictures and.
CC 2007, 2011 attribution - R.B. Allen Multimedia and Hypermedia.
 The combination of sound, animation, graphics, video, and color into a document  The combination of text with graphics, sound, video, or animation.
Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #15 Secure Multimedia Data.
CSCI-100 Introduction to Computing Hardware Part II.
SMART Boards in the World Language Classroom Amanda Robustelli-Price 9/20/11.
Search Engine using Web Mining COMS E Web Enhanced Information Mgmt Prof. Gail Kaiser Presented By: Rupal Shah (UNI: rrs2146)
Internet Applications (Cont’d) Basic Internet Applications – World Wide Web (WWW) Browser Architecture Static Documents Dynamic Documents Active Documents.
MULTIMEDIA Multimedia is the field concerned with the computer- controlled integration of text, graphics, drawings, still and moving images (Video), animation,
MIT Artificial Intelligence Laboratory — Research Directions The START Information Access System Boris Katz
Human Computation (aka Crowdsourcing) LUIS VON AHN Slides taken from a talk by.
Quiz Week 8 Topical. Topical Quiz (Section 2) What is the difference between Computer Vision and Computer Graphics What is the difference between Computer.
1 What is Multimedia? Multimedia can have a many definitions Multimedia means that computer information can be represented through media types: – Text.
Layer 6 Presentation Layer. Overview Now that you have learned about Layer 5 of the OSI model, it is time to look at Layer 6, the presentation layer.
By: Steven Baker.  What is a CAPTCHA?  History of CAPTCHA  Applications of CAPTCHAs  Accessibility  Examples of CAPTCHAs  reCAPTCHA  Vulnerabilities.
Separating man from machine since 2000….. ?. Agenda  Definition  History  Need  Types  Constructing CAPTCHAs  Breaking CAPTCHAs  Applications 
Chapter 8 Adding Multimedia Content to Web Pages HTML5 & CSS 7 th Edition.
Convert-It audio converter is fast, complete, easy yet powerful software that allows you to convert between a large collection of audio file formats.
Glencoe Introduction to Multimedia Chapter 2 Multimedia Online 1 Internet A huge network that connects computers all over the world. Show Definition.
SANDEEP MEHTA (ECE, IV Year). CAPTCHA Completely Automated Public Turing test to tell Computers and Humans Apart Invented at CMU by Luis von Ahn, Manuel.
THE ESP GAME, AND OTHER STUFF
CS115/MAS115: Computing for The Socio-Techno Web
Features of Authoring Tools
Supervisor: Prof Michael Lyu Presented by: Lewis Ng, Philip Chan
Data and Applications Security Developments and Directions
Section 17.1 Section 17.2 Add an audio file using HTML
Web Design and Development
Software and Multimedia
Next-Generation Search Engines -Perspective and challenges
Software and Multimedia
Multimedia Information Retrieval
Mrs. Beth Cueni Carnegie Mellon
Creating Transcripts of Your Narrated PowerPoints Richard Oliver Department of Information Systems 2018 Quality in Online Education Conference.
Multimedia Information Retrieval
I UNDERSTAND CONCEPTS OF MULTIMEDIA
Interactive media.
Presentation transcript:

CS315 Multimedia Search and Retrieval

Types of Multimedia Multimedia: Beyond text communication Stored in a variety of formats Audio Today most popular formats: Image Today most popular formats: Animation Today most popular formats: Video Today’s most popular formats:

Searching for Audio Tagged audio files News organizations (e.g., NPR, BBC, …) iTunes etc services Raw audio Signal processing To Speech recognition processing To Text (inaccurate) Perform text search Tune recognition Signal processing Pattern matching E.g., midomi.com, shazam.com/

Searching for Video Tagged by humans News organizations YouTube.com TED.com MIT’s Lecture Browser Lectures have additional challenges Glass at MIT Spoken Lecture Processing Project -browser -browser Extract audio track Convert into text Analyze text to reveal structure Segment based on structure

Searching for Images Use surrounding text Filenames, html, nearby text Computer Vision techniques Still a tough problem Tagged by humans Great results, but… Expensive! Slow! Idea: Exchange adrenaline for human labor! The ESP game (now part of gwap.com) [von Ahn, Dabbish: Labelling Images with a Computer Game] The Peekaboom game (newer version called squigl) [von Ahn, Liu, Blum: A game for locating objects in images]

If humans are still the best taggers… Captcha: program that can tell whether its user is a human or a computer Can generate and grade test that Most humans can pass Current computer programs will fail New: ReCAPTCHA