1. A. Frank Multimedia Multimedia/Video Search

2. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search

3. 3 A. Frank Multimedia Resources – תמונות Pictures, Photos, Maps, Graphics, Animations שמע – Audio, Sounds מוסיקה– Music, MP3 הקלטות – Radio, Podcasts, Speeches חוזי– Video, Flash, Vlogs סרטים – Movies, TV

4. 4 A. Frank MM Search & Information Retrieval (MMIR) Search & information retrieval of multimedia objects is hard!! Using SEs to find relevant, quality MM objects can be difficult and frustrating. Sample query: find a movie that has a large mouse chasing a Persian cat with twins watching from above? Common MM search is text-based; object text can be derived from: –caption of the MM object –text surrounding the MM object –filenames of MM object and the containing page –manual/automatic annotations Recently, tag-based MM search is effective (social computing). However, long due, content-based MM search on the Web is forthcoming.

5. 5 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search

6. 6 A. Frank Multimedia: Google

7. 7 A. Frank Multimedia: Google

8. 8 A. Frank Multimedia: Yahoo

9. 9 A. Frank Yahoo Audio Search

10. 10 A. Frank

11. 11 A. Frank AOL Video Search

12. 12 A. Frank Multimedia: MSN Live

13. 13 A. Frank MSN Live

14. 14 A. Frank MSN Live Search

15. 15 A. Frank AltaVista Multimedia Search

16. 16 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search

17. 17 A. Frank Images: Picsearch

18. 18 A. Frank Picsearch Advanced Interface

19. 19 A. Frank Audio: FindSounds

20. 20 A. Frank Types of Sounds

21. 21 A. Frank Video: SearchVideo

22. 22 A. Frank Video: Clipblast! Organizes and makes the video Web relevant, fast and simple to navigate. Video Search and Navigation technology makes it easy to search, browse and personalize the video that viewers want, when they want it. Crawls the entire Web for all video content available, indexing more video content providers than any other video search engine. Largest video distribution platform ever.

23. 23 A. Frank Video: Clipblast

24. 24 A. Frank Multimedia: Flurl

25. 25 A. Frank Flurl list of sites

26. 26 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search

27. 27 A. Frank Flickr

28. 28 A. Frank Flickr

29. 29 A. Frank Flickr

30. 30 A. Frank Image/Maps: Panoramio

31. 31 A. Frank Image/Maps: Panoramio

32. 32 A. Frank Image/Maps: Panoramio

33. 33 A. Frank Video: YouTube

34. 34 A. Frank Keotag Meta-SE

35. 35 A. Frank Keotag Meta-SE

36. 36 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search

37. 37 A. Frank “Content-based“ Image Search/Retrieval “Content based” image DB or Web site(s) that contain a large number of images. Image analysis techniques used to describe images by their extracted visual features such as color, texture, shape and orientation. These objects can be represented by sets of image features and then compared with the sets extracted from other images. Feature sets are described by their statistics, and the computer searches for statistically likely matches. Queries can be formulated in terms of visual features or by similarity options.

38. 38 A. Frank Image: Squid Has about 1100 images of marine creatures in its database. Each image shows one distinct species on a uniform background. Every image is processed to recover the boundary contour, which is then represented by three global shape parameters and the maxima of the curvature zero-crossing contours in its Curvature Scale Space (CSS) image.

39. 39 A. Frank Images: Squid

40. 40 A. Frank Images: Squid

41. 41 A. Frank Images: Squid

42. 42 A. Frank Images: Squid

43. 43 A. Frank Image: retriever Experimental service which lets you search and explore in a selection of Flickr images by drawing a rough sketch. Matches the most pronounced shapes and slabs of colors. The results are usually fairly good, sometimes even stunning, But it doesn't do object/face recognition of any kind, so if drawing an outline sketch of a chair, it almost certainly won't get you one back.

44. 44 A. Frank Images: retriever

45. 45 A. Frank Images: retriever

46. 46 A. Frank Images: retriever

47. 47 A. Frank MelodyHound

48. 48 A. Frank MelodyHound

49. 49 A. Frank MelodyHound

50. 50 A. Frank MelodyHound

51. 51 A. Frank Musipedia

52. 52 A. Frank Audio: MusiPedia

53. 53 A. Frank Music: Musipedia

54. 54 A. Frank Musipedia or Web Search?

55. 55 A. Frank Video: Blinkx World's largest and most advanced video search engine. Use of visual analysis and speech recognition to better understand rich media content. Advanced image and audio analysis techniques are used to automatically extract information about a video in real time and to create a rich index about the video content. Automatically and implicitly conducts searches based on the content being viewed by each individual user. With the advent of blinkx TV, users can now search and access news, movie trailers, popular multimedia segments and other video formats on demand.

56. 56 A. Frank Video: Blinkx

57. 57 A. Frank Video: Blinkx

58. 58 A. Frank Blinkx TV Architecture

59. 59 A. Frank References Kate Greene, Better, More Accurate Image Search, Technology Review, April 9, 2007, http://www.technologyreview.com/Infotech/18501/ http://www.technologyreview.com/Infotech/18501/ Kate Greene, Surfing TV on the Internet, Technology Review, April 18, 2007, http://www.technologyreview.com/Infotech/18545/ http://www.technologyreview.com/Infotech/18545/ Amit Agarwal, 10 Interesting Things You Can Do with YouTube or Google Videos, Digital Inspiration (Blog), July 27, 2006, http://labnol.blogspot.com/2006/07/10-interesting-things-you- can-do-with.html http://labnol.blogspot.com/2006/07/10-interesting-things-you- can-do-with.html