- 1/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G DIGIFACT: Digitisation of Museum Artefacts Facilitating.

Slides:



Advertisements
Similar presentations
Copyright, UCL LEADERS: Linking EAD to Electronically Retrievable Sources Developing a Generic Toolkit: Architecture and technology issues ALLC/ACH Conference.
Advertisements

Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
A Natural Interactive Game By Zak Wilson. Background This project was my second year group project at University and I have chosen it to present as it.
RGB-D object recognition and localization with clutter and occlusions Federico Tombari, Samuele Salti, Luigi Di Stefano Computer Vision Lab – University.
CAPTURE SOFTWARE Please take a few moments to review the following slides. Please take a few moments to review the following slides. The filing of documents.
Image Information Retrieval Shaw-Ming Yang IST 497E 12/05/02.
Tagging of digital historical images Authors: A. N. Talbonen A. A. Rogov Petrozavodsk state university.
Database-Based Hand Pose Estimation CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.
ARNOLD SMEULDERS MARCEL WORRING SIMONE SANTINI AMARNATH GUPTA RAMESH JAIN PRESENTERS FATIH CAKIR MELIHCAN TURK Content-Based Image Retrieval at the End.
Digital Video Archiving. ViArchive Overview ViArchive provides user friendly solutions for… – uploading video clips with metadata (searchable file info.
Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE.
A Colour Face Image Database for Benchmarking of Automatic Face Detection Algorithms Prag Sharma, Richard B. Reilly UCD DSP Research Group This work is.
1 Content-Based Retrieval (CBR) -in multimedia systems Presented by: Chao Cai Date: March 28, 2006 C SC 561.
Image-Based Modeling, Rendering, and Lighting
IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.
ADVISE: Advanced Digital Video Information Segmentation Engine
Object-based Image Representation Dr. B.S. Manjunath Sitaram Bhagavathy Shawn Newsam Baris Sumengen Vision Research Lab University of California, Santa.
MUltimo3-D: a Testbed for Multimodel 3-D PC Presenter: Yi Shi & Saul Rodriguez March 14, 2008.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Content-Based Image Retrieval (CBIR) Student: Mihaela David Professor: Michael Eckmann Most of the database images in this presentation are from the Annotated.
Re-ranking Documents Segments To Improve Access To Relevant Content in Information Retrieval Gary Madden Applied Computational Linguistics Dublin City.
AceMedia Personal content management in a mobile environment Jonathan Teh Motorola Labs.
Visual Information Retrieval Chapter 1 Introduction Alberto Del Bimbo Dipartimento di Sistemi e Informatica Universita di Firenze Firenze, Italy.
Vision-Based Biometric Authentication System by Padraic o hIarnain Final Year Project Presentation.
SIEVE—Search Images Effectively through Visual Elimination Ying Liu, Dengsheng Zhang and Guojun Lu Gippsland School of Info Tech,
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
Carlos Lamsfus. ISWDS 2005 Galway, November 7th 2005 CENTRO DE TECNOLOGÍAS DE INTERACCIÓN VISUAL Y COMUNICACIONES VISUAL INTERACTION AND COMMUNICATIONS.
A summary of the report written by W. Alink, R.A.F. Bhoedjang, P.A. Boncz, and A.P. de Vries.
How to Face the Challenges of Web Archiving? The experiences of a small library on the edge. Chloe Martin, Internet Memory Catherine Ryan, National Library.
Culture & Sport Science & Technology: iMus – Israeli Museums System Public web portal
Automatic Identification of Concurrency in Handel-C Joseph C Libby, Kenneth B Kent, Farnaz Gharibian Faculty of Computer Science University of New Brunswick.
Multimedia Databases (MMDB)
Efficient Editing of Aged Object Textures By: Olivier Clément Jocelyn Benoit Eric Paquette Multimedia Lab.
- 1/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G DIGIFACT: Digitisation of Museum Artefacts Facilitating.
Content-Based Image Retrieval
Digital Image Processing & Analysis Spring Definitions Image Processing Image Analysis (Image Understanding) Computer Vision Low Level Processes:
11 October 2015 MAVIS v “Sneak Preview”. 11 October 2015 Enhancements in the Release  Reference Material  Brief Accessioning View  Template.
Producción de Sistemas de Información Agosto-Diciembre 2007 Sesión # 8.
Computer Vision – Overview Hanyang University Jong-Il Park.
© 2005 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice The China Digital Museum Project.
Introduction to Omeka. What is Omeka? - An Open Source web publishing platform - Used by libraries, archives, museums, and scholars through a set of commonly.
ISpheresImage iSpheresImage Feature Overview and Progress Summary.
EVIA Digital Archive New Tools William G. Cowan Mike Durbin Digital Library Program EVIA Digital Archive DLP Brown Bag 20 September 2006.
Intelligent Bilddatabassökning Reiner Lenz, Thanh H. Bui, (Linh V. Tran) ITN, Linköpings Universitet David Rydén, Göran Lundberg Matton AB, Stockholm.
Research Experience Daniel Fregosi Summer 2006 UNCC Visualization Center.
The Digital Library for Earth System Science: Contributing resources and collections GCCS Internship Orientation Holly Devaul 19 June 2003.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
1 Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP Reporter: 林浩棟.
Chittampally Vasanth Raja 10IT05F vasanthexperiments.wordpress.com.
Magic Camera Master’s Project Defense By Adam Meadows Project Committee: Dr. Eamonn Keogh Dr. Doug Tolbert.
MMDB-9 J. Teuhola Standardization: MPEG-7 “Multimedia Content Description Interface” Standard for describing multimedia content (metadata).
DSpace - Digital Library Software
Problem Query image by content in an image database.
Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.
TREC-2003 (CDVP TRECVID 2003 Team)- 1 - Center for Digital Video Processing C e n t e r f o r D I g I t a l V I d e o P r o c e s s I n g CDVP & TRECVID-2003.
Digital Video Library Network Supervisor: Prof. Michael Lyu Student: Ma Chak Kei, Jacky.
Soon Joo Hyun Database Systems Research and Development Lab. US-KOREA Joint Workshop on Digital Library t Introduction ICU Information and Communication.
DANIELA KOLAROVA INSTITUTE OF INFORMATION TECHNOLOGIES, BAS Multimedia Semantics and the Semantic Web.
Final Year Project. Project Title Kalman Tracking For Image Processing Applications.
Content-Based MP3 Information Retrieval Chueh-Chih Liu Department of Accounting Information Systems Chihlee Institute of Technology 2005/06/16.
WebDat: A Web-based Test Data Management System J.M.Nogiec January 2007 Overview.
Query by Image and Video Content: The QBIC System M. Flickner et al. IEEE Computer Special Issue on Content-Based Retrieval Vol. 28, No. 9, September 1995.
ELVIS Educational Laboratory Virtual Instrumentation Suite: Phase II Abstract Problem Statement The goal of this project is to convert the EE 201 labs.
INFORMATION STROAGE AND RETRIEVAL SYSTEM By Ms. Preeti Patel Lecturer School of Library And Information Science DAVV, Indore
Chang, Wen-Hsi Division Director National Archives Administration, 2011/3/18/16:15-17: TELDAP International Conference.
MPEG 7 &MPEG 21.
Visualization of Three-Dimensional Geometric Models in a Stereoscopic System Rositsa Radoeva Assistant professor at St. Cyril and St. Methodius University.
Day 3: computer vision.
Digital Video Library - Jacky Ma.
Visual Information Retrieval
Presentation transcript:

- 1/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G DIGIFACT: Digitisation of Museum Artefacts Facilitating Search & Retrieval Noel O’Connor & Robert Keogh C entre for D igital V ideo P rocessing Dublin City University, Ireland

- 2/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Outline Background –Motivation, project objectives, funding, timeline & plan 2D artefact indexing –Image capture, object segmentation, feature extraction, database population, search & retrieval Exploring 3D indexing –Depth-based features –Image-based rendering Conclusion

- 3/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Motivation NMI collection: –4-5 million objects –4 curatorial divisions –4 separate geographical locations –Only a small fraction physically on display –Similar problems are faced by other museums Requirement for collections to be documented so that they are accessible for browsing and searching. At present 1 : –“subjective written descriptions supported by often copious 2D images which are unable to deliver concise visual definitions of complete objects” –“is excessively time consuming, cumbersome and inflexible” 1 ORION research roadmap for the European archaeological museums’ sector

- 4/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Project Objectives To develop a low-cost approach to image-based indexing of artefacts –Straighforward image capture –Automatic extraction of searchable image- based metadata –Can be used to complement (extend) existing cataloging processes –Explore 3D indexing and imaging For the end-user: –“Find me similar views of similar artefacts" –"Show me this artefact from a different (user defined) angle”

- 5/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Funding EI Proof of Concept: –1 year project, €90k (approx.) –Competitive bid (<25% funded) –Letters of support from NMI and MERL –Aim: validate the original idea –People: Noel O’Connor (PI), Alan Smeaton, Gareth Jones, Robert Keogh, Phil Kelly (part-time), Eddie Cooke (previously) Technology Development: –Opportunity to re-apply in 2 nd phase –Still competitive … but successful PoC helps! –3 year project, €350K Need strong business case (valuable IP generation)

- 6/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Project Plan

- 7/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Image Capture “Off the shelf” Components Easy to source, set- up and use Entire cost < €2,000

- 8/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G 2D Indexing Segmentation –Extracting the object’s shape from the (green) background Feature extraction –Calculating a description of the object’s shape, colour and texture Description –Structured, searchable metadata file imported to database –Standards compliant Use existing research: –aceToolbox*: a multi- platform software tool-box for low-level MPEG-7 visual analysis –Video object segmentation and modeling* + *Funded by EU FP6 +Funded by EI Tech Dev

- 9/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G 2D Indexing Demo: –Data capture (saw in lab) –Admin application: Add new artefact Edit description: extract object, calculate description, add to database –Search and Retrieval Application Select existing image/object Find similar objects by matching descriptions (only uses 1 feature at the moment)

- 10/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G 3D Indexing Rotating turntable is like multiple cameras placed around the object –Each pair of images is like a stereo pair –Can use computer vision techniques to extract 3D information –Rudimentary depth estimation –Info can be used to generate virtual views 5˚ 0˚ 10˚

- 11/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G Conclusions Good initial progress 2D indexing work well in hand 3D work at much earlier stage Thanks for your attention!