Event-Based Fusion of Distributed Multimedia Data Sources Vincent Oria Department of Computer Science New Jersey Institute of Technology Newark, NJ 07102.

Slides:



Advertisements
Similar presentations
A Stepwise Modeling Approach for Individual Media Semantics Annett Mitschick, Klaus Meißner TU Dresden, Department of Computer Science, Multimedia Technology.
Advertisements

Data Warehousing CPS216 Notes 13 Shivnath Babu. 2 Warehousing l Growing industry: $8 billion way back in 1998 l Range from desktop to huge: u Walmart:
Chapter 2 Database Environment.
Multimedia Search and Retrieval: New Concepts, System Implementation, and Application Qian Huang, Atul Puri, Zhu Liu IEEE TRANSACTION ON CIRCUITS AND SYSTEMS.
ADVISE: Advanced Digital Video Information Segmentation Engine
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Multimedia Search and Retrieval Presented by: Reza Aghaee For Multimedia Course(CMPT820) Simon Fraser University March.2005 Shih-Fu Chang, Qian Huang,
Advanced Topics COMP163: Database Management Systems University of the Pacific December 9, 2008.
Data Sources Data Warehouse Analysis Results Data visualisation Analytical tools OLAP Data Mining Overview of Business Intelligence Data visualisation.
1 Location Information Management and Moving Object Databases “Moving Object Databases: Issues and Solutions” Ouri, Bo, Sam and Liqin.
1 Lecture 13: Database Heterogeneity Debriefing Project Phase 2.
Architecture & Data Management of XML-Based Digital Video Library System Jacky C.K. Ma Michael R. Lyu.
Data Management I DBMS Relational Systems. Overview u Introduction u DBMS –components –types u Relational Model –characteristics –implementation u Physical.
Visual Information Retrieval Chapter 1 Introduction Alberto Del Bimbo Dipartimento di Sistemi e Informatica Universita di Firenze Firenze, Italy.
COMP 578 Data Warehousing And OLAP Technology Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
CH 11 Multimedia IR: Models and Languages
The University of Akron Dept of Business Technology Computer Information Systems Database Management Approaches 2440: 180 Database Concepts Instructor:
Automatic Data Ramon Lawrence University of Manitoba
CSE6011 Warehouse Models & Operators  Data Models  relations  stars & snowflakes  cubes  Operators  slice & dice  roll-up, drill down  pivoting.
Chapter 13 The Data Warehouse
Lecture Two Database Environment Based on Chapter Two of this book:
Ch3 Data Warehouse part2 Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009.
Introduction and Conceptual Modeling
OLAP OPERATIONS. OLAP ONLINE ANALYTICAL PROCESSING OLAP provides a user-friendly environment for Interactive data analysis. In the multidimensional model,
A Scalable Framework for the Collaborative Annotation of Live Data Streams Thesis Proposal Tao Huang
Database Environment 1.  Purpose of three-level database architecture.  Contents of external, conceptual, and internal levels.  Purpose of external/conceptual.
Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
Override the title Chris Harrington
An Extension to XML Schema for Structured Data Processing Presented by: Jacky Ma Date: 10 April 2002.
Data Management Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Multimedia Databases: Where are we?
Chapter 7 Web Content Mining Xxxxxx. Introduction Web-content mining techniques are used to discover useful information from content on the web – textual.
Database System Concepts and Architecture
A Proposal for a Video Modeling for Composing Multimedia Document Cécile ROISIN - Tien TRAN_THUONG - Lionel VILLARD Presented by: Tien TRAN THUONG Project.
Ahsan Abdullah 1 Data Warehousing Lecture-11 Multidimensional OLAP (MOLAP) Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 5-1 Chapter 5 Business Intelligence: Data.
Dr. Mohamed Osman Hegazi 1 Database Systems Concepts Database Systems Concepts Course Outlines: Introduction to Databases and DBMS. Database System Concepts.
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
DBSQL 12-1 Copyright © Genetic Computer School 2009 Chapter 12 Recent Concepts and Application of Databases.
1 Data Warehouses BUAD/American University Data Warehouses.
The Data Warehouse “A data warehouse is a subject-oriented, integrated, time-variant, and nonvolatile collection of “all” an organisation’s data in support.
October 28, Data Warehouse Architecture Data Sources Operational DBs other sources Analysis Query Reports Data mining Front-End Tools OLAP Engine.
Rupa Tiwari, CSci5980 Fall  Course Material Classification  GIS Encyclopedia Articles  Classification Diagram  Course – Encyclopedia Mapping.
DATABASE MANAGEMENT SYSTEM ARCHITECTURE
1 Chapter 1 Introduction to Databases Transparencies.
Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #15 Secure Multimedia Data.
Issues in Ontology-based Information integration By Zhan Cui, Dean Jones and Paul O’Brien.
Digital Video Library Network Supervisor: Prof. Michael Lyu Student: Ma Chak Kei, Jacky.
Object storage and object interoperability
1 Database Environment. 2 Objectives of Three-Level Architecture u All users should be able to access same data. u A user’s view is immune to changes.
1 Chapter 2 Database Environment Pearson Education © 2009.
MULTIMEDIA DATA MODELS AND AUTHORING
Database Environment Chapter 2. The Three-Level ANSI-SPARC Architecture External Level Conceptual Level Internal Level Physical Data.
1 Database Systems, 8 th Edition Star Schema Data modeling technique –Maps multidimensional decision support data into relational database Creates.
Introduction: Databases and Database Systems Lecture # 1 June 19,2012 National University of Computer and Emerging Sciences.
MPEG 7 &MPEG 21.
Visual Information Retrieval
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Introduction Multimedia initial focus
Data and Applications Security Developments and Directions
Multimedia Content-Based Retrieval
Chapter 13 The Data Warehouse
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
Data Warehouse.
Data, Databases, and DBMSs
Multimedia Content Description Interface
Database Systems Instructor Name: Lecture-3.
Presentation transcript:

Event-Based Fusion of Distributed Multimedia Data Sources Vincent Oria Department of Computer Science New Jersey Institute of Technology Newark, NJ 07102

2 Outline Classical Data Integration Problem Multimedia Data An Architectural approach to Multimedia Data Integration Event-Based Integration of Data Sources Conclusion

3 Classical Data Integration* * Borrowed from M. Lenzerini

4 Classical Data Integration Issues How to construct the global schema? (Automatic) source wrapping How to discover mappings between the sources and the global schema? Limitations in the mechanisms for accessing the sources Data extraction, cleaning and reconciliation How to process updates expressed on the global schema, and updates expressed on the sources? The modeling problem: How to model the mappings between the sources and the global schema? The querying problem: How to answer queries expressed on the global schema? Query optimization

5 Multimedia Data Multimedia data management is more than physical server design Logical data modeling is important Multimedia data management is more than similarity search “Show me all the images that are similar to this one [in terms of color, texture, shape].” Querying is much more complicated Give me all the news items on Baghdad over the last 2 weeks

6 Multimedia Data … Multimedia data is heterogeneous in both format and in access primitives and this has to be accommodated You cannot store all the data in a single DBMS; the system has to be open Query-based access to multimedia data is important as well as browsing and some transactional access Some DBMS-like interface and control over multimedia data should be provided

7 Multimedia Data … Multimedia data management is not data model independent The complexity of the primitive data types and the required extensibility necessitate certain functionality It does not make sense to completely ignore standardization or to be slave to them Follow, and perhaps extend, standards (e.g., XML, MPEG, …)

8 Multimedia Database Processing Multimedia Data Preprocessing System Database Processing MM Data Pre- processor Additional Information..... Multimedia DBMS Users Query Interface MM Data Instance..... Recognized components MM Data Instance MM Data Meta-Data

9 Document Database Architecture Document Processing System Database Processing DTD or XML Schema files Schema Parser..... DTD/ XML Manager Type Generator Document DBMS Users Query Interface DTD/ XML Schema Document content Documents XML or SGML Document Instance Parse Tree DTD/ XML Schema Types Objects Document Parser Instance Generator

10 Image Database Architecture Image Processing System Database Processing Image Analysis and Pattern Recognition Image Annotation Image DBMS Users Query Interface Image Content Description Image Syntactic Objects Semantic Objects..... Meta-Data

11 Video Database Architecture Video Processing System Database Processing Video Analysis and Pattern Recognition Video Annotation Video DBMS Users Query Interface Video Key Frames Meta-Data..... Video Content Description Video

12 Multimedia Data Integration: An Architectural Perspective Simple Client-Server Integrated Server Database Server Middleware and Mediation

13 Simple Client-Server Heavy-duty client  Synchronization, user interface, QoS, … Client has to access each server Scalability problems  client code has to be updated when new servers come on-line Meta- data Database Server Database Server Text Server Text Server Text Image Server Image Server Images CM Server CM Server Video/ Audio Client

14 “Integrated” Server Heavy-duty server DBMS should be able to handle multiple storage systems Real-time constraints on CM Meta- data Video/ Audio Images Text Image Server CM Server Object Storage Server DBMS Functions Client

15 Database Server Lighter client Client has to access only one server Scalability problems  server may become a bottleneck - distribute and interoperate Meta- data CM Server CM Server Video/ Audio Image Server Image Server Images Text Server Text Server Database Server Database Server Client

16 Document Server Document-centric view  Multimedia objects are parts of documents Might be suitable for, e.g., e-commerce catalogs Video/ Audio Images Text Structured Document DBMS Image DBMS CM DBMS Client

17 Interoperable System Middleware Wrapper Text DBMS Text DBMS Video DBMS Image DBMS Image DBMS Mediator Client

18 Event-Based Multimedia Data Integration An event aims at modeling any happening  Facts, context An event has 3 components  Time  Space (location)  Objects

19 Events: Temporal Dimension Time Line and Temporal relationships Event1 ImageVideo Text Event2 ImageVideo Event3 ImageVideo Image Time Line

20 Events: Spatial Dimension GIS (Location and Spatial Relationships) Event1 Event2 Event3 Directional and Topological relationships

21 Events: Object Dimension Which real world objects are involved in the event?  Object Recognition  Classical Data Integration

22 Event: Spatio-Temporal Dimension Moving Objects and their Trajectories  Raw representation: The trajectory T of a moving object is defined as a sequence of vectors T=[t 1, …, t n ] Each r i show the successive positions of the moving object over a period of time.  Movement sequence: The trajectory of a moving object is represented by a sequence of (movement direction, distance ratio) pairs. This representation is not affected by rotation, shifting or scaling. M=[m 1, …, m n-1 ] Each m i is a pair of (movement direction, distance ratio).

23 Event Model Events model interpretation context Example: KIMCOE 2006 is an event Participants are objects Location: Hilton Garden Inn, Suffolk, Virginia Date/Time: October , 2006 Has sub-events like sessions or visit of Lockheed Martin's Center For Innovation Event Properties Discrete or continuous Local or distributed Simple or composite Descriptors: Data (classical and multimedia)

24 Event Querying Objects: RDBM, XML Time Space: GIS

25 Event Querying Objects: RDBM, XML Time Space: GIS

26 Event Querying Objects: RDBM, XML Time Space: GIS

27 Event Operators Temporal Operator Spatial Operators Spatio-Temporal Operator Aggregation

28 Aggregation and Concept Hierarchy Dimensions are hierarchical by nature: total orders or partial orders Example: Location(continent  country  province  city) Time(year  quarter  (month,week)  day) Industry Country Year Category Region Quarter Product City Month Week Office Day

29 Aggregation and Concept Hierarchy: Operators  roll-up (increase the level of abstraction)  drill-down (decrease the level of abstraction)  slice and dice (selection and projection)  pivot (re-orient the multi-dimensional view)  drill-through (links to the raw data)

30 Aggregation and Concept Hierarchy: Roll-up Use of aggregation to summarize at different levels of a dimension hierarchy  Ex: if we are given total sales per city we can aggregate on the market to obtain sales per state Dayton Q1 Q2Q4 Drama Horror Sci. Fi.. Comedy Time (Quarters) Market (city, state) Q3 Newark S. Orange N. York Category Roll-up on Market Ohio Q1 Q2Q4 Drama Horror Sci. Fi.. Comedy Time (Quarters) Market (States,, USA) Category Q3 New Jersey New York Arizona

31 Aggregation and Concept Hierarchy: Drill-down Inverse of roll-up  Given a total sales by state, we can ask for more detailed presentation by drilling down on market Dayton Q1 Q2Q4 Drama Horror Sci. Fi.. Comedy Market (city, state) Q3 Newark S. Orange N. York Category Drill-down on Market Ohio Q1 Q2Q4 Drama Horror Sci. Fi.. Comedy Time (Quarters) Market (States,, USA) Category Q3 New Jersey New York Arizona

32 Aggregation and Concept Hierarchy: Dice and Slice January Slice on January Newark Electronics January Dice on Electronics and Newark

33 Conclusion Event model: A data Integration model This is a work in progress: We need to fully define the event model We want to build on existing Technology (RDBMS, XML, GIS,..)