ConQuer: Efficient Management of Inconsistent Databases Presented by: Presented by: Ariel Fuxman (Univ. of Toronto) Ariel Fuxman (Univ. of Toronto) Joint.

Slides:



Advertisements
Similar presentations
Uncertainty in Data Integration Ai Jing
Advertisements

Limitations of the relational model 1. 2 Overview application areas for which the relational model is inadequate - reasons drawbacks of relational DBMSs.
1 Lecture 5: SQL Schema & Views. 2 Data Definition in SQL So far we have see the Data Manipulation Language, DML Next: Data Definition Language (DDL)
Using MIS 2e Chapter 5 Database Processing MARIA DEL MORAL GROUP F.
Efficient Management of Inconsistent and Uncertain Data Renée J. Miller University of Toronto.
Computer Science & Engineering 2111 Introduction to Database Systems 1CSE 2111-Introduction to Database Systems.
ConQuer: Efficient Management of Inconsistent Databases Presented by: Presented by: Ariel Fuxman (Univ. of Toronto) Ariel Fuxman (Univ. of Toronto) Joint.
Incremental Maintenance for Non-Distributive Aggregate Functions work done at IBM Almaden Research Center Themis Palpanas (U of Toronto) Richard Sidle.
ISP 121 Access Normalization and Relationships. Normalization Say we’re operating a pet day-care and we need to keep information on our pets/customers.
24/1/20081 Architecture of multiple databases integration.
Ch1: File Systems and Databases Hachim Haddouti
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
CS405G: Introduction to Database Systems Final Review.
Dr. Kalpakis CMSC 461, Database Management Systems Introduction.
Computer Science & Engineering 2111 Introduction to Database Management Systems Relationships and Database Creation 1 CSE 2111 Introduction to Database.
Annotating Search Results from Web Databases. Abstract An increasing number of databases have become web accessible through HTML form-based search interfaces.
CS462: Introduction to Database Systems. ©Silberschatz, Korth and Sudarshan1.2Database System Concepts Course Information Instructor  Kyoung-Don (KD)
AS Level ICT Mrs. Ghazaal. In the past, when a customer wanted to talk to someone in a company they would usually be able to telephone and be put through.
Introduction to Databases
1 Intro to Info Tech Database Management Systems Copyright 2003 by Janson Industries This presentation can be viewed on line at:
Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support Chapter 25, Part B.
Midterm Exam Chapters 1,2,3,5, 6,7 (closed book) March 11, 2014.
DATABASES Pindaro Demertzoglou – Lally School of Management and Technology.
Lecture 1: Introduction Faculty of Computer Science Technion – Israel Institute of Technology Spring 2015.
Configuration Management (CM)
DATA-DRIVEN UNDERSTANDING AND REFINEMENT OF SCHEMA MAPPINGS Data Integration and Service Computing ITCS 6010.
M Taimoor Khan Course Objectives 1) Basic Concepts 2) Tools 3) Database architecture and design 4) Flow of data (DFDs)
©2003 Prentice Hall Business Publishing, Accounting Information Systems, 9/e, Romney/Steinbart 4-1 Accounting Information Systems 9 th Edition Marshall.
Database Management Systems Introduction. In the Beginning… Customer Program 1.
Lecture2: Database Environment Prepared by L. Nouf Almujally & Aisha AlArfaj 1 Ref. Chapter2 College of Computer and Information Sciences - Information.
Organizing Data Revision: pages 8-10, 31 Chapter 3.
Keyword Searching and Browsing in Databases using BANKS Seoyoung Ahn Mar 3, 2005 The University of Texas at Arlington.
Computer Science & Engineering 2111 Lecture 10 Introduction to Database Management Systems 1.
1 ICOM 5016 – Introduction to Database System Project # 1 Dr. Manuel Rodriguez-Martinez Department of Electrical and Computer Engineering University of.
CASE Tools Union Palenshus. In the early days… ► Software engineering tools consisted solely of translators, compilers, assemblers, linkers, loaders,
SE305 Database System Technology 23/10/2014 Quiz-2.
Hippo a System for Computing Consistent Query Answers to a Class of SQL Queries Jan Chomicki University at Buffalo Jerzy Marcinkowski Wroclaw University.
Database Security Lesson Introduction ●Understand the importance of securing data stored in databases ●Learn how the structured nature of data in databases.
Jennifer Widom Relational Databases The Relational Model.
ASET 1 Amity School of Engineering & Technology B. Tech. (CSE/IT), III Semester Database Management Systems Jitendra Rajpurohit.
Lecture 15: Query Optimization. Very Big Picture Usually, there are many possible query execution plans. The optimizer is trying to chose a good one.
Databases Databases are collections of information; our study repeats a theme: Tell the computer the structure, and it can help you! © 2004, Lawrence Snyder.
Database System Concepts Introduction Purpose of Database Systems View of Data Data Models Data Definition Language Data Manipulation Language Transaction.
Data Resource Management Application Layer TPS A RCHITECTURE Data Layer Sales/MarketingHR Finance/Accounting Operations Spreadsheet Data MS Access Accounts.
Databases Salihu Ibrahim Dasuki (PhD) CSC102 INTRODUCTION TO COMPUTER SCIENCE.
©Silberschatz, Korth and Sudarshan 1.1 Database System Concepts قواعد البيانات Data Base قواعد البيانات CCS 402 Mr. Nedal hayajneh E- mail
CHAPTER 1: INTRODUCTION Purpose of Database Systems View of Data Data Models Data Definition Language Data Manipulation Language Storage Management Database.
CIS 336 AID Your Dreams Our Mission/cis336aid.com
Chapter 1: Introduction
Chapter 1: Introduction
CIS 336 Slingshot Academy / cis336study.com
Introduction to Database Systems
CIS 336 str Competitive Success/snaptutorial.com
CIS 336 Competitive Success/snaptutorial.com
CIS 336 PAPERS Education Your Life-- cis336papers.com.
CIS 336 PAPERS Lessons in Excellence-- cis336papers.com.
CIS 336 str Education for Service- -snaptutorial.com.
CIS 336 Education for Service-- snaptutorial.com.
CIS 336 Teaching Effectively-- snaptutorial.com
CIS 336 str Teaching Effectively-- snaptutorial.com.
CIS 336 PAPERS Education for Service-- cis336papers.com.
Managing Inconsistent Data in Data Integration and Data Exchange
Relational Databases The Relational Model.
Relational Databases The Relational Model.
Views Automatic View Modifications.
Consistent Query Answering: a personal perspective
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Chapter 1: Introduction
Presentation transcript:

ConQuer: Efficient Management of Inconsistent Databases Presented by: Presented by: Ariel Fuxman (Univ. of Toronto) Ariel Fuxman (Univ. of Toronto) Joint work with: Diego Fuxman (Univ. Nacional del Sur) Diego Fuxman (Univ. Nacional del Sur) Renée J. Miller (Univ. of Toronto) Renée J. Miller (Univ. of Toronto)

Ariel Fuxman, Diego Fuxman, Renée J. Miller 2 A system designed to answer SQL queries over inconsistent databases A system designed to answer SQL queries over inconsistent databases ConQuer 130KMary 110KMary 400KPaul 200KPeter 40KPeter IncomeName name should be the key INCONSISTENT DATABASE

Ariel Fuxman, Diego Fuxman, Renée J. Miller 3 One Application Sales Shipping Customer Support Web Forms Demographic Data IntegratedCustomerDatabase Customer Relationship Management (CRM)

Ariel Fuxman, Diego Fuxman, Renée J. Miller 4 Disagreement Between Sources Which tuple for Peter should we delete? Which tuple for Peter should we delete? Removing both tuples loses consistent information Removing both tuples loses consistent information Deciding the correct income may require human intervention Deciding the correct income may require human intervention 110K… 20 Union Street Mary 400K… 100 Bloor Street Paul …. … 276 College Street address 40KPeter incomename 400K… 100 Bloor Street Paul 130K… 20 Union Street Mary …. … 276 College Street address 200KPeter incomename sales web

Ariel Fuxman, Diego Fuxman, Renée J. Miller 5 Inconsistent Integrated Database name…income Peter…40K Paul…400K Mary…110K name…incomePeter…200K Paul…400K Mary…130K name…incomePeter…40K Peter…200K Paul…400K Mary…110K Mary…130K Sales Web Integrated Database Transfer all conflicting tuples to the integrated database INCONSISTENT DATABASE

Ariel Fuxman, Diego Fuxman, Renée J. Miller 6 Query Answering q=“Get customers who make more than 100K” 130K 110K 400K 200K 40K income web sales sales/web web sales Mary Mary Paul Peter Peter name Peter,Paul,Mary Peter should NOT be offered a Platinum card!! Offering a Platinum credit card…

Ariel Fuxman, Diego Fuxman, Renée J. Miller 7 Get customers who possibly make more than 100K Get customers who possibly make more than 100K Get customers who certainly make more than 100K Get customers who certainly make more than 100K There is considerable work in the literature about theoretical aspects of consistent answers There is considerable work in the literature about theoretical aspects of consistent answers ConQuer: Efficient computation of consistent answers ConQuer: Efficient computation of consistent answers Semantics of Query Answering CONSISTENT ANSWER [Arenas, Bertossi, Chomicki 99]

Ariel Fuxman, Diego Fuxman, Renée J. Miller 8 Commercial database engine Query Answering in ConQuer Query q Keys Keys Rewritten Q * ConQuer’sRewritingAlgorithm [ICDT 05] [SIGMOD 05] Inconsistentdatabase May not get consistent answers Consistent answer to q

Ariel Fuxman, Diego Fuxman, Renée J. Miller 9 Demo Present a case study of an inconsistent database about airports and cities Present a case study of an inconsistent database about airports and cities Explain the automatically generated rewritings Explain the automatically generated rewritings Deal with Select-Project-Join queries with grouping and aggregation Deal with Select-Project-Join queries with grouping and aggregation

Ariel Fuxman, Diego Fuxman, Renée J. Miller 10 ConQuer papers A. Fuxman, E. Fazli, and R. J. Miller. ConQuer: Efficient Management of Inconsistent Databases, SIGMOD A. Fuxman, E. Fazli, and R. J. Miller. ConQuer: Efficient Management of Inconsistent Databases, SIGMOD A. Fuxman and R. J. Miller. First-Order Query Rewriting for Inconsistent Databases, ICDT A. Fuxman and R. J. Miller. First-Order Query Rewriting for Inconsistent Databases, ICDT 2005.

Ariel Fuxman, Diego Fuxman, Renée J. Miller 11 Schema A_ICAO a_name a_city a_country a_latdeg a_latmin a_latsec a_latdir a_height C_IATA c_icao CI_NAME CI_COUNTRY ci_population ci_year CODES AIRPORTS CITIES