Wrappers in Mediator-Based Systems Chapter 21.3 Information Integration Presented By Annie Hii Toderici.

Slides:



Advertisements
Similar presentations
Chapter 1 Getting Started with Access Databases. Objectives Identify Good Database Design Create a Table and Define Fields in a New Blank Database Change.
Advertisements

Business Intelligence (BI) PerformancePoint in SharePoint 2010 Sayed Ali – SharePoint Administrator.
CS104: Chapter 15 CS 104 Students and me. Big Question Q: You say creating a class is how to create a new type. Why would we even want to do this?! A:
Lukas Blunschi Claudio Jossen Donald Kossmann Magdalini Mori Kurt Stockinger.
Chapter 23 Database Security and Authorization Copyright © 2004 Pearson Education, Inc.
SECTION 21.5 Eilbroun Benjamin CS 257 – Dr. TY Lin INFORMATION INTEGRATION.
Advanced Database Systems September 2013 Dr. Fatemeh Ahmadi-Abkenari 1.
CS 257 Database Systems Principles Assignment 1 Instructor: Student: Dr. T. Y. Lin Rajan Vyas (119)
Chapter 21.2 Modes of Information Integration ID: 219 Name: Qun Yu Class: CS Spring 2009 Instructor: Dr. T.Y.Lin.
SECTIONS 21.4 – 21.5 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin INFORMATION INTEGRATION.
OLAP. Overview Traditional database systems are tuned to many, small, simple queries. Some new applications use fewer, more time-consuming, analytic queries.
CS 257 Database Systems Principles Assignment 1 Instructor: Student: Dr. T. Y. Lin Rajan Vyas (119)
Capability-Based Optimization in Mediators Rohit Deshmukh ID 120 CS-257 Rohit Deshmukh ID 120 CS-257.
Chapter 3. 2 Chapter 3 - Objectives Terminology of relational model. Terminology of relational model. How tables are used to represent data. How tables.
Multi-Attribute Exchange Market: Theory and Experiments Eugene Fink Josh Johnson John Hershberger.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 6 The Relational Algebra and Relational Calculus.
Chapter 21 Information Integration 21.3 Wrappers in Mediator-Based Systems Presented by: Kai Zhu Professor: Dr. T.Y. Lin Class ID: 220.
Automatic Data Ramon Lawrence University of Manitoba
Chapter 7 Managing Data Sources. ASP.NET 2.0, Third Edition2.
Information systems and databases Database information systems Read the textbook: Chapter 2: Information systems and databases FOR MORE INFO...
A tour of new features introducing LINQ. Agenda of LINQ Presentation We have features for every step of the way LINQ Fundamentals Anonymous Functions/Lambda.
Query Optimization CS 157B Ch. 14 Mien Siao. Outline Introduction Steps in Cost-based query optimization- Query Flow Projection Example Query Interaction.
Maintaining and Querying a Database Microsoft Access 2010.
Lecture 2 The Relational Model. Objectives Terminology of relational model. How tables are used to represent data. Connection between mathematical relations.
Chapter 4 The Relational Model Pearson Education © 2014.
Optimizing Queries and Diverse Data Sources Laura M. Hass Donald Kossman Edward L. Wimmers Jun Yang Presented By Siddhartha Dasari.
©Silberschatz, Korth and Sudarshan4.1Database System Concepts Chapter 4: SQL Basic Structure Set Operations Aggregate Functions Null Values Nested Subqueries.
On-Line Analytic Processing Chetan Meshram Class Id:221.
Chapter 21.2 Modes of Information Integration ID: 219 Name: Qun Yu Class: CS Spring 2009 Instructor: Dr. T.Y.Lin.
CSE 636 Data Integration Limited Source Capabilities Slides by Hector Garcia-Molina Fall 2006.
Chapter 3 The Relational Model. 2 Chapter 3 - Objectives u Terminology of relational model. u How tables are used to represent data. u Connection between.
20.5 Data Cubes Instructor : Dr. T.Y. Lin Chandrika Satyavolu 222.
A Query Translation Scheme for Rapid Implementation of Wrappers Presented By Preetham Swaminathan 03/22/2007 Yannis Papakonstantinou, Ashish Gupta, Hector.
Sensor Database System Sultan Alhazmi
CSE314 Database Systems The Relational Algebra and Relational Calculus Doç. Dr. Mehmet Göktürk src: Elmasri & Navanthe 6E Pearson Ed Slide Set.
Introduction to Databases Trisha Cummings. What is a database? A database is a tool for collecting and organizing information. Databases can store information.
Distributed Information Retrieval Using a Multi-Agent System and The Role of Logic Programming.
Submitted by: Deepti Kundu Submitted to: Dr.T.Y.Lin
Unit 5 Lecture 2 Error Control Error Detection & Error Correction.
INFORMATION INTEGRATION Shengyu Li CS-257 ID-211.
1 Information Integration. 2 Information Resides on Heterogeneous Information Sources different interfaces different data representations redundant and.
8 1 Chapter 8 Advanced SQL Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
1 Information Integration Mediators Warehousing Answering Queries Using Views Slides are modified from Dr. Ullman’s notes.
DBMS2001Notes 10: Information Integration1 Principles of Database Management Systems 10: Information Integration Pekka Kilpeläinen University of Kuopio.
2005/12/021 Fast Image Retrieval Using Low Frequency DCT Coefficients Dept. of Computer Engineering Tatung University Presenter: Yo-Ping Huang ( 黃有評 )
Information Integration By Neel Bavishi. Mediator Introduction A mediator supports a virtual view or collection of views that integrates several sources.
Resource negotiation Two-tier negotiation protocol:  Provider and Mediator  Mediator and Client Provider provides resources/services Mediator aggregates.
Wrappers in Mediator-Based Systems. Introduction Mediator Wrapper Source 1 Source 2 Query Result.
Object storage and object interoperability
20 Copyright © 2008, Oracle. All rights reserved. Cache Management.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Section 20.1 Modes of Information Integration Anilkumar Panicker CS257: Database Systems ID: 118.
ACCESS CHAPTER 2 Introduction to ACCESS Learning Objectives: Understand ACCESS icons. Use ACCESS objects, including tables, queries, forms, and reports.
Chapter 4 The Relational Model Pearson Education © 2009.
Chapter 111 Chapter 11 Information Integration Spring 2001 Prof. Sang Ho Lee School of Computing, Soongsil Univ.
Rendering XML Documents ©NIITeXtensible Markup Language/Lesson 5/Slide 1 of 46 Objectives In this session, you will learn to: * Define rendering * Identify.
Information Integration(cntd.)
15.1 – Introduction to physical-Query-plan operators
Chapter 11 Information Integration
On-Line Analytic Processing
Presented by: Kai Zhu Professor: Dr. T.Y. Lin Class ID: 220
SQL: Structured Query Language DML- Queries Lecturer: Dr Pavle Mogin
Chapter 15 QUERY EXECUTION.
GO! with Microsoft® Access e
Chapter 4 The Relational Model Pearson Education © 2009.
Chapter 4 The Relational Model Pearson Education © 2009.
Query Execution Presented by Jiten Oswal CS 257 Chapter 15
Information Integration
02 | Querying Tables with SELECT
Programming Techniques
Presentation transcript:

Wrappers in Mediator-Based Systems Chapter 21.3 Information Integration Presented By Annie Hii Toderici

Outline Templates for Query Patterns Wrapper Generators Filters Other Operations at the Wrapper

Extractors in Data Warehouse Extractors (wrapper) consist of: ◦ Predefined queries that are executed at the source to produce data for the warehouse ◦ Suitable communication mechanisms  Pass specific queries to the source  Receive responses from the source  Pass information to the warehouse

Warehouse Source 1 Combiner Extractor Source 2 resultuser query

Wrappers in Mediator Systems Mediator systems require more complex wrappers than warehouse systems Must be able to accept a variety of queries from the mediator and translate any of them to the terms of the source

Mediator Wrapper Source 1 queryresult queryresult Wrapper Source 2 queryresult queryresult queryresult

Wrapper Wrapper connects a mediator to a source Wrapper (aka “adapter”) translates incoming queries and outgoing answers Wrappers are defined by templates The wrapper generator creates tables of all possible templates The driver and tables constitute the wrapper

Templates for Query Patterns Design a wrapper ◦ Classify the possible queries that the mediator can ask into templates Templates are queries with parameters that represent constants (e.g., red) Uses the notation T=>S ◦ Template T is turned by the wrapper into the source query S

Templates Suppose we want to build a wrapper for the source of Dealer 1 Dealer 1 ◦ Cars(serialNo, model, color, autoTrans, navi, …) Mediator ◦ AutosMed(serialNo, model, color, autoTrans, dealer)

Template: cars of a given color ($c) SELECT * FROM AutosMed WHERE color = ‘$c’; => SELECT serialNo, model, color, autoTrans, ‘dealer1’ FROM Cars WHERE color = ‘$c’;

Templates Other templates would be needed to deal with other queries ◦ Type of models: parameter $m ◦ Type of transmission: parameter $t ◦ Seat type: parameter $s N attributes, 2 n possible templates Number of templates could grow unreasonably large, it is possible to simplify

Wrapper Generators A collection of templates is given to the wrapper generator (WG) WG creates a table that holds the various query patterns contained in the templates, and the source queries that are associated with each

Wrapper generator Driver Table Source Templates ResultsQueries from mediator QueriesResult

Task of the driver Accept a query from the mediator Search the table for a template that matches the query The source query is sent to the source The response is processed by the wrapper, and then returned to the mediator

Filters Not always realistic to write a template for every possible form of query To have the wrapper filter the results of queries that it poses to the source The wrapper has a template that returns a superset of what the query wants, then filter the returned tuples at the wrapper and pass only the desired tuples to the mediator

Example Filter: blue Civic SELECT * FROM AutosMed WHERE color = ‘$c’; => SELECT serialNo, model, color, autoTrans, ‘dealer1’ FROM cars WHERE color = ‘$c’; Set $c = ‘blue’ TempAutos(serialNo, model, color, autoTrans, dealer) SELECT * FROM TempAutos WHERE model = ‘Civic’;

Other Operations at the Wrapper To transform data in other ways ◦ Columns may be projected out of the tuples before transmission to the mediator ◦ To take aggregations or joins at the wrapper and transmit the result to the mediator

Mediator: find blue Civic and retrieve serial #, transmission type and dealers SELECT * FROM AutosMed WHERE color = ‘$c’; => SELECT serialNo, model, color, autoTrans, ‘dealer1’ FROM cars WHERE color = ‘$c’; Set $c = ‘blue’ TempAutos(serialNo, model, color, autoTrans, dealer) SELECT serialNo, autoTrans, dealer FROM TempAutos WHERE model = ‘Civic’;

Examples Mediator: find dealers s.t there are two red cars of the same model, one manual and one automatic Query from mediator to wrapper: SELECT A1.model A1.dealer FROM AutosMed A1, AutosMed A2 WHERE A1.model = A2.model AND A1.color = ‘red’ AND A2.color = ‘red’ AND A1.autoTrans = ‘no’ AND A2.autoTrans = ‘yes’;

Example (Continued) RedAutos(serialNo, model, color, autoTrans, dealer) SELECT * FROM AutosMed WHERE color = ‘red’; SELECT DISTINCT A1.model, A1.dealer FROM RedAutos A1, RedAutos A2 WHERE A1.model = A2.model AND A1.autoTrans = ‘no’ AND A2.autoTrans = ‘yes’;

Thank You! The End!