Optimizing Sequences of DB Operations

Slides:



Advertisements
Similar presentations
DBMSs on a Modern Processor: Where Does Time Go? Anastassia Ailamaki Joint work with David DeWitt, Mark Hill, and David Wood at the University of Wisconsin-Madison.
Advertisements

1/1/ /e/e eindhoven university of technology Microprocessor Design Course 5Z008 Dr.ir. A.C. (Ad) Verschueren Eindhoven University of Technology Section.
The State of the Art in Distributed Query Processing by Donald Kossmann Presented by Chris Gianfrancesco.
Design patterns exercise Nick Lopez Duplication of course material for any commercial purpose without the explicit written permission of the professor.
Introduction CS 524 – High-Performance Computing.
P2P Information Interoperability & Decision Support Domain Application SEMANTIC INTEROP QUERY PROCESSING GIS INTEROP P2P ● Heterogeneous semantic ● Semantic.
Overview Distributed vs. decentralized Why distributed databases
What I am doing Amol Deshpande. Selection Ordering  Given a set of selection predicates and correlations between them, find the optimal ordering : Not.
Scalable Approximate Query Processing through Scalable Error Estimation Kai Zeng UCLA Advisor: Carlo Zaniolo 1.
Load Balancing Dan Priece. What is Load Balancing? Distributed computing with multiple resources Need some way to distribute workload Discreet from the.
Will Data Mining Change the Functions of DBMS? Jiawei Han DAIS (Data And Information Systems) Lab University of Illinois at Urbana-Champaign.
Ahsan Abdullah 1 Data Warehousing Lecture-17 Issues of ETL Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
Enhancing GPU for Scientific Computing Some thoughts.
20 October 2006Workflow Optimization in Distributed Environments Dynamic Workflow Management Using Performance Data David W. Walker, Yan Huang, Omer F.
Massively Distributed Database Systems - Distributed DBS Spring 2014 Ki-Joune Li Pusan National University.
1 A Framework for Data-Intensive Computing with Cloud Bursting Tekin Bicer David ChiuGagan Agrawal Department of Compute Science and Engineering The Ohio.
Database Systems: Design, Implementation, and Management Ninth Edition Chapter 12 Distributed Database Management Systems.
Center for Component Technology for Terascale Simulation Software CCA is about: Enhancing Programmer Productivity without sacrificing performance. Supporting.
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
Query Execution on NetTraveler Angel L. Villalaín-García Manuel Rodríguez-Martínez University of Puerto Rico - Mayaguez Campus.
Cluster computing. 1.What is cluster computing? 2.Need of cluster computing. 3.Architecture 4.Applications of cluster computing 5.Advantages of cluster.
18 May 2006CCGrid2006 Dynamic Workflow Management Using Performance Data Lican Huang, David W. Walker, Yan Huang, and Omer F. Rana Cardiff School of Computer.
Closing the Query Processing Loop in Oracle 11g Allison Lee, Mohamed Zait.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
LM 9. Distributed Database Dr. Lei Li 1. Note: The content of the slides including figures are mainly based on a publicly available textbook chapter:
Chapter 14: Query Optimization
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
Auburn University
DLA Disposition Services “How do I direct ship my property?”
A Framework for Measurability of Security
Introduction to Load Balancing:
Information Retrieval in Practice
Data Mining K-means Algorithm
Auburn University COMP7330/7336 Advanced Parallel and Distributed Computing Mapping Techniques Dr. Xiao Qin Auburn University.
Data Warehouse—Subject‐Oriented
Grid Computing.
DLA Disposition Services “How do I direct ship my property?”
Learn To Fix Errors On Dell PC. We are a third-party service provider for Dell users in Nederland. Call us on Website:
Database Actors Welcome : To the third learning sequence “ DB ACTORS “
The UK Tier 1 Entrepreneur Visa and the UK Representative of Overseas Business Visa - SmartMove2UK
Control Structures.
The Top 10 Reasons Why Federated Can’t Succeed
Chapter 17: Database System Architectures
Lecture#12: External Sorting (R&G, Ch13)
The Globus Toolkit™: Information Services
What is the Value of an IBM Balanced Warehouse™
Declarative Creation of Enterprise Applications
Introduction to Data Warehousing
Wavelet “Block-Processing” for Reduced Memory Transfers
A Software-Defined Storage for Workflow Applications
Software Engineering INTRODUCTION
Scheduled Accomplishments
Chapter 17: Client/Server Computing
Database Actors.
Introduction to Computing
Performance Evaluation
Kabra and DeWitt presented by Zack Ives CSE 590DB, May 11, 1998
Scheduling & Dispatching
Control Theory in Log Processing Systems
Lecture 26: Internet Topology CS 765: Complex Networks.
Database System Architectures
Generating Sequences © T Madas.
Scheduling & Dispatching
PROGRAMME 17 REDUCTION FORMULAS.
Measurement Report Feedback in 11az
Dialog Design 1 Basic Dialog Styles.
Distribution of Survey Respondents with High Needs
Additional Resources (Probiotics)
overview today’s ideas relational databases
Presentation transcript:

Optimizing Sequences of DB Operations Problem: Workflows, query generators, appl programmers all produce sequences of simple steps Op1 -> Op2 -> Op3… -> OpN Overhead on each call Sometimes expensive materialization of intermediate results Goal: Merge subsequences into more complex queries Op123 -> Op45… -> OpN When can you merge? How much should you merge?

Where to do what when in distributed query processing Problem: Data-intensive computations over distributed data Scientific and commercial examples Heterogeneous environments Want to spread the work over multiple systems, but Load on systems varies unpredictably Costs of shipping data may be prohibitive Limited use of and lack of mechanisms for function-shipping today Cost of evaluating more options may be prohibitive Goal: Enhance performance of distributed queries Respond to changing environment