Idle Waiting for slides

Slides:



Advertisements
Similar presentations
Peer-to-peer and agent-based computing P2P Algorithms.
Advertisements

Semantics and Evaluation Techniques for Window Aggregates in Data Streams Jin Li, David Maier, Kristin Tufte, Vassilis Papadimos, Peter A. Tucker SIGMOD.
CS240B Midterm Spring 2013 Your Name: and your ID: Problem Max scoreScore Problem 140% Problem 232% Problem 228% Total 100%
16.4 Estimating the Cost of Operations Project GuidePrepared By Dr. T. Y. LinVinayan Verenkar Computer Science Dept San Jose State University.
Two-Pass Algorithms Based on Sorting
SES Algorithm SES: Schiper-Eggli-Sandoz Algorithm. No need for broadcast messages. Each process maintains a vector V_P of size N - 1, N the number of processes.
UIUC CS 497: Section EA Lecture #2 Reasoning in Artificial Intelligence Professor: Eyal Amir Spring Semester 2004.
Data-Flow Analysis Framework Domain – What kind of solution is the analysis looking for? Ex. Variables have not yet been defined – Algorithm assigns a.
COSC 2006 Chapter 7 Stacks III
Maintaining Sliding Widow Skylines on Data Streams.
Continuous Analytics Over Discontinuous Streams Sailesh Krishnamurthy, Michael Franklin, Jeff Davis, Daniel Farina, Pasha Golovko, Alan Li, Neil Thombre.
©Brooks/Cole, 2003 Chapter 4 Operations on Bits. ©Brooks/Cole, 2003 Apply arithmetic operations on bits when the integer is represented in two’s complement.
Query Execution Optimizing Performance. Resolving an SQL query Since our SQL queries are very high level, the query processor must do a lot of additional.
ONE PASS ALGORITHM PRESENTED BY: PRADHYUMAN RAOL ID : 114 Instructor: Dr T.Y. LIN.
An Abstract Semantics and Concrete Language for Continuous Queries over Streams and Relations Presenter: Liyan Zhang Presentation of ICS
ONE PASS ALGORITHM PRESENTED BY: PRADHYUMAN RAOL ID : 114 Instructor: Dr T.Y. LIN.
1 Computing Functions with Turing Machines. 2 A function Domain: Result Region: has:
Avoiding Idle Waiting in the execution of Continuous Queries Carlo Zaniolo CSD CS240B Notes April 2008.
J. Michael Moore Recursion CSCE 110 From James Tam’s material.
© GCSE Computing Candidates should be able to:  convert positive denary whole numbers (0-255) into 8-bit binary numbers and vice versa  add two 8-bit.
Chapter 5.
CIS 720 Distributed algorithms. “Paint on the forehead” problem Each of you can see other’s forehead but not your own. I announce “some of you have paint.
XOR and XNOR Logic Gates. XOR Function Output Y is TRUE if input A OR input B are TRUE Exclusively, else it is FALSE. Logic Symbol  Description  Truth.
A Novel Method for Formally Detecting RFID Event Using Petri Nets SEKE 2011.
CSCE Database Systems Chapter 15: Query Execution 1.
CSE314 Database Systems The Relational Algebra and Relational Calculus Doç. Dr. Mehmet Göktürk src: Elmasri & Navanthe 6E Pearson Ed Slide Set.
Data Streams: Lecture 101 Window Aggregates in NiagaraST Kristin Tufte, Jin Li Thanks to the NiagaraST PSU.
Discrete Structure Sets. 2 Set Theory Set: Collection of objects (“elements”) a  A “a is an element of A” “a is a member of A” a  A “a is not an element.
1 Ethics of Computing MONT 113G, Spring 2012 Session 5 Binary Addition.
Programming at a high level. Developing a Computer Program Programmer  Writes program in source code (VB or other language) Compiler  Converts source.
CS 257 Chapter – 15.9 Summary of Query Execution Database Systems: The Complete Book Krishna Vellanki 124.
CS4432: Database Systems II Query Processing- Part 2.
High Level Architecture Time Management. Time management is a difficult subject There is no real time management in DIS (usually); things happen as packets.
Chapter 4 Operations on Bits. Apply arithmetic operations on bits when the integer is represented in two’s complement. Apply logical operations on bits.
1 Semantics and Evaluation Techniques for Window Aggregates in Data Streams Jin Li, David Maier, Kristin Tufte, Vassilis Papadimos, Peter Tucker This work.
CC 215 DATA STRUCTURES MORE ABOUT STACK APPLICATIONS Dr. Manal Helal - Fall 2014 Lecture 6 AASTMT Engineering and Technology College 1.
1 Computing Functions with Turing Machines. 2 A function Domain Result Region has:
DIGITAL Logic DESIGN Digital system and binary numbers Lecturer: Ms. Farwah Ahmad.
Merge Sort 1/12/2018 5:48 AM Merge Sort 7 2   7  2  2 7
Automatic Test Generation
Chapter 4 Operations on Bits.
Recursive stack-based version of Back-chaining using Propositional Logic
Relational Algebra - Part 1
AKA – Input/output tables
Data stream as an unbounded table
Lecture 16 Arithmetic Circuits
CS 240 – Lecture 11 Pseudocode.
Problem-Solving Steps Solve Problem-Solving Steps Solve
Information of the LO Subject: Information Theory Domain: Algorithms
The Relational Algebra
Streaming Sensor Data Fjord / Sensor Proxy Multiquery Eddy
Computing Functions with Turing Machines
Programming in JavaScript
Algorithm and Ambiguity
One-Pass Algorithms for Database Operations (15.2)
Notes about Homework #4 Professor Hugh C. Lauer CS-1004 — Introduction to Programming for Non-Majors (Slides include materials from Python Programming:
The Relational Algebra
Computer Science 2 Hashing.
60 MINUTES REMAINING.
Programming in JavaScript
UCLA, Fall CS240B Midterm Your Name: and your ID:
Continuous Query Languages for DSMS
Intro to Computer Science CS1510 Dr. Sarah Diesburg
CS240B Midterm: Winter 2017 Your Name: and your ID:
EECE.3220 Data Structures Instructor: Dr. Michael Geiger Spring 2019
COMPUTER HISTORY, PRESENT & FUTURE. What is a Computer? A computer is a machine that can be instructed to carry out sequences of arithmetic or logical.
Introduction to Traffic Shaping
靜夜思 床前明月光, 疑是地上霜。 舉頭望明月, 低頭思故鄉。 ~ 李白 李商隱.
Generic Set Algorithms
Depth-First Searches.
Presentation transcript:

Idle Waiting for slides We showed that binary operators, such as union and joins, are subject to idle-wating problem. But this problem can also occur in some unary operators. Say for instance that an aggregate is called on a time-stamped tumble window (or on a timestamped window with slides). Discuss this situation, its idle-waiting problem, and how it can be solved

SELECT itemID, bid time, sum(bid price) OVER(PARTITION BY itemID 10 MINUTES PRECEDING SLIDE 2 MINUTES) FROM Bid A window of 10 minutes divided into 5 panes by a slide of 2 minutes Time is divided slides, and the value of the aggregate is only returned for the last tuple in each slide. Tumble: the slide is as big or bigger than the window. The value of the aggregate on a window with slides can only be returned when we are sure that we have seen the last tuple in this pane—i.e., that the next tuple has a timestamp value that is past the expiration time of the current pane. Until that is established by the arrival of the next tuple—or via heartbeat punctuations or other ETS mechanism, to be discussed later— the logical window with slide aggregate will have to remain in an idle-waiting state. Until that time the input tuple is moved to the internal window buffer used to compute the aggregate— whereby tuples that have expired out of the window are also removed---internal window management same as that of joins.

Aggregates on Logical Windows with Slides. When a tuple is present at the input do: (production) if the timestamp of this input tuple is > than the expiration time of the slide, compute the aggregate on its internal window buffer and add the result to the output (consumption) remove the input tuple and add it to the internal window buffer on which the aggregate is computed.

On Demand Punctuation tuples carrying timestamps Next Operator Selection (NOS): Depth-First Rules. Forward: if yield then next := succ Encore: else if more then next := self Backtrack: else next := pred and repeat this NOS step on pred.

Aggregates on Logical Windows with Slides: when punctuation on demand is used If more is true, then: (production) If τ > the expiration time of the slide, then compute the aggregate on its internal window buffer and deliver the result to the output; otherwise generate a punctuation tuple with timestamp τ (consumption) If the input tuple is a data tuple, add it to the internal window buffer on which the aggregate is computed. If input is empty the wait….