Streams and Stuff Sirish and Sam and Mike.

Slides:



Advertisements
Similar presentations
Raghavendra Madala. Introduction Icicles Icicle Maintenance Icicle-Based Estimators Quality Guarantee Performance Evaluation Conclusion 2 ICICLES: Self-tuning.
Advertisements

Copyright © 2004 Pearson Education, Inc.. Chapter 15 Algorithms for Query Processing and Optimization.
1 11. Streaming Data Management Chapter 18 Current Issues: Streaming Data and Cloud Computing The 3rd edition of the textbook.
Online Aggregation Liu Long Aggregation Operations related to aggregating data in DBMS –AVG –SUM –COUNT.
Incremental Materialization of RDF Graph Closures for Stream Reasoning Alexandre Mello Ferreira (PhD student) 22/11/2010.
Progress Report on Continuous Data Stream Management  Mining Frequent Itemsets over Data Streams  Music Virtual Channel Presented by: Dr. Yi-Hung Wu.
Adaptive Sampling for Sensor Networks Ankur Jain ٭ and Edward Y. Chang University of California, Santa Barbara DMSN 2004.
PSoup Kevin Menard CS 561 4/11/2005. Streaming Queries over Streaming Data Sirish Chandrasekaran UC Berkeley August 20, 2002 with Michael J. Franklin.
Agenda  Introduction  Background to CEP  Complex Event Processing  Stream Insight  Anatomy of a Stream Insight Project.
SWiM Benchmark Brainstorming Dave Maier Mike Stonebraker and All of You! With thanks to Jim Gray for suggestions.
Towards Adaptive Dataflow Infrastructure Joe Hellerstein, UC Berkeley.
Semantics and Evaluation Techniques for Window Aggregates in Data Stream Jin Li, David Maier, Kristin Tufte, Vassillis Papadimos, Peter Tucker. Presented.
SWIM 1/9/20031 QoS in Data Stream Systems Rajeev Motwani Stanford University.
Avoiding Idle Waiting in the execution of Continuous Queries Carlo Zaniolo CSD CS240B Notes April 2008.
1 Confidence Intervals for Means. 2 When the sample size n< 30 case1-1. the underlying distribution is normal with known variance case1-2. the underlying.
施賀傑 何承恩 TelegraphCQ. Outline Introduction Data Movement Implies Adaptivity Telegraph - an Ancestor of TelegraphCQ Adaptive Building.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Ripple Joins for Online Aggregation by Peter J. Haas and Joseph M. Hellerstein published in June 1999 presented by Ronda Hilton.
1 Fjording The Stream An Architecture for Queries over Streaming Sensor Data Samuel Madden, Michael Franklin UC Berkeley.
Online aggregation Joseph M. Hellerstein University of California, Berkley Peter J. Haas IBM Research Division Helen J. Wang University of California,
Data Streams: Lecture 101 Window Aggregates in NiagaraST Kristin Tufte, Jin Li Thanks to the NiagaraST PSU.
IV. Inferential Statistics B. Confidence Intervals
Runtime Optimization of Continuous Queries Balakumar K. Kendai and Sharma Chakravarthy Information Technology Laboratory Department of Computer Science.
Fixing Run-on Sentences Clause – a group of words that contain a subject and a verb Independent clause –makes sense as a sentence; can stand on its own.
Streaming Queries over Streaming Data Sirish Chandrasekaran (UC Berkeley) Michael J. Franklin (UC Berkeley) Presented by Andy Williamson.
Summary Queries Query Wizard –This is a choice once you select fields –Much easier to develop some summary queries with the wizard, then learn how to do.
Joseph M. Hellerstein Peter J. Haas Helen J. Wang Presented by: Calvin R Noronha ( ) Deepak Anand ( ) By:
ITEC 352 Lecture 3 Low level components(2). Low-level components Review Electricity Transistors Gates Really simple circuit.
ACM SIGMOD International Conference on Management of Data, Beijing, June 14 th, Keyword Search on Relational Data Streams Alexander Markowetz Yin.
Adaptive Sleep Scheduling for Energy-efficient Movement-predicted Wireless Communication David K. Y. Yau Purdue University Department of Computer Science.
Evaluating Window Joins over Unbounded Streams Jaewoo Kang Jeffrey F. Naughton Stratis D. Viglas {jaewoo, naughton, Univ. of Wisconsin-Madison.
Mining of Massive Datasets Ch4. Mining Data Streams
W. Hong & S. Madden – Implementation and Research Issues in Query Processing for Wireless Sensor Networks, ICDE 2004.
1 Semantics and Evaluation Techniques for Window Aggregates in Data Streams Jin Li, David Maier, Kristin Tufte, Vassilis Papadimos, Peter Tucker This work.
Bootstrapped Optimistic Algorithm for Tree Construction
Supporting Join Queries Talk by: Andy Cooke Collaborators: Alasdair Gray, Lisha Ma, and Werner Nutt Heriot-Watt University.
Overview of Discussion  What are the pros and cons of the options?  Are there other options? A2 SUBCOMMITTEE.
My Wonderful World of Stuff This is a sample slide upload.
Data Streams COMP3017 Advanced Databases Dr Nicholas Gibbins –
1 Out of Order Processing for Stream Query Evaluation Jin Li (Portland State Universtiy) Joint work with Theodore Johnson, Vladislav Shkapenyuk, David.
Radiation Resistant Lighting Ben Fiedler Supervisor: J. Devine.
Mining Data Streams (Part 1)
Advanced Database Systems: DBS CB, 2nd Edition
COMP3211 Advanced Databases
The Stream Model Sliding Windows Counting 1’s
Distributed database approach,
Data stream as an unbounded table
Quality-aware Aggregation & Predictive Analytics at the Edge
Sample Presentation. Slide 1 Info Slide 2 Info.
The Design of an Acquisitional Query Processor For Sensor Networks
CS222: Principles of Data Management Notes #13 Set operations, Aggregation Instructor: Chen Li.
Load Shedding Techniques for Data Stream Systems
Instrument Considerations
نام دوره: آیین نگارش مکاتبات اداری
Streaming Sensor Data Fjord / Sensor Proxy Multiquery Eddy
Electrical and Computer Engineering Department
Domain and Range From a Graph
Sampling results 5 (10%) 74% 10 (20%) 25 (50%) 45 (90%) Sample Size
Ашық сабақ 7 сынып Файлдар мен қапшықтар Сабақтың тақырыбы:
Windows басқару элементтері
CC La Web de Datos Primavera 2018 Lecture 8: SPARQL [1.1]
Dop d d 1 2 reconst reconst sop P P 1 2.
Chapter 3: Response models
TelegraphCQ: Continuous Dataflow Processing for an Uncertain World
PSoup: A System for streaming queries over streaming data
Қош келдіңіздер!.
Eddies for Continuous Queries
Data science laboratory (DSLAB)
Информатика пән мұғалімі : Аитова Карима.
Maintaining Stream Statistics over Sliding Windows
Presentation transcript:

Streams and Stuff Sirish and Sam and Mike

Streaming Considerations Lifetime: Instantaneous vs. Standing Delivery: All-the-time, periodic, on-demand (deltas?) Append Only With windows Units: tuples, time, or punctuations Endpoints: fixed, moving, or both? “NOW” keyword: relative to when? Update-in-place Do time windows make sense? Sensor “knobs” OK to combine values from different epochs? CONTROL: prioritize groups, sensors. Interactivity Accuracy (e.g. confidence intervals, counts, percentages)

The Telegraph Engine CACQ PSoup Sensors All-the-time delivery Output window Left edge fixed at time of query Therefore, results never invalidated Right edge sliding, = NOW Band Joins PSoup On demand delivery Endpoints sliding or fixed Band Joins in Main Memory Implementation Sensors On-demand (instantaneous) or periodic delivery Sample rate = GCD of delivery rates Combine Values from Different Epochs