An Evaluation of Multi-Resolution Storage for Sensor Networks SenSys’03 Paper by Deepak Ganesan, Ben Greenstein, Denis Perelyubskiy, Deborah Estrin, and.

Slides:



Advertisements
Similar presentations
Design of the fast-pick area Based on Bartholdi & Hackman, Chpt. 7.
Advertisements

Overcoming Limitations of Sampling for Agrregation Queries Surajit ChaudhuriMicrosoft Research Gautam DasMicrosoft Research Mayur DatarStanford University.
Resource Management §A resource can be a logical, such as a shared file, or physical, such as a CPU (a node of the distributed system). One of the functions.
1 Data-Centric Storage in Sensornets with GHT, A Geographic Hash Table Sylvia Ratnasamy, Scott Shenker, Brad Karp, Ramesh Govindan, Deborah Estrin, Li.
Approximating Sensor Network Queries Using In-Network Summaries Alexandra Meliou Carlos Guestrin Joseph Hellerstein.
A Parallel Computational Model for Heterogeneous Clusters Jose Luis Bosque, Luis Pastor, IEEE TRASACTION ON PARALLEL AND DISTRIBUTED SYSTEM, VOL. 17, NO.
An Energy-Efficient Data Storage Scheme for Multi- resolution Query in Wireless Sensor Networks 老師 : 溫志煜 學生 : 官其瑩.
Probabilistic Aggregation in Distributed Networks Ling Huang, Ben Zhao, Anthony Joseph and John Kubiatowicz {hling, ravenben, adj,
Differentiated Surveillance for Sensor Networks Ting Yan, Tian He, John A. Stankovic CS294-1 Jonathan Hui November 20, 2003.
Adaptive Data Collection Strategies for Lifetime-Constrained Wireless Sensor Networks Xueyan Tang Jianliang Xu Sch. of Comput. Eng., Nanyang Technol. Univ.,
1-1 CMPE 259 Sensor Networks Katia Obraczka Winter 2005 Storage and Querying II.
1 Rethinking Data Management for Storage-centric Sensor Networks Yanlei Diao, Deepak Ganesan, Gaurav Mathur, and Prashant Shenoy CIDR 2007 Proceedings.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Distributed Quad-Tree for Spatial Querying in Wireless Sensor Networks (WSNs) Murat Demirbas, Xuming Lu Dept of Computer Science and Engineering, University.
1 An Evaluation of Multi-resolution Storage for Sensor Networks Deepak Ganesan, Ben Greenstein, Denis Perelyubskiy, Deborah Estrin (UCLA), John Heidemann.
A Hierarchical Energy-Efficient Framework for Data Aggregation in Wireless Sensor Networks IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 55, NO. 3, MAY.
1 An Evaluation of Multi-resolution Storage for Sensor Networks D. Ganesan, B. Greenstein, D. Perelyubskiy, D. Estrin, J. Heidemann ACM SenSys 2003.
The Impact of Spatial Correlation on Routing with Compression in WSN Sundeep Pattem, Bhaskar Krishnamachri, Ramesh Govindan University of Southern California.
1 TTS: A Two-Tiered Scheduling Algorithm for Effective Energy Conservation in Wireless Sensor Networks Nurcan Tezcan & Wenye Wang Department of Electrical.
Cumulative Violation For any window size  t  Communication-Efficient Tracking for Distributed Cumulative Triggers Ling Huang* Minos Garofalakis.
Distributed Quad-Tree for Spatial Querying in Wireless Sensor Networks (WSNs) Murat Demirbas, Xuming Lu Dept of Computer Science and Engineering, University.
Online Data Gathering for Maximizing Network Lifetime in Sensor Networks IEEE transactions on Mobile Computing Weifa Liang, YuZhen Liu.
Searching in Unstructured Networks Joining Theory with P-P2P.
1 Mathematical Modeling and Algorithms for Wireless Sensor Networks Bhaskar Krishnamachari Autonomous Networks Research Group Department of Electrical.
Abstract Shortest distance query is a fundamental operation in large-scale networks. Many existing methods in the literature take a landmark embedding.
Sensor Networks Storage Sanket Totala Sudarshan Jagannathan.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
Parallel Adaptive Mesh Refinement Combined With Multigrid for a Poisson Equation CRTI RD Project Review Meeting Canadian Meteorological Centre August.
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 2007 (TPDS 2007)
TSAR: A Two Tier Sensor Storage Architecture Using Interval Skip Graphs Peter Desnoyers, Deepak Ganesan, and Prashant Shenoy Department of Computer Science.
Exposure In Wireless Ad-Hoc Sensor Networks Seapahn Meguerdichian Computer Science Department University of California, Los Angeles Farinaz Koushanfar.
CONGRESSIONAL SAMPLES FOR APPROXIMATE ANSWERING OF GROUP-BY QUERIES Swarup Acharya Phillip Gibbons Viswanath Poosala ( Information Sciences Research Center,
Network Aware Resource Allocation in Distributed Clouds.
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
An Integration Framework for Sensor Networks and Data Stream Management Systems.
Department of Computer Science, University of Waikato, New Zealand Geoffrey Holmes, Bernhard Pfahringer and Richard Kirkby Traditional machine learning.
UOS 1 Ontology Based Personalized Search Zhang Tao The University of Seoul.
1 ENTROPY-BASED CONCEPT SHIFT DETECTION PETER VORBURGER, ABRAHAM BERNSTEIN IEEE ICDM 2006 Speaker: Li HueiJyun Advisor: Koh JiaLing Date:2007/11/6 1.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Tekin Bicer Gagan Agrawal 1.
Data centric Storage In Sensor networks Based on Balaji Jayaprakash’s slides.
Join Synopses for Approximate Query Answering Swarup Achrya Philip B. Gibbons Viswanath Poosala Sridhar Ramaswamy Presented by Bhushan Pachpande.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Graduate Student Department Of CSE 1.
Trevor Brown – University of Toronto B-slack trees: Space efficient B-trees.
INTERACTIVE ANALYSIS OF COMPUTER CRIMES PRESENTED FOR CS-689 ON 10/12/2000 BY NAGAKALYANA ESKALA.
Department of Computer Science University of Massachusetts, Amherst TSAR*: A Two Tier Sensor Storage Architecture Using Interval Skip Graphs Peter Desnoyers,
Multi-Resolution Spatial and Temporal Coding in a Wireless Sensor Network for Long-Term Monitoring Applications You-Chiun Wang, Member, IEEE, Yao-Yu Hsieh,
1 Spectral filtering for CW searches S. D’Antonio *, S. Frasca %&, C. Palomba & * INFN Roma2 % Universita’ di Roma “La Sapienza” & INFN Roma Abstract:
REED: Robust, Efficient Filtering and Event Detection in Sensor Networks Daniel Abadi, Samuel Madden, Wolfgang Lindner MIT United States VLDB 2005.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
1 DIMENSIONS: Why do we need a new Data Handling architecture for sensor networks? Deepak Ganesan, Deborah Estrin (UCLA), John Heidemann (USC/ISI) Presenter:
BARD / April BARD: Bayesian-Assisted Resource Discovery Fred Stann (USC/ISI) Joint Work With John Heidemann (USC/ISI) April 9, 2004.
Multi-user Broadcast Authentication in Wireless Sensor Networks Kui Ren, Wenjing Lou, Yanchao Zhang SECON2007 Manar Mahmoud Abou elwafa.
STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration.
1 Approximate XML Query Answers Presenter: Hongyu Guo Authors: N. polyzotis, M. Garofalakis, Y. Ioannidis.
D-skyline and T-skyline Methods for Similarity Search Query in Streaming Environment Ling Wang 1, Tie Hua Zhou 1, Kyung Ah Kim 2, Eun Jong Cha 2, and Keun.
Predicting the Location and Time of Mobile Phone Users by Using Sequential Pattern Mining Techniques Mert Özer, Ilkcan Keles, Ismail Hakki Toroslu, Pinar.
Partially Overlapped Channels Not Considered Harmful Arunesh Mishra, Vivek Shrivastava, Suman Banerjee, William Arbaugh (ACM SIGMetrics 2006) Slides adapted.
Attribute Allocation in Large Scale Sensor Networks Ratnabali Biswas, Kaushik Chowdhury, and Dharma P. Agrawal International Workshop on Data Management.
Written By: Presented By: Swarup Acharya,Amr Elkhatib Phillip B. Gibbons, Viswanath Poosala, Sridhar Ramaswamy Join Synopses for Approximate Query Answering.
September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.
1 Chapter 5 Branch-and-bound Framework and Its Applications.
Dense-Region Based Compact Data Cube
Data Driven Resource Allocation for Distributed Learning
A paper on Join Synopses for Approximate Query Answering
Feifei Li, Ching Chang, George Kollios, Azer Bestavros
Outline Ganesan, D., Greenstein, B., Estrin, D., Heidemann, J., and Govindan, R. Multiresolution storage and search in sensor networks. Trans. Storage.
Paper Reading Dalong Du April.08, 2011.
Wavelet-based histograms for selectivity estimation
Content Delivery and Remote DNS services
Presented by Mohammad Rashidujjaman Rifat Ph.D Student,
Presentation transcript:

An Evaluation of Multi-Resolution Storage for Sensor Networks SenSys’03 Paper by Deepak Ganesan, Ben Greenstein, Denis Perelyubskiy, Deborah Estrin, and John Heidemann CPSC 538A Presentation: Georg Wittenburg partly based on slides by Deepak Ganesan

Background of the Paper Authors:  Deepak Ganesan – Ph.D. Candidate, UCLA  Ben Greenstein – Ph.D. Candidate, UCLA  Denis Perelyubskiy – Completed M.S., UCLA  Deborah Estrin, Ph.D. – Professor of CS, UCLA; Director, Center for Embedded Networked Sensing (CENS); Associate Editor, ACM Transactions on Sensor Networks  John Heidemann – Assistant Professor, USC ?

The Truth about Sensor Networks The one big, huge, fundamental truth about sensor networks is:

The Truth about Sensor Networks The one big, huge, fundamental truth about sensor networks is: “Resources are limited so don’t waste them!” (Just in case someone missed that… )

Motivation So which resource do we concentrate on this time? Storage Setting:  A lot of data will be generated by the sensor network over time, i.e. continuous measurements rather than discrete events.  At the time of deployment, no knowledge exists exactly what kind of queries will be performed.

Proposed Solution (“Paper-on-a-Slide”) Organize sensor nodes hierarchically and summarize the data gathered at each level.  This allows for “drill-down queries” that retrieve data from the network when requested, while still providing interesting information at the top level. Allow for graceful degradation in quality of replies to queries by aging summaries.  Older data is gradually removed from the network.  More useful summaries are retained longer.

DIMEMSIONS Architecture PROGRESSIVELY AGE Construct distributed load- balanced quad-tree hierarchy of lossy wavelet-compressed summaries corresponding to different resolutions and spatio-temporal scales. Queries drill-down from root of hierarchy to focus search on small portions of the network. Progressively age summaries for long-term storage and graceful degradation of query quality over time. Level 0 Level 1 Level 2 PROGRESSIVELY LOSSY …

A Word about Wavelets (from “An Introduction to Wavelets” by Amara Graps) Wavelets are mathematical functions that cut up data into different frequency components, and then study each component with a resolution matched to its scale. They have advantages over traditional Fourier methods in analyzing physical situations where the signal contains discontinuities and sharp spikes. See IEEEwave/IEEEwavelet.html

Building the Hierarchy (1) Initially, nodes fill up their own storage with raw sampled data.

Building the Hierarchy (2) Tesselate the network space into grids, and hash in each to determine location of clusterhead (ref: DCS). Send wavelet-compressed local time-series to clusterhead.

Building the Hierarchy (3) Hash to different locations over time to distribute load among nodes in the network.

In Other Words A temporal summary is generated in each sensor. Construct grid-based overlay and re- summarize data at each level, compressing it both over space and time. Open questions:  Are there better hierarchies than the quad-tree?  How about only storing the difference to the summary on the next level locally?

Aging the Data (1) Graceful Query Degradation: Provide more accurate responses to queries on recent data and less accurate responses to queries on older data. Level 0 Level 1 Level 2 Time presentpast Query Accuracy high query accuracy low compactness low query accuracy high compactness low high How do we allocate storage at each node to summaries at different resolutions to provide gracefully degrading storage and search capability?

Aging the Data (2) Objective: Minimize worst case difference between user-desired query quality (blue curve) and query quality that the system can provide (red step function). Quality Difference Time Query Accuracy presentpast User provides a function, Q user that represents desired query quality degradation over time. Q system, with steps at times when summaries are aged. System provides a step function, Q system, with steps at times when summaries are aged. 95% 50%

Aging the Data (3) Solve Constraint Optimization Omniscient Strategy Baseline. Use all data to decide optimal allocation. Training Strategy (can be used when small training dataset from initial deployment). Greedy Strategy (when no data is available, use a simple weighted allocation to summaries). Coarse FinerFinest 1 : 2 : 4 No a priori information full a priori information

Aging the Data (4) Objective: Find {s i }, i=1..log4N that: Given constraints:  Storage constraint: Each node cannot store any greater than its storage limit.  Drill-down constraint: It is not useful to store finer resolution data if coarser resolutions of the same data is not present.

In Other Words An user-defined aging function is approximated given storage constraints of the network. Data may be aged according to different strategies depending on pre-known parameters. Open Questions:  Is the exponential compression at the root good enough for applications?

Assumptions Sensors nodes are arranged in a grid or otherwise uniformly deployed in the physical world for load balancing. The network is homogeneous, i.e. sensor nodes have similar capabilities. Data needs to be synchronized in time in order to build summaries. Summaries at the same level are of equal size, i.e. data is gathered at the same rate in the entire network.

Conclusion Experimental evaluation shows that  Overhead of communicating summaries can be amortized over many queries.  Aging after prior training performs only 1% worse than optimal solution. Greedy aging with “nice” parameters performs 5% worse than optimal solution.  A load-balanced hierarchy reduces storage used per node by a factor of three, while having similar communication requirements as a fixed hierarchy.

Future Work Some of the assumptions are too strong for real- world applications.  Placing nodes in a structured way (e.g. grid) may not be feasible.  Different nodes may produce a significantly different amount of data. Hence …  … wavelet processing needs to be adapted to cope with irregularities.  … the hierarchy needs to adapt the size of the summaries to the regional requirements.

Follow-Up Work Deepak Ganesan, Sylvia Ratnasamy, Hanbiao Wang and Deborah Estrin “Coping with irregular spatio-temporal sampling in sensor networks” Ben Greenstein, E. Kohler, D. Culler and Deborah Estrin “Distributed Techniques for Area Computation in Sensor Networks”

Evaluation (“My $0.02”) Major contributions are the adaptation of several techniques to the area of sensor networks, especially the aging strategy. Some rough edges (assumptions) have been addressed in follow-up papers. Further tests are needed as the data set in their experimental evaluation was rather small.

The End

Discussion Level 0 Level 1 Level 2 …