STREAMS & SENSOR NETWORKS “ Query Processing in Sensor Networks ”
Introduction to Wireless Sensor Network (WSN)s WSN Specific Issues for Query Processing Data Storage & Data Management Issues Stream Processing Requirements Query Processing Techniques in WSN Discussion & Future Work Outline
Introduction to WSN
Introduction to WMSN WMSN = Data Sensor Nodes + Stream Processing Nodes Data Sensor NodesStream Processing Nodes TemperatureStill Images PressureAudio Streams HumidityVideo Streams LocationCombination of above
Introduction to WSN Initial Usage : Data-only Delay-tolerant apps. Advances in IT Suitable for a variety of applications such as retrieval of multimedia streams, Store, process in real-time, correlate and fuse multimedia content.
Introduction to WSN
Properties of WSNs : Large number of tiny sensor nodes, One or more base stations (the sink), Densely deployed. AOU (Areas of Use) : Advanced Healthcare Monitoring, Environmental Monitoring, Traffic and Collision Avoidance, Surveillance Systems.
WSN Specific Issues Hardware Requirements Computational constraints, Communication constraints, Mobility, Power supplies, Objectives and Efforts*
WSN Specific Issues * Data Storage & Management Restricted hardware resources of sensor nodes, due to their tiny design, impede most general storage management issues to be implemented on WSN.
WSN Specific Issues * Data Storage & Management Approaches in Data Storage & Management Burden of data processing on the sink Node --- Little Storage Sink --- Plenty of Storage Storage-Centric WSN Embed nodes with high capacity storage (stemmed from energy consumption)
WSN Specific Issues * Data Storage & Management
WSN Specific Issues * Stream Processing Requirements Multimedia streaming, requires high- bandwidth channels and timeliness… Key Challenges Low-power resources and computational capabilities for video coding, Real-time requirements of the bursty video traffic, Lossy wireless hops.
Requirements of multimedia streaming at each level of the stack : At the application layer, sensor nodes require video/audio coding & compression with low complexity, producing a low output bandwidth, packet loss-tolerant and energy efficient. At the transport layer, requirements such as bounded delay and jitter in data delivery, minimum bandwidth availability, multiple data priorities and session maintenance must be met. WSN Specific Issues * Stream Processing Requirements
Requirements of multimedia streaming at each level of the stack : Network layer is crucial for QoS( Quality of Service). MAC layer in WMSN requires two new performance criteria along with the traditional requirements : Packet latency, Multiple priorities to packets. Cross-layer Requirement Optimization. WSN Specific Issues * Stream Processing Requirements
Query Processing in Sensor Networks
Query Processing in WSN WHAT IS QP in WSN? Unlike traditional query processing on each computational unit, WSN queries are generally high-level statements of logical interests over an entire network which may be event detection or monitoring of an area. WHAT IS NOT QP in WSN? Users specifying the data they want to collect through simple, declarative queries.
Query Processing in WSN Differences between standard data sources and sensor based data sources: Stream data delivery, Garbled and unreliable data delivery.
WSN Specific Issues * Query Processing Techniques Sensor node operating systems are not very useful in fault tolerance and devices (sensor nodes) are crash-prone. Because of the limitations on implementation issues, careful resource management, transient node come&go and varying signal strengths between devices are to be considered.
WSN Specific Issues * Query Processing Techniques QP in SN can be divided into two: Shipping data to a remote server for processing(Fjording Architecture) In-network QP (SNQP)
WSN Specific Issues * Shipping Data to a Remote Server In this technique, QP is done on 2 levels: Reassembled query plan architecture called Fjords “Framework in Java for Operators on Remote Data Streams” Sensor-proxies.
WSN Specific Issues * Shipping Data to a Remote Server Flowing data from sensors is pushed into query operators directly. Operators do not actively pull data to process, rather, they operate when sensor data is available and are otherwise idle. Because of this passive behavior, the adaptive-query processing situation of an operator being “blocked”, waiting for input, does not happen.
WSN Specific Issues * Shipping Data to a Remote Server
WSN Specific Issues * SNQP Data summarization techniques, Interfaces that can be easily used by the operators of the sink, Network monitoring tools in order to check the health status of sensor nodes have to be developed.
WSN Specific Issues * SNQP Components : Server-side software running on the sink, Sensor-side software running on the nodes.
WSN Specific Issues * SNQP
Query inputs by the operators at the sink, Sensor data is sampled according to the demanded intervals which is called epoch, Tailored SQL language is used, Query results passed forward from nodes to the sink.
WSN Specific Issues * SNQP SNQP typically choose from several alternative plans and operator orderings for any given logical query according to the cost estimation. Query optimization occurs as much possible as on the sink.
WSN Specific Issues * SNQP WSN Query Processing Operators OperatorDescription Select Reject readings that don’t satisfy a particular Boolean predicate. Aggregate Combine readings according to an aggregation function like sum, max etc. Join Concatenate two readings when some join predicate is satisfied. For example, the predicate PointA.light > sensors.light joins (concatenates) all the historical tuples in PointA with current sensor readings for any pair of tuples in which the current light value exceeds the historical value. Data acquisition Acquire a reading (field) from a sensor or an internal device attribute, such as a light sensor reading or free RAM in the dynamic heap.
WSN Specific Issues * SNQP Aggregation operation NOT ONLY reduces the quantity of data that must be transmitted through the network. Thus, it can reduce energy consumption and bandwidth usage, BUT ALSO detect object tracking.
WSN Specific Issues * SNQP SAMPLE QUERY CLAUSES STOP QUERY id, SAMPLE PERIOD and FOR clauses, CREATE STORAGE POINT,
WSN Specific Issues * SNQP (Tree-Based Routing)
WSN Specific Issues * SNQP
* Sample Query in SNQP
WSN Specific Issues * Query Optimization Techniques Lifetime management, Partial aggregation, Packet Merging for Pushing Computation These techniques all emphasize the efficient usage of the restricted resources.
Discussion & Future Work Data Management and Storage Issue Deployment Consideration Improvements over Protocol Stack QP Techniques
References [1] Wireless multimedia sensor networks: A survey, IF Akyildiz, T Melodia… - Wireless Communications, …, ieeexplore.ieee.org [2] Rethinking data management for storage-centric sensor networks, Y Diao, D Ganesan, G Mathur… - Proceedings of the Third …, mit.edu [3] Ultra-low power data storage for sensor networks, G Mathur, P Desnoyers, P Chukiu… - … on Sensor Networks ( …, dl.acm.org) [4] A survey of multimedia streaming in wireless sensor networks, S Misra, M Reisslein…Communications Surveys & …, ieeexplore.ieee.org [5] Transmitting streaming data in wireless multimedia sensor networks with holes L Shu, ZB Zhou, M Hauswirth, D Le Phuoc… - … ubiquitous multimedia, dl.acm.org [6] Query processing in sensor networks, J Gehrke… - Pervasive Computing, IEEE, ieeexplore.ieee.org [7] Fjording the stream: An architecture for queries over streaming sensor data, S Madden… - Data Engineering, Proceedings …, ieeexplore.ieee.org [8] Join of multiple data streams in sensor networks, X Zhu, H Gupta… - Knowledge and Data Engineering, …, ieeexplore.ieee.org [9] Y. Wei, J. Heidemann, and D. Estrin. An energy-efficient MAC protocol for wireless sensor networks. In Proc. IEEE INFOCOM, pages , June 2002
STREAMS & SENSOR NETWORKS “ Query Processing in Sensor Networks ”