Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing Lipyeow Lim University of Hawai`i at M ā noa Archan.

Slides:



Advertisements
Similar presentations
Evaluating Window Joins over Unbounded Streams Author: Jaewoo Kang, Jeffrey F. Naughton, Stratis D. Viglas University of Wisconsin-Madison CS Dept. Presenter:
Advertisements

Adam Jorgensen Pragmatic Works Performance Optimization in SQL Server Analysis Services 2008.
Analysis of : Operator Scheduling in a Data Stream Manager CS561 – Advanced Database Systems By Eric Bloom.
CPU Scheduling Tanenbaum Ch 2.4 Silberchatz and Galvin Ch 5.
SQL SERVER 2012 XVELOCITY COLUMNSTORE INDEX Conor Cunningham Principal Architect SQL Server Engine.
Online Filtering, Smoothing & Probabilistic Modeling of Streaming Data In short, Applying probabilistic models to Streams Bhargav Kanagal & Amol Deshpande.
Decentralized Reactive Clustering in Sensor Networks Yingyue Xu April 26, 2015.
Suman Nath Microsoft Research. Continuous Context-Aware Apps Continuous sensing of user’s context How much do I jog? Monitor indoor location Alert when.
3G v.s WIFI Radio Energy with YouTube downloads. Energy in Mobile Phone Data Transfers In 3G, there are three states –Idle –DCH (Dedicated Channel), do.
1 CSE 480: Database Systems Lecture 22: Query Optimization Reference: Read Chapter 15.6 – 15.8 of the textbook.
Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing LIM Lip Yeow University of Hawai`i at M ā noa Archan.
ACE: Exploiting Correlation for Energy-Efficient and Continuous Context Sensing Suman Nath Microsoft Research MobiSys 2012 Presenter: Jeffrey.
Query Evaluation. An SQL query and its RA equiv. Employees (sin INT, ename VARCHAR(20), rating INT, age REAL) Maintenances (sin INT, planeId INT, day.
1 Relational Query Optimization Module 5, Lecture 2.
ICS 421 Spring 2010 Relational Query Optimization Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 9/8/20091Lipyeow.
An Energy-Efficient Data Storage Scheme for Multi- resolution Query in Wireless Sensor Networks 老師 : 溫志煜 學生 : 官其瑩.
Fjording the Stream: An Architecture for Queries over Streaming Sensor Data Samuel Madden, Michael J. Franklin University of California, Berkeley Proceedings.
Evaluating Window Joins Over Unbounded Streams By Nishant Mehta and Abhishek Kumar.
Naming in Wireless Sensor Networks. 2 Sensor Naming  Exploiting application-specific naming and in- network processing for building efficient scalable.
VLDB Revisiting Pipelined Parallelism in Multi-Join Query Processing Bin Liu and Elke A. Rundensteiner Worcester Polytechnic Institute
Exploiting Correlated Attributes in Acquisitional Query Processing Amol Deshpande University of Maryland Joint work with Carlos Sam
Flow Algorithms for Two Pipelined Filtering Problems Anne Condon, University of British Columbia Amol Deshpande, University of Maryland Lisa Hellerstein,
© 2005, it - instituto de telecomunicações. Todos os direitos reservados. Gerhard Maierbacher Scalable Coding Solutions for Wireless Sensor Networks IT.
CMSC724: Database Management Systems Instructor: Amol Deshpande
LPT for Data Aggregation in Wireless Sensor networks Marc Lee and Vincent W.S Wong Department of Electrical and Computer Engineering, University of British.
Improving the Accuracy of Continuous Aggregates & Mining Queries Under Load Shedding Yan-Nei Law* and Carlo Zaniolo Computer Science Dept. UCLA * Bioinformatics.
1 External Sorting for Query Processing Yanlei Diao UMass Amherst Feb 27, 2007 Slides Courtesy of R. Ramakrishnan and J. Gehrke.
ICS 499 Projects Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 12/7/20111Lipyeow Lim -- University of.
Sensor Data Management: Challenges and (some) Solutions Amol Deshpande, University of Maryland.
Process Flowsheet Generation & Design Through a Group Contribution Approach Lo ï c d ’ Anterroches CAPEC Friday Morning Seminar, Spring 2005.
Wei Gao1 and Qinghua Li2 1The University of Tennessee, Knoxville
Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing By Archan Misra (School of Information Systems, Singapore.
Sensor Network Capacity Enhancement Through Spatial Concurrency Bharat B. Madan and Shashi Phoha Applied Research Lab, Penn State University.
Database Management Systems, R. Ramakrishnan and J. Gehrke1 Query Evaluation Chapter 12: Overview.
Physical Database Design & Performance. Optimizing for Query Performance For DBs with high retrieval traffic as compared to maintenance traffic, optimizing.
Access Path Selection in a Relational Database Management System Selinger et al.
Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing By Archan Misra (School of Information Systems, Singapore.
ICS 321 Fall 2011 Overview of Storage & Indexing (i) Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 11/9/20111Lipyeow.
The Design of an Acquisitional Query Processor for Sensor Networks CS851 Presentation 2005 Presented by: Gang Zhou University of Virginia.
Online aggregation Joseph M. Hellerstein University of California, Berkley Peter J. Haas IBM Research Division Helen J. Wang University of California,
© ETH Zürich Eric Lo ETH Zurich a joint work with Carsten Binnig (U of Heidelberg), Donald Kossmann (ETH Zurich), Tamer Ozsu (U of Waterloo) and Peter.
Tracking Irregularly Moving Objects based on Alert-enabling Sensor Model in Sensor Networks 1 Chao-Chun Chen & 2 Yu-Chi Chung Dept. of Information Management.
An Energy-Efficient Voting-Based Clustering Algorithm for Sensor Networks Min Qin and Roger Zimmermann Computer Science Department, Integrated Media Systems.
Lecture 15- Parallel Databases (continued) Advanced Databases Masood Niazi Torshiz Islamic Azad University- Mashhad Branch
Energy conservation in Wireless Sensor Networks Sagnik Bhattacharya, Tarek Abdelzaher University of Virginia, Department of Computer Science School of.
ACM SIGMOD International Conference on Management of Data, Beijing, June 14 th, Keyword Search on Relational Data Streams Alexander Markowetz Yin.
Introduction to Query Optimization, R. Ramakrishnan and J. Gehrke 1 Introduction to Query Optimization Chapter 13.
Rule based Context Sensing. Background Context sensing – Sensors in smartphone – Reacts based on operating condition Example – Location based reminder,
Eddies: Continuously Adaptive Query Processing Ross Rosemark.
Database Management Systems, R. Ramakrishnan and J. Gehrke1 Introduction to Query Optimization Chapter 13.
An Energy Efficient MAC Protocol for Wireless LANs, E.-S. Jung and N.H. Vaidya, INFOCOM 2002, June 2002 吳豐州.
Variant Indexes. Specialized Indexes? Data warehouses are large databases with data integrated from many independent sources. Queries are often complex.
Query Processing – Query Trees. Evaluation of SQL Conceptual order of evaluation – Cartesian product of all tables in from clause – Rows not satisfying.
Query Optimization CMPE 226 Database Systems By, Arjun Gangisetty
Efficient OLAP Operations in Spatial Data Warehouses Dimitris Papadias, Panos Kalnis, Jun Zhang and Yufei Tao Department of Computer Science Hong Kong.
W. Hong & S. Madden – Implementation and Research Issues in Query Processing for Wireless Sensor Networks, ICDE 2004.
Query Processing – Implementing Set Operations and Joins Chap. 19.
Submitted by: Sounak Paul Computer Science & Engineering 4 th Year, 7 th semester Roll No:
Rate-Based Query Optimization for Streaming Information Sources Stratis D. Viglas Jeffrey F. Naughton.
By: Peter J. Haas and Joseph M. Hellerstein published in June 1999 : Presented By: Sthuti Kripanidhi 9/28/20101 CSE Data Exploration.
Query Optimization for Stream Databases Presented by: Guillermo Cabrera Fall 2008.
CPU Scheduling CS Introduction to Operating Systems.
Modeling In-Network Processing and Aggregation in Sensor Networks Ajay Mahimkar EE 382C Embedded Software Systems Prof. B. L. Evans May 5, 2004.
Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing By Archan Misra (School of Information Systems, Singapore.
Introduction Smartphones already have several on-board sensors (e.g., GPS, accelerometer, compass and microphone) But, there are many situations where.
Distributed database approach,
Context Sensing.
The Design of an Acquisitional Query Processor For Sensor Networks
Introduction to Query Optimization
Streaming Sensor Data Fjord / Sensor Proxy Multiquery Eddy
Presentation transcript:

Optimizing Sensor Data Acquisition for Energy-Efficient Smartphone-based Continuous Event Processing Lipyeow Lim University of Hawai`i at M ā noa Archan Misra Singapore Management University 2/3/20111Lipyeow Lim

Telehealth Scenario SPO2 ECG HR Temp. Acc.... IF Avg(Window(HR)) > 100 AND Avg(Window(Acc)) < 2 THEN SMS(doctor) Wearable sensors transmit vitals to cell phone via wireless (eg. bluetooth) Phone runs a complex event processing (CEP) engine with rules for alerts Alerts can notify emergency services or caregiver 2/3/20112Lipyeow Lim

Energy Efficiency Energy consumption of processing ◦ Sensors: transmission of sensor data to CEP engine ◦ Phone: acquisition of sensor data ◦ Phone: processing of queries at CEP engine Optimization objectives ◦ Minimize energy consumption at phone ◦ Maximize operational lifetime of the system. 2/3/20113Lipyeow Lim This Talk

Sensor Data Acquisition Constant sampling rate (wifi) uses 2 power modes: active, idle Bluetooth has 3 modes: active, idle, sleep (not relevant). Time needed to switch modes Energy expended to switch Bluetooth Or Or D acc. ECG, EMG, GSR 2/3/20114Lipyeow Lim

Query Model A query is a boolean combination of predicates Predicates ◦ Aggregation functions over a time-based window of sensor data Traditional push model ◦ A given query is evaluated whenever a new sensor reading arrives AVG(SPO2, 5s) < 98% SPREAD(Acc, 10s) < 2g AVG(HR, 10s) < 75 AVG(SPO2, 5s) < 95% AVG(HR, 10s) > 100 SPREAD(Acc, 10s) > 4g AND OR Alert 2/3/20115Lipyeow Lim

Continuous Evaluation 2/3/2011Lipyeow Lim6 Pull Loop Acquire t i for Si Enqueue t i into W i If Q is true, Then output alert End loop if Avg(S2, 5)>20 AND S1<10 AND Max(S3,10)<4 then (doctor). S1 S2 S3 w1 w3 CEP Engine Push When t i of Si arrives Enqueue t i into W i If Q is true, Then output alert Eval Query

Key Ideas Pull model ◦ Evaluate a query every ω seconds ◦ Acquire only data that is needed Evaluation order of predicates matter! ◦ Shortcircuiting can avoid data acquisition Batching 2/3/20117Lipyeow Lim

Example: ω =7 Time 5: eval order is 3,1,2 Time 12: eval order is 1,2,3 Time 19: eval order is 2,3, /3/20118Lipyeow Lim

Evaluation Order Evaluate predicates with lowest energy consumption first Evaluate predicates with highest false probability first Hence, evaluate predicate with lowest normalized acquisition cost first. PredicateAvg(S2, 5)>20S1<10Max(S3,10)<4 Acquisition5 *.02 = 0.1 nJ0.2 nJ10 *.01 = 0.1 nJ Pr(false) if Avg(S2, 5)>20 AND S1<10 AND Max(S3,10)<4 then (doctor). Acq./Pr(f)0.1/ /0.50.1/0.8 2/3/20119Lipyeow Lim

Example: ω =3 Time 5: 1,2,3 Time 8: acquisition cost for A becomes cheaper, because some tuples are already in buffer 123 Acquisition cost depends on state of the buffer at time t 2/3/201110Lipyeow Lim

Algorithm At each ω 1. Calculate normalized acquisition cost (NAC) based on buffer state and P(pred=true) 2. Find evaluation order using NAC 3. Acquire sensor data and eval pred using eval order with shortcircuiting. What happens if >2 predicates operate on the same sensor data stream? 2/3/201111Lipyeow Lim

Simulation Setup Naive ◦ data from all sensors acquired in batches ASRS-static ◦ Evaluation order determined once at initialization and never changes ASRS-dynamic ◦ Evaluation order determined at each ω time period. Data generated using independent Gaussian distribution 2/3/201112Lipyeow Lim

Simulation Results Bluetooth Energy Bytes 2/3/201113Lipyeow Lim

A Lot More Work Needed Improve simulator ◦ Disjunctive normal form query representation ◦ More realistic data generators Estimation algorithms for P(pred=true) ◦ Condition on context Batching: wait say 3 ω before query evaluation ◦ Design and implement the algorithm ◦ Evaluation via simulation End-to-end evaluation on Android phone ◦ Maximize operational lifetime of phone+sensors 2/3/201114Lipyeow Lim

Other projects Cloud-based SQL Processor for Scientific Applications ◦ Benchmarking work ◦ Query optimization for parallel SQL processing ◦ Elastic & dynamic parallelization Develop a journal version of: Optimizing Access Across Multiple Hierarchies in Data Warehouses Data compression of Join Query Result Sets 2/3/201115Lipyeow Lim

ACM SIGMOD Programming Contest Task: A Durable Main-Memory Index Using Flash Contest ends Mar Skills: C, OS, Algorithms, DB concepts Why do it? ◦ Great learning experience ◦ Looks good on your resume 2/3/2011Lipyeow Lim16 USD 5000 Free trip for two to SIGMOD 2011 in Athens!