Intelligent Contextual Data Stream Monitoring

Slides:



Advertisements
Similar presentations
Exercise 7.5 (p. 343) Consider the hotel occupancy data in Table 6.4 of Chapter 6 (p. 297)
Advertisements

CountrySTAT Team-I November 2014, ECO Secretariat,Teheran.
An Adaptive Data Forwarding Scheme for Energy Efficiency in Wireless Sensor Networks Christos Anagnostopoulos Theodoros Anagnostopoulos Stathes Hadjiefthymiades.
Chapter 12 Simple Regression
Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:
Context Compression: using Principal Component Analysis for Efficient Wireless Communications Christos Anagnostopoulos & Stathes Hadjiefthymiades Pervasive.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering On-line Alert Systems for Production Plants A Conflict Based Approach.
Forecasting.
Situation Awareness: Dealing with Vague Context C. Anagnostopoulos, Y. Ntarladimas, S. Hadjiefthymiades P ervasive C omputing R esearch G roup C ommunication.
On the Use of Fuzzy Logic in a Seller Bargaining Game Kostas Kolomvatsos Christos Anagnostopoulos Stathes Hadjiefthymiades Pervasive Computing Research.
University of Athens, Greece Pervasive Computing Research Group Predicting the Location of Mobile Users: A Machine Learning Approach 1 University of Athens,
Cumulative Violation For any window size  t  Communication-Efficient Tracking for Distributed Cumulative Triggers Ling Huang* Minos Garofalakis.
CSE 300: Software Reliability Engineering Topics covered: Software metrics and software reliability Software complexity and software quality.
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
Context Fusion: Dealing with Sensor Reliability Christos Anagnostopoulos Odysseas Sekkas Stathes Hadjiefthymiades Pervasive Computing Research Group,
Fire Detection in the Urban Rural Interface through Fusion Techniques Evangelos Zervas Odysseas Sekkas Stathes Hadjiefthymiades Christos Anagnostopoulos.
Energy-efficient Self-adapting Online Linear Forecasting for Wireless Sensor Network Applications Jai-Jin Lim and Kang G. Shin Real-Time Computing Laboratory,
Automatic Fuzzy Rules Generation for the Deadline Calculation of a Seller Agent Kostas Kolomvatsos and Stathes Hadjiefthymiades Pervasive Computing Research.
Short Term Load Forecasting with Expert Fuzzy-Logic System
Classification and Prediction: Regression Analysis
1 Prediction of Software Reliability Using Neural Network and Fuzzy Logic Professor David Rine Seminar Notes.
Buyer Agent Decision Process Based on Automatic Fuzzy Rules Generation Methods Roi Arapoglou, Kostas Kolomvatsos, Stathes Hadjiefthymiades Pervasive Computing.
Optimal Stopping of the Context Collection Process in Mobile Sensor Networks Christos Anagnostopoulos 1, Stathes Hadjiefthymiades 2, Evangelos Zervas 3.
Inference for regression - Simple linear regression
LSS Black Belt Training Forecasting. Forecasting Models Forecasting Techniques Qualitative Models Delphi Method Jury of Executive Opinion Sales Force.
Portfolio Management-Learning Objective
EVENT MANAGEMENT IN MULTIVARIATE STREAMING SENSOR DATA National and Kapodistrian University of Athens.
Resistant Learning on the Envelope Bulk for Identifying Anomalous Patterns Fang Yu Department of Management Information Systems National Chengchi University.
Efficient Elastic Burst Detection in Data Streams Yunyue Zhu and Dennis Shasha Department of Computer Science Courant Institute of Mathematical Sciences.
A Process Control Screen for Multiple Stream Processes An Operator Friendly Approach Richard E. Clark Process & Product Analysis.
A New Method to Forecast Enrollments Using Fuzzy Time Series and Clustering Techniques Kurniawan Tanuwijaya 1 and Shyi-Ming Chen 1, 2 1 Department of Computer.
A Multi-level Data Fusion Approach for Early Fire Detection Odysseas Sekkas Stathes Hadjiefthymiades Evangelos Zervas Pervasive Computing Research Group,
George Boulougaris, Kostas Kolomvatsos, Stathes Hadjiefthymiades Building the Knowledge Base of a Buyer Agent Using Reinforcement Learning Techniques Pervasive.
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
A Passive Approach to Sensor Network Localization Rahul Biswas and Sebastian Thrun International Conference on Intelligent Robots and Systems 2004 Presented.
K. Kolomvatsos 1, C. Anagnostopoulos 2, and S. Hadjiefthymiades 1 An Efficient Environmental Monitoring System adopting Data Fusion, Prediction & Fuzzy.
MGS3100_03.ppt/Feb 11, 2016/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Time Series Forecasting Feb 11, 2016.
CHAPTER 12 FORECASTING. THE CONCEPTS A prediction of future events used for planning purpose Supply chain success, resources planning, scheduling, capacity.
On Mobile Sink Node for Target Tracking in Wireless Sensor Networks Thanh Hai Trinh and Hee Yong Youn Pervasive Computing and Communications Workshops(PerComW'07)
10 March 2016Materi ke-3 Lecture 3 Statistical Process Control Using Control Charts.
1 Decision Making ADMI 6510 Forecasting Models Key Sources: Data Analysis and Decision Making (Albrigth, Winston and Zappe) An Introduction to Management.
Forecast 2 Linear trend Forecast error Seasonal demand.
Chapter 11 Linear Regression and Correlation. Explanatory and Response Variables are Numeric Relationship between the mean of the response variable and.
Personal Home Healthcare System for the Cardiac Patient of Smart City Using Fuzzy Logic Shijia Liu.
Lecture 1.31 Criteria for optimal reception of radio signals.
The simple linear regression model and parameter estimation
Operations Management Contemporary Concepts and Cases
Chapter 7. Classification and Prediction
Online Conditional Outlier Detection in Nonstationary Time Series
System Control based Renewable Energy Resources in Smart Grid Consumer
Quality-aware Aggregation & Predictive Analytics at the Edge
Chapter 11 Simple Regression
Automatic Picking of First Arrivals
CHAPTER 29: Multiple Regression*
A Modified Naïve Possibilistic Classifier for Numerical Data
Introduction to Instrumentation Engineering
Regression Models - Introduction
The European Statistical Training Programme (ESTP)
A Novel Evaluation Methodology for Assessing Off-Policy Learning Methods in Contextual Bandits Negar Hassanpour and Russ Greiner Department of Computing.
Linear Regression and Correlation
Uncertainty-driven Ensemble Forecasting of QoS in Software Defined Networks Kostas Kolomvatsos1, Christos Anagnostopoulos2, Angelos Marnerides3, Qiang.
K. Kolomvatsos1, C. Anagnostopoulos2, and S. Hadjiefthymiades1
Linear Regression and Correlation
Danger Prediction by Case-Based Approach on Expressways
Linear Regression and Correlation
Roc curves By Vittoria Cozza, matr
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
An Edge-Centric Ensemble Scheme for Queries Assignment
Kostas Kolomvatsos, Christos Anagnostopoulos
Chapter 13: Item nonresponse
Presentation transcript:

Intelligent Contextual Data Stream Monitoring K. Kolomvatsos1, C. Anagnostopoulos2, and S. Hadjiefthymiades1 1University of Athens, Department of Informatics & Telecommunications 2University of Glasgow, School of Computing Science 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA 2015) July 1-3, 2015, Corfu, Greece

Outline Monitoring Systems The Proposed Mechanism The Prediction Module The Fusion Module The Consensus Module The Fuzzy Logic Module Experimental Results

Monitoring Systems (1/2) Monitoring System (MS): monitors specific contextual parameters. The MS generates alerts when any abnormalities are present. Alerts are derived by triggering mechanisms that continually check the fulfillment of certain conditions. Inputs are received by a set of sensors. Sensors send their observations at specific intervals to MS. MS based on observations derives the Degree of Alert (DoA) that indicates if measures should be applied.

Monitoring Systems (2/2) MS minimizes false alerts as those can affect the performance of the entire system. If measures are applied in a wrong interval, they will not benefit the performance of the response. We propose a combination of: multivariate contextual data fusion techniques time-series forecast and consensus theory

The Proposed Mechanism (1/2) Let a team of N sensors. Sensors observe the same phenomenon and report data to pre- defined intervals. When the MS receives the reports, it decides if an event is identified, thus, it derives alerts without any human intervention. The MS is not based only on a single sensor observations, as false alarms could be derived. Sensors could report invalid observations due to various reasons like resources status and environmental characteristics. The MS relies on the opinion of the majority before it decides the initiation of an alert.

The Proposed Mechanism (2/2) The proposed MS includes the following components: Prediction module (PM): is based on sensors historical values, predicts future observations. Fusion module (FM): it eliminates the outliers data and provides the final fused measurement. Consensus module (CM): it produces the Degree of Consensus (DoC) which denotes the unanimity in the opinion of sensors (experts). Fuzzy Logic module (FLM): combines the outputs of the FM and the CM and derives the Degree of Alert (DoA). The DoA provides a support for deriving an alert to users or applications. The decision is made based on (1) the current aggregated measurements and (2) the consensus of the team.

The Prediction Module For each sensor Si a time ordered set of past values HSi is maintained. We consider the history of the latest observations. We predict the missing measurement through a linear combination of the historical measurements with real-valued prediction coefficients. The set of coefficients are estimated to minimize the prediction error between the predicted and the actual measurement. We get a number of equations, (a.k.a Yule-Walker equations) for estimating the coefficients. In our effort, we adopt the Levinson-Durbin algorithm.

The Fusion Module (1/4) Data fusion combines contextual data from all sensors to derive reliable fused measurements. We adopt the cumulative sum (CumSum) algorithm for outliers detection and the linear opinion pool algorithm for deriving the final aggregated value. The CumSum algorithm detects if there is any change in the distribution of a contextual time series corresponding to a sensor. The algorithm is a change-point detection technique based on the cumulative sum of the differences between the current value at instance t and the overall average up to t. Slopes depict jumps in the times series, thus, corresponding to outliers. We adopt a two-side detection scheme where an observation is inferred as an outlier when it deviates above a target threshold h+ or below a target threshold h-.

The Fusion Module (2/4) Two signals are the outputs of the CumSum algorithm: the first is related to the above detection signal while the second corresponds to the below detection signal. When the time series deviates from the thresholds, detection signals are set to 1. The detected outliers are eliminated and, thus, the mechanism at t is based on the opinion (measurements) of those sensors that do not produce outliers. The proposed MS adopts a linear opinion pool scheme for the remaining values.

The Fusion Module (3/4)  

The Fusion Module (4/4)  

The Consensus Module  

The Fuzzy Logic Module The Fuzzy Logic Module has two inputs: the fused measurement f the DoC The output is the DoA value. We consider that DoA  1 indicates that the danger is at high levels; the opposite stands when DoA  0. We consider three linguistic values: Low, Medium, High. Low value represents that the fuzzy variable takes values close to the lower limit while a High value depicts the case where the variable takes values close to the upper level. A Medium value depicts the case where the variable takes values close to the average. We consider triangular membership functions.

Experimental Results (1/2) We examine the MS performance related to the Rate of False Alerts (RFA). As RFA  1, the MS results a lot of false alerts. As RFA  0, the MS minimizes the rate of false alerts. We experiment with two datasets: The MHEALTH dataset (Banos, O., et al., 'mHealthDroid: a novel framework for agile development of mobile health applications', In 6th IWAAL, 2014) We consider the provided electrocardiogram signal and assume 1,000 measurements for each volunteer The second dataset is retrieved by the Intel Berkeley Research Lab (http://db.csail.mit.edu/labdata/labdata.html) We get 15,000 measurements assuming that N = 15 sensors produced 1,000 reports

Experimental Results (2/2) We inject p faulty measurements into datasets. We compare the proposed MS with the Single Sensor Alerting (SSA) mechanism. The SSA mechanism delivers an alert when at least one sensor reports a value over a predefined threshold

Thank you!