K. Kolomvatsos 1, C. Anagnostopoulos 2, and S. Hadjiefthymiades 1 An Efficient Environmental Monitoring System adopting Data Fusion, Prediction & Fuzzy.

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

International Technology Alliance In Network & Information Sciences International Technology Alliance In Network & Information Sciences 1 A framework for.
Statistics for Improving the Efficiency of Public Administration Daniel Peña Universidad Carlos III Madrid, Spain NTTS 2009 Brussels.

Combining Classification and Model Trees for Handling Ordinal Problems D. Anyfantis, M. Karagiannopoulos S. B. Kotsiantis, P. E. Pintelas Educational Software.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
Experimental Design, Response Surface Analysis, and Optimization
Correlation and regression
Validation and Monitoring Measures of Accuracy Combining Forecasts Managing the Forecasting Process Monitoring & Control.
Multi-criteria Design of X-bar control chart Zhaojun (Steven) Li IND E 516 Homework 1.
An Adaptive Data Forwarding Scheme for Energy Efficiency in Wireless Sensor Networks Christos Anagnostopoulos Theodoros Anagnostopoulos Stathes Hadjiefthymiades.
1 In-Network PCA and Anomaly Detection Ling Huang* XuanLong Nguyen* Minos Garofalakis § Michael Jordan* Anthony Joseph* Nina Taft § *UC Berkeley § Intel.
Sensor & Computing Infrastructure for Environmental Risks SCIER FP IST-5 Stathes Hadjiefthymiades (NKUA) 1st Student Workshop on Wireless Sensor.
Context Compression: using Principal Component Analysis for Efficient Wireless Communications Christos Anagnostopoulos & Stathes Hadjiefthymiades Pervasive.
Software Quality Control Methods. Introduction Quality control methods have received a world wide surge of interest within the past couple of decades.
Forecasting.
University of Athens, Greece Pervasive Computing Research Group Predicting the Location of Mobile Users: A Machine Learning Approach 1 University of Athens,
Context Fusion: Dealing with Sensor Reliability Christos Anagnostopoulos Odysseas Sekkas Stathes Hadjiefthymiades Pervasive Computing Research Group,
1 Seventh Lecture Error Analysis Instrumentation and Product Testing.
Energy-efficient Self-adapting Online Linear Forecasting for Wireless Sensor Network Applications Jai-Jin Lim and Kang G. Shin Real-Time Computing Laboratory,
Automatic Fuzzy Rules Generation for the Deadline Calculation of a Seller Agent Kostas Kolomvatsos and Stathes Hadjiefthymiades Pervasive Computing Research.
Short Term Load Forecasting with Expert Fuzzy-Logic System
Classification and Prediction: Regression Analysis
Business Forecasting Chapter 5 Forecasting with Smoothing Techniques.
1 Prediction of Software Reliability Using Neural Network and Fuzzy Logic Professor David Rine Seminar Notes.
Buyer Agent Decision Process Based on Automatic Fuzzy Rules Generation Methods Roi Arapoglou, Kostas Kolomvatsos, Stathes Hadjiefthymiades Pervasive Computing.
Optimal Stopping of the Context Collection Process in Mobile Sensor Networks Christos Anagnostopoulos 1, Stathes Hadjiefthymiades 2, Evangelos Zervas 3.
Annex I: Methods & Tools prepared by some members of the ICH Q9 EWG for example only; not an official policy/guidance July 2006, slide 1 ICH Q9 QUALITY.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
C. Anagnostopoulos 1 K. Kolomvatsos 2 & S. Hadjiefthymiades 2 1 Ionian University, Corfu, Greece 2 National and Kapodistrian University of Athens, Greece.
Resistant Learning on the Envelope Bulk for Identifying Anomalous Patterns Fang Yu Department of Management Information Systems National Chengchi University.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
DAVIS AQUILANO CHASE PowerPoint Presentation by Charlie Cook F O U R T H E D I T I O N Forecasting © The McGraw-Hill Companies, Inc., 2003 chapter 9.
Data Mining Practical Machine Learning Tools and Techniques Chapter 4: Algorithms: The Basic Methods Section 4.6: Linear Models Rodney Nielsen Many of.
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
10B11PD311 Economics REGRESSION ANALYSIS. 10B11PD311 Economics Regression Techniques and Demand Estimation Some important questions before a firm are.
Operations Fall 2015 Bruce Duggan Providence University College.
Vibration Based Fuzzy-Neural System for Structural Health Monitoring
A Multi-level Data Fusion Approach for Early Fire Detection Odysseas Sekkas Stathes Hadjiefthymiades Evangelos Zervas Pervasive Computing Research Group,
A Passive Approach to Sensor Network Localization Rahul Biswas and Sebastian Thrun International Conference on Intelligent Robots and Systems 2004 Presented.
Enrique Martínez-Meyer
/ 26 Evolutionary Computing Chapter 8. / 26 Chapter 8: Parameter Control Motivation Parameter setting –Tuning –Control Examples Where to apply parameter.
Robust data filtering in wind power systems
MARKET APPRAISAL. Steps in Market Appraisal Situational Analysis and Specification of Objectives Collection of Secondary Information Conduct of Market.
Lecture 18 Today: More Chapter 9 Next day: Finish Chapter 9.
Model Fusion and its Use in Earth Sciences R. Romero, O. Ochoa, A. A. Velasco, and V. Kreinovich Joint Annual Meeting NSF Division of Human Resource Development.
Classification and Prediction: Ensemble Methods Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
MGS3100_03.ppt/Feb 11, 2016/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Time Series Forecasting Feb 11, 2016.
1 Lecture 4 The Fuzzy Controller design. 2 By a fuzzy logic controller (FLC) we mean a control law that is described by a knowledge-based system consisting.
Forecasting Demand. Problems with Forecasts Forecasts are Usually Wrong. Every Forecast Should Include an Estimate of Error. Forecasts are More Accurate.
Assignable variation Deviations with a specific cause or source. forecast bias or assignable variation or MSE? Click here for Hint.
LOAD FORECASTING. - ELECTRICAL LOAD FORECASTING IS THE ESTIMATION FOR FUTURE LOAD BY AN INDUSTRY OR UTILITY COMPANY - IT HAS MANY APPLICATIONS INCLUDING.
1 A latent information function to extend domain attributes to improve the accuracy of small-data-set forecasting Reporter : Zhao-Wei Luo Che-Jung Chang,Der-Chiang.
McGraw-Hill/Irwin Copyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 3 Forecasting.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Online Conditional Outlier Detection in Nonstationary Time Series
Outlier Processing via L1-Principal Subspaces
Evaluation of measuring tools: validity
Quality-aware Aggregation & Predictive Analytics at the Edge
Dr. Unnikrishnan P.C. Professor, EEE
Introduction to Instrumentation Engineering
Uncertainty-driven Ensemble Forecasting of QoS in Software Defined Networks Kostas Kolomvatsos1, Christos Anagnostopoulos2, Angelos Marnerides3, Qiang.
K. Kolomvatsos1, C. Anagnostopoulos2, and S. Hadjiefthymiades1
Intelligent Contextual Data Stream Monitoring
Roc curves By Vittoria Cozza, matr
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
An Edge-Centric Ensemble Scheme for Queries Assignment
Kostas Kolomvatsos, Christos Anagnostopoulos
Presentation transcript:

K. Kolomvatsos 1, C. Anagnostopoulos 2, and S. Hadjiefthymiades 1 An Efficient Environmental Monitoring System adopting Data Fusion, Prediction & Fuzzy Logic 1 University of Athens, Department of Informatics & Telecommunications 2 Department of Informatics, Ionian University 6 th International Conference on Information, Intelligence, Systems and Applications July 2015 Corfu, Greece

Outline Environmental Monitoring The Proposed Mechanism The Fusion Component The Prediction Component The Fuzzy Logic Controller Experimental Results

Environmental Monitoring Changes in the environment should be immediately identified and specific solutions should be applied. Need: pro-active methods that immediately respond to any change in the environment’s characteristics. A number of sensors could monitor specific areas and a Central System (CS) could reason over the observed values and support decision making. Many research and commercial efforts adopt: sensors observing a specific phenomenon (e.g., temperature, humidity, water level), and, intelligent systems that respond to the identification of events (e.g., fire, flood)

The Proposed Mechanism (1/3) We propose a mechanism that combines data fusion techniques, prediction (regression) and Fuzzy Logic (FL). The proposed mechanism is a decision making tool for the identification of environmental events. builds on top of measurements performed by a number of sensors to provide immediate responses to any observed abnormality. derives knowledge from the group of sensors. aggregates the reported measurements and reasons over the opinion of the group (on the occurrence of the specific event).

The Proposed Mechanism (2/3) We consider a group of N sensors. Sensors observe the same phenomenon and their reports are TXed at pre-defined intervals to the CS. When the CS receives sensor readings, it decides if an event has occurred and, then, triggers the respective alert. The CS is not based only on a single sensor observations, as false alarms could undermine robustness. Sensors could report invalid observations due to various reasons (intrinsic, extrinsic).

The Proposed Mechanism (3/3) In the proposed CS, a number of components are responsible to manage the incoming data and derive the appropriate decision. The adopted components are: a Fusion Component (FC) that undertakes the responsibility of eliminating the outlier data and providing the final fused measurement, a Prediction Component (PC) that, based on the fused measurement historical values, derives the predicted future fused measurement and, an FL Controller (FLC) that gets the results of FC and PC components and derives the Degree of Danger (DoD). The DoD provides a view on the existing danger based on the current measurements and the predicted value.

The Fusion Component (1/4) Data fusion combines contextual data from all sensors to derive reliable fused measurements. We adopt the cumulative sum (CumSum) algorithm for outliers detection over all measurements and the linear opinion pool algorithm for deriving the final aggregated value. CumSum detects if there is any change in the distribution of a contextual time series corresponding to a sensor. The algorithm is a change-point detection technique based on the cumulative sum of the differences between the current value at instance t and the overall average up to t. We adopt a 2-side detection scheme where an observation is inferred as an outlier when it lies above a target threshold h + or below a target threshold h -

The Fusion Component (2/4) Two signals are the output of the CumSum algorithm: the above detection signal and the below detection signal. When the time series deviates from the thresholds, detection signals are set to 1. The detected outliers are eliminated and, thus, the mechanism (at instance t) is based on the opinion (measurements) of those sensors that do not produce outliers. The proposed MS adopts a linear opinion pool scheme for the remaining values.

The Fusion Component (3/4) The linear opinion pool is a standard approach to combine experts’ opinion through a weighted linear average. The final aim is to combine singe experts’ opinion to produce the opinion of the group. We apply specific weights in each expert to pay more / less attention on each opinion affecting more / less the final result. The fused measurement f = F(x 1, x 2, …, x N ) is the opinion pool based on the pooling operator F over the measurements (opinions). We adopt a weighted linear average i.e.,, where w i is the weight associated with the opinion of sensor S i which does not produce an outlier. m is the number of sensors derived by the CumSum algorithm..

The Fusion Component (4/4) We define C i as the confidence that the CS has on sensor S i in successfully fulfilling the assigned task. C i could be affected by the sensor state or by historical data. We calculate each weight as follows: The CS assigns more weight on the opinion of a sensor having a high confidence value.

The Prediction Component For each sensor S i a time ordered set of past values is maintained. History of the latest observations. We predict the next measurement through a linear combination of the historical measurements with real-valued prediction coefficients. The set of coefficients are estimated to minimize the prediction error between the predicted and the actual measurement. We adopt the Levinson-Durbin * algorithm for coefficient estimation. * A)Durbin J., ‘The fitting of time series models’, Rev. Inst. Int. Stat., v. 28, 1960, pp B) Levinson N., ‘The Wiener RMS error criterion in filter design and prediction’, Journal Math. Phys., v. 25, 1947, pp

The FL Controller We developed an FL Controller (FLC), which is responsible for defining the CS’s reaction to the incoming data The FL Controller has two inputs: the fused measurement based on current sensors observations (f v ) the predicted measurement based on historical data (p v ) The output is the DoD value. We consider that DoD  1 indicates that the danger is at high levels; the opposite stands when DoD  0. We consider three linguistic values: Low, Medium, High. A Low value represents that the variable takes values close to the lower limit while a High value depicts the case where the variable takes values close to the upper level. A Medium value depicts the case where the variable takes values close to the average. We consider triangular membership functions.

Experimental Evaluation (1/3) Performance Metrics Rate of False Alerts (RFA). It represents the rate of false alerts. As RFA → 1, the system results a lot of false alerts. As RFA → 0, the system minimizes the rate of false alerts. Index of Alert (IA). It represents the index of the sensor report that triggers an alert. Datasets Intel Berkeley Research Lab dataset – Temperature values (Intel Lab Data, We inject faulty measurements to derive the RFA - P faulty measurements (P ∈ {1%, 5%, 10%, 20%, 40%}) of the total (15,000 measurements) Real past flood event as reported by a number of water level sensors (

Experimental Evaluation (2/3) We compare the proposed FL system (FLS) with the following models: The Single Sensor Alerting (SSA) mechanism It delivers an alert when at least one sensor reports a value over a pre- defined threshold The Average Measurements Alerting (AMA) mechanism It produces alerts when the average value of the sensor reports is over the pre-defined threshold

Experimental Evaluation (3/3) Experimental results for various P Experimental results for various N (number of sensors) Experimental results for IA (5 sensors) Experimental results for IA (10 sensors) ModelIA Real Event45 FLC44 AMA88 ModelIA Real Event45 FLC40 AMA45 SSA34, 35, 36, 39

Thank You!