Robust data filtering in wind power systems

Slides:



Advertisements
Similar presentations
Mirror Outlier Detection in Foreign Trade Data Markos Fragkakis NTTS 2009.
Advertisements

CHAPTER 2 Building Empirical Model. Basic Statistical Concepts Consider this situation: The tension bond strength of portland cement mortar is an important.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Chapter 10 Curve Fitting and Regression Analysis
1 Simple Linear Regression and Correlation The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES Assessing the model –T-tests –R-square.
Challenge the future Delft University of Technology Blade Load Estimations by a Load Database for an Implementation in SCADA Systems Master Thesis.
STAT 135 LAB 14 TA: Dongmei Li. Hypothesis Testing Are the results of experimental data due to just random chance? Significance tests try to discover.
A Short Introduction to Curve Fitting and Regression by Brad Morantz
IAOS 2014 Conference – Meeting the Demands of a Changing World Da Nang, Vietnam, 8-10 October 2014 ROBUST REGRESSION IMPUTATION: CONSIDERATION ON THE INFLUENCE.
Simple Linear Regression
Robust Estimator 學生 : 范育瑋 老師 : 王聖智. Outline Introduction LS-Least Squares LMS-Least Median Squares RANSAC- Random Sample Consequence MLESAC-Maximum likelihood.
Data Modeling and Least Squares Fitting 2 COS 323.
Nonlinear Regression Probability and Statistics Boris Gervits.
Fitting. Choose a parametric object/some objects to represent a set of tokens Most interesting case is when criterion is not local –can’t tell whether.
5. Estimation 5.3 Estimation of the mean K. Desch – Statistical methods of data analysis SS10 Is an efficient estimator for μ ?  depends on the distribution.
1Jana Kosecka, CS 223b EM and RANSAC EM and RANSAC.
Correlation and Regression Analysis
Simple Linear Regression. Introduction In Chapters 17 to 19, we examine the relationship between interval variables via a mathematical equation. The motivation.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
GEODETIC INSTITUTE LEIBNIZ UNIVERSITY OF HANNOVER GERMANY Ingo Neumann and Hansjörg Kutterer The probability of type I and type II errors in imprecise.
Chapter 14: Sampling ACCT620 Internal Auditing Otto Chang Professor of Accounting.
1 Robust estimation techniques in real-time robot vision Ezio Malis, Eric Marchand INRIA Sophia, projet ICARE INRIA Rennes, projet Lagadic.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
1.6 Linear Regression & the Correlation Coefficient.
Introduction to Linear Regression
Statistical Methods Statistical Methods Descriptive Inferential
1 Robust Statistical Methods for Securing Wireless Localization in Sensor Networks (IPSN ’05) Zang Li, Wade Trappe Yanyong Zhang, Badri Nath Rutgers University.
How Errors Propagate Error in a Series Errors in a Sum Error in Redundant Measurement.
K. Kolomvatsos 1, C. Anagnostopoulos 2, and S. Hadjiefthymiades 1 An Efficient Environmental Monitoring System adopting Data Fusion, Prediction & Fuzzy.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 3 Describing Relationships 3.2 Least-Squares.
Introduction to Biostatistics and Bioinformatics Regression and Correlation.
Lecture 16 - Approximation Methods CVEN 302 July 15, 2002.
Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)
Curve Fitting Introduction Least-Squares Regression Linear Regression Polynomial Regression Multiple Linear Regression Today’s class Numerical Methods.
Engineering Analysis ENG 3420 Fall 2009 Dan C. Marinescu Office: HEC 439 B Office hours: Tu-Th 11:00-12:00.
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
V. Rouillard  Introduction to measurement and statistical analysis CURVE FITTING In graphical form, drawing a line (curve) of best fit through.
Linear Regression Linear Regression. Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Purpose Understand Linear Regression. Use R functions.
Copyright © Cengage Learning. All rights reserved. 12 Analysis of Variance.
DATA ANALYSIS AND MODEL BUILDING LECTURE 9 Prof. Roland Craigwell Department of Economics University of the West Indies Cave Hill Campus and Rebecca Gookool.
Graphics Programming 2007 Hwang Yong-Hyeon Dongseo Univ. Automatic Detection of Region-Mura Defect in TFT-LCD Yong-Hyeon.
Virtual University of Pakistan
Estimating standard error using bootstrap
Statistical disclosure control on visualising geocoded population data using a structure in quadtrees Eduard Suñé, Cristina Rovira, Daniel Ibáñez, Mireia.
CHAPTER 3 Describing Relationships
How Good is a Model? How much information does AIC give us?
Chapter 5 STATISTICS (PART 4).
SIMPLE LINEAR REGRESSION MODEL
Unfolding Problem: A Machine Learning Approach
Linear Regression.
Modelling data and curve fitting
Regression Models - Introduction
EQ: How well does the line fit the data?
CHAPTER 3 Describing Relationships
Linear regression Fitting a straight line to observations.
Least Squares Fitting A mathematical procedure for finding the best-fitting curve to a given set of points by minimizing the sum of the squares of the.
K. Kolomvatsos1, C. Anagnostopoulos2, and S. Hadjiefthymiades1
CHAPTER 3 Describing Relationships
CHAPTER 3 Describing Relationships
CHAPTER 3 Describing Relationships
Introduction to Sensor Interpretation
CHAPTER 3 Describing Relationships
CHAPTER 3 Describing Relationships
Introduction to Analytical Chemistry
CHAPTER 3 Describing Relationships
Unfolding with system identification
Introduction to Sensor Interpretation
Load forecasting Prepared by N.CHATHRU.
CHAPTER 3 Describing Relationships
Presentation transcript:

Robust data filtering in wind power systems By: Andrés Llombart-Estopiñán CIRCE Foundation – Zaragoza University

Index Objective Introduction: the need of filtering The LMS fitting technique The LMedS methodology Experimental results Conclusions

Index  Objective Introduction: the need of filtering The LMS fitting technique The LMedS methodology Experimental results Conclusions

Objective To assess the performance of the Least Median of Squares method when it is used to filter wind power data

Index Objective  Introduction: the need of filtering The LMS fitting technique The LMedS methodology Experimental results Conclusions

Introduction Why it is needed? Operation Maintenance Production Control Characterization of the P – v curves High quality P – v data

Introduction Circumstances that affect the data quality Sensor accuracy EMI Information processing errors Storage faults Faults in the communication systems Alarms in the wind turbine etc

Introduction An example of P – v data

Introduction P – v data after considering the SCADA alarms

Index Objective Introduction: the need of filtering  The LMS fitting technique The LMedS methodology Experimental results Conclusions

The LMS fitting technique Gets the curve that minimizes the Mean Square Error All measurements can be interpreted with the same model Very sensitive to outliers Breakdown of 0% of spurious data

The LMS fitting technique

Index Objective Introduction: the need of filtering The LMS fitting technique  The LMedS methodology Experimental results Conclusions

The LMedS fitting technique It is based in the existence of redundancy LMedS method uses the Median whereas the LMS method uses the mean Unfortunately the LMedS method don’t have analytical solution

The LMS fitting technique 1 2 3 4 5 6 8 7

The LMedS fitting technique Example Fitting with a polynomial with 4 coefficients n measurements m possible solutions, where

The LMedS fitting technique Steps to get the fitting: Calculate the m subsets of the minimum number of measurements required to fit your curve For each subset S, we compute a power curve in closed form PS For each solution PS, the median MS of the squares of the residue with respect to all the measurements is computed We store the solution PS which gives the least median MS

The LMedS fitting technique Rejection of wrong data: Estimate de standard deviation Probability of accepting a measure being good: 99 % Threshold = 2.57 s

Index Objective Introduction: the need of filtering The LMS fitting technique The LMedS methodology  Experimental results Conclusions

Experimental results Methodology A year of historical data 5 different tests Alarm Records (AR) AR + classical statistic method AR + robust statistic Classical statistic Robust statistic

Experimental results Rough data Considered Alarms

Experimental results AR + Class. Stat AR + Robust Stat.

Experimental results Classic Stat. Robust Stat.

Index Objective Introduction: the need of filtering The LMS fitting technique The LMedS methodology Experimental results  Conclusions

Conclusions A robust filtering method has been proposed It has been proved successfully The method have shown a good robustness Some research is needed Considering the wind direction

Robust data filtering in wind power systems Thanks for your attention

The LMedS fitting technique Example: fitting a polynomial of 4 coefficients for a 3 months period of data, that implies ~ 12.750 data The computational cost is huge

The LMedS fitting technique Solution: selecting randomly subsets Compromise: Minimizing the number of subsets Warranting a reasonable probability of not failing So, the first method step is substituted by a Monte Carlo technique to randomly select k subsets of 4 elements

The LMedS fitting technique How many subsets? A selection of k subsets is good if at least in one subset all the measurements are good Pns is the probability that a measurement is not spurious Pm is the probability of not reaching a good solution

The LMedS fitting technique In our example considering: Pns = 75 % Pm = 0,001