Fault Prediction in Electrical Valves Using Temporal Kohonen Maps Luiz F. Gonçalves, Eduardo L. Schneider, Jefferson L. Bosa, Renato Ventura B. Henriques,

Slides:



Advertisements
Similar presentations
Perceptron Learning Rule
Advertisements

2806 Neural Computation Self-Organizing Maps Lecture Ari Visa.
Neural Networks Dr. Peter Phillips. The Human Brain (Recap of week 1)
Marković Miljan 3139/2011
1 Machine Learning: Lecture 10 Unsupervised Learning (Based on Chapter 9 of Nilsson, N., Introduction to Machine Learning, 1996)
Self Organization of a Massive Document Collection
Neural Networks Chapter 9 Joost N. Kok Universiteit Leiden.
Self Organization: Competitive Learning
5/16/2015Intelligent Systems and Soft Computing1 Introduction Introduction Hebbian learning Hebbian learning Generalised Hebbian learning algorithm Generalised.
Kohonen Self Organising Maps Michael J. Watts
Unsupervised Networks Closely related to clustering Do not require target outputs for each input vector in the training data Inputs are connected to a.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
UNIVERSITY OF JYVÄSKYLÄ Yevgeniy Ivanchenko Yevgeniy Ivanchenko University of Jyväskylä
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks Ch15. 2 Objectives Grossberg network is a self-organizing continuous-time competitive network.  Continuous-time recurrent.
Lecture 09 Clustering-based Learning
Introduction to Artificial Neural Network and Fuzzy Systems
SOMTIME: AN ARTIFICIAL NEURAL NETWORK FOR TOPOLOGICAL AND TEMPORAL CORRELATION FOR SPATIOTEMPORAL PATTERN LEARNING.
Radial Basis Function (RBF) Networks
Radial Basis Function Networks
 C. C. Hung, H. Ijaz, E. Jung, and B.-C. Kuo # School of Computing and Software Engineering Southern Polytechnic State University, Marietta, Georgia USA.
Soft Computing Colloquium 2 Selection of neural network, Hybrid neural networks.
Lecture 12 Self-organizing maps of Kohonen RBF-networks
KOHONEN SELF ORGANISING MAP SEMINAR BY M.V.MAHENDRAN., Reg no: III SEM, M.E., Control And Instrumentation Engg.
A Shaft Sensorless Control for PMSM Using Direct Neural Network Adaptive Observer Authors: Guo Qingding Luo Ruifu Wang Limei IEEE IECON 22 nd International.
FAULT DIAGNOSIS OF THE DAMADICS BENCHMARK ACTUATOR USING NEURO-FUZZY SYSTEMS WITH LOCAL RECURRENT STRUCTURE FAULT DIAGNOSIS OF THE DAMADICS BENCHMARK ACTUATOR.
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
Electrical and Computer Systems Engineering Postgraduate Student Research Forum 2001 WAVELET ANALYSIS FOR CONDITION MONITORING OF CIRCUIT BREAKERS Author:
CZ5225: Modeling and Simulation in Biology Lecture 5: Clustering Analysis for Microarray Data III Prof. Chen Yu Zong Tel:
Self-organizing Maps Kevin Pang. Goal Research SOMs Research SOMs Create an introductory tutorial on the algorithm Create an introductory tutorial on.
Intrusion Detection Using Hybrid Neural Networks Vishal Sevani ( )
Artificial Neural Networks Dr. Abdul Basit Siddiqui Assistant Professor FURC.
Self organizing maps 1 iCSC2014, Juan López González, University of Oviedo Self organizing maps A visualization technique with data dimension reduction.
1 UFRGS Design of an Embedded System for the Proactive Maintenance of Electrical Valves Luiz F. Gonçalves, Jefferson L. Bosa, Renato V. B. Henriques, Marcelo.
A Scalable Self-organizing Map Algorithm for Textual Classification: A Neural Network Approach to Thesaurus Generation Dmitri G. Roussinov Department of.
NEURAL NETWORKS FOR DATA MINING
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A Comparison of SOM Based Document Categorization Systems.
MATLAB.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Institute for Advanced Studies in Basic Sciences – Zanjan Kohonen Artificial Neural Networks in Analytical Chemistry Mahdi Vasighi.
Self Organizing Feature Map CS570 인공지능 이대성 Computer Science KAIST.
September Bound Computation for Adaptive Systems V&V Giampiero Campa September 2008 West Virginia University.
IE 585 Competitive Network – Learning Vector Quantization & Counterpropagation.
Akram Bitar and Larry Manevitz Department of Computer Science
Intelligent Database Systems Lab N.Y.U.S.T. I. M. Externally growing self-organizing maps and its application to database visualization and exploration.
Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.
CUNY Graduate Center December 15 Erdal Kose. Outlines Define SOMs Application Areas Structure Of SOMs (Basic Algorithm) Learning Algorithm Simulation.
Performance of Adaptive Beam Nulling in Multihop Ad Hoc Networks Under Jamming Suman Bhunia, Vahid Behzadan, Paulo Alexandre Regis, Shamik Sengupta.
Semiconductors, BP&A Planning, DREAM PLAN IDEA IMPLEMENTATION.
Lecture 5 Neural Control
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A self-organizing map for adaptive processing of structured.
CHAPTER 14 Competitive Networks Ming-Feng Yeh.
An Energy-Efficient Approach for Real-Time Tracking of Moving Objects in Multi-Level Sensor Networks Vincent S. Tseng, Eric H. C. Lu, & Kawuu W. Lin Institute.
ViSOM - A Novel Method for Multivariate Data Projection and Structure Visualization Advisor : Dr. Hsu Graduate : Sheng-Hsuan Wang Author : Hujun Yin.
IEEE AI - BASED POWER SYSTEM TRANSIENT SECURITY ASSESSMENT Dr. Hossam Talaat Dept. of Electrical Power & Machines Faculty of Engineering - Ain Shams.
A Self-organizing Semantic Map for Information Retrieval Xia Lin, Dagobert Soergel, Gary Marchionini presented by Yi-Ting.
Neural network based hybrid computing model for wind speed prediction K. Gnana Sheela, S.N. Deepa Neurocomputing Volume 122, 25 December 2013, Pages 425–429.
Machine Learning 12. Local Models.
Big data classification using neural network
Self-Organizing Network Model (SOM) Session 11
Temporal Sequence Processing using Recurrent SOM
Building Adaptive Basis Function with Continuous Self-Organizing Map
Soft Computing Applied to Finite Element Tasks
Lecture 22 Clustering (3).
The use of Neural Networks to schedule flow-shop with dynamic job arrival ‘A Multi-Neural Network Learning for lot Sizing and Sequencing on a Flow-Shop’
Artificial Neural Networks
Unsupervised Networks Closely related to clustering
Akram Bitar and Larry Manevitz Department of Computer Science
Presentation transcript:

Fault Prediction in Electrical Valves Using Temporal Kohonen Maps Luiz F. Gonçalves, Eduardo L. Schneider, Jefferson L. Bosa, Renato Ventura B. Henriques, Paulo M. Engel, Marcelo S. Lubaszewski 11 th LATW Punta del Leste - March UFRGS

2 OUTLINE  Introduction  Maintenance scheme  Mathematical model  Signal processing  Temporal Kohonen maps  Experimental results  Conclusions

3 INTRODUCTION

4  The prediction of certain phenomena, processes or failures (or time series prediction) is particularly interesting and useful in many cases  It has been the subject of research in several areas:  Medicine (saving lives)  Meteorology (predicting the rain precipitation)  Engineering (increasing equipment reliability)  Economics (predicting changes in the stock market)  Main motivation: is the need to predict the future conditions and to understand the underlying phenomena and processes of the system under study Building models of the system using the knowledge and information that is available

5 INTRODUCTION  Many methods for system prediction have been developed with very different approaches  Statistics:  Autoregressive  Autoregressive Moving Average  Neural networks:  Multi-Layer Perceptrons  Radial Basis Networks  Self-Organizing Maps (SOM) In the last years, models based on self-organizing maps have been raising much interest

6 INTRODUCTION  Self-organizing map algorithms perform a vector quantization of data, leading to representatives in each portion of the space  The temporal models, built from SOM such as:  Temporal Kohonen maps (TKM)  Merge self-organizing maps (MSOM)  Recurrent self-organizing maps (RSOM) Use a leaky integrator memory to preserve the temporal context of the input signals

7 INTRODUCTION  In this work, a proactive maintenance scheme is proposed for fault prediction in electrical valves Electrical valves Model Signals of torque and position Predicting the faults Oil distribution network Proactive maintenance scheme Wavelet packet transform & Temporal Kohonen maps

8 MAINTENANCE SCHEME

9 PROACTIVE MAINTENANCE  Recent advances in:  Electronics  Computing  Proactive ≠ corrective, preventive or predictive To automate and integrate proactive (also know as intelligent) maintenance tasks into embedded system That are based either on post-failure correction or on off-line periodic system checking Focuses on fault prediction and diagnosis based on component lifetimes and on system on-line monitoring

10 MAINTENANCE SCHEME Mathematical model Wavelet packet transform Temporal Kohonen maps

11 MATHEMATICAL MODEL  Electrical actuator Main components Forces

12 MATHEMATICAL MODEL  Electrical actuator model Differential and algebraic equations Fault injection Position Torque

13 SIGNAL PROCESSING  Wavelet packet transform  Preserves timing and spectral information  Suitable for the analysis of non-stationary signals  Capable of decomposing the signal in frequency bands  Energy (spectral density)  Torque  Position  The energy is used by the self-organizing maps Divided into N frequency bands The WPT runs in a PC station during the training phase During on-line testing, the WPT shall be part of the embedded system

14 SELF-ORGANIZING MAPS  SOM or Kohonen maps (class of neural networks)  Unsupervised learning paradigm based on:  Competition (search the winner neuron)  Cooperation (identify direct neighbors)  Adaptation (update synaptic weights) The goal of a SOM is, after trained, mapping any input data from a R n space representation into R 2 lattice-like matrix Energy vector Synaptic weight vector

15 TEMPORAL KOHONEN MAPS  The temporal Kohonen map (TKM)  Unsupervised approach for prediction derived from the SOM algorithm  Uses leaky integrators to maintain the activation history of each neuron  These neurons gradually loose their activity and are added to the outputs of the other normal competitive units  These integrators, and consequently the decay of activation, are modeled through the difference equation: Where: Euclidean Distance Temporal Activation

16 TEMPORAL KOHONEN MAPS  The internal processing of SOM and TKM algorithms can be simplified and divided in three different steps: 1. Start up 2. Training 3. Recovery  Winner neuron:  SOM: the neuron with the shortest distance  TKM: the neuron with the highest activation Except for the determination of the winner neurons (recovery step), all other steps of the TKM are the same as in the SOM

17  For fault prediction, in recovery step, the map is colored such that the distance between neighboring neurons can be seen  The distance is given by the difference between the synaptic weights of neighboring neurons  Closer neurons will appear clustered in the map and will be assigned the same color  Different colors will denote neurons under different operation conditions: normal, degraded or faulty  Once the winner neuron is computed for a particular input vector, E, the current system status can be identified in the colored map and, in deviated behavior, the degradation trajectory can be visualized in the map TEMPORAL KOHONEN MAPS

18 TEMPORAL KOHONEN MAPS  In the TKM the system state can be visualized as a trajectory on the map and it is possible to follow the dynamics of the process This trajectory is described based on the winning neurons In a normal operation mode, the winners ought to follow a path inside the normal behavior region When a failure occurs, the winner will deviate from the normal region

19 EXPERIMENTAL RESULTS

20 EXPERIMENTAL RESULTS  Steps to generate the results: 1. Generate data (W) for normal (N), degraded (D) and faulty (F) behavior (obtained from the model) 2. Obtain the classification map (N, D and F data) using temporal Kohonen maps 3. Generate new N, D and F data (E) for three faults 4. Obtain the prediction map for each kind of faulty

21 EXPERIMENTAL RESULTS  A lot of simulations is performed to obtain typical values of torque and opening position under N, D and F valve operation to train the fault prediction map  The fault simulation is needed to generate the F and D data (some parameters are gradually incremented) K M deviations simulate the elasticity loss of the valve spring along time C a deviations simulate an increase of friction between the valve stem and seal 100 operation cycles K R simulates the degradation of the internal valve worm gear, till it breaks

22 MODEL RESULTS  Fault simulation Torque Position

23 CLASSIFICATION RESULTS  Fault classification map of faults in K R, K M and C a

24 CLASSIFICATION RESULTS  Fault classification map of faults in K R, K M and C a

25 CLASSIFICATION RESULTS  Fault classification map of faults in K R, K M and C a

26 CLASSIFICATION RESULTS  Fault classification map of faults in K R, K M and C a

27 CLASSIFICATION RESULTS  Fault classification map of faults in K R, K M and C a During the on-line testing phase, a winner neuron computed for a measured input vector can be easily located in this map Each cluster is assigned a different color

28 PREDICTION RESULTS  Fault prediction map of faults in K R

29 PREDICTION RESULTS  Fault prediction map of faults in K M

30 PREDICTION RESULTS  Fault prediction map of faults in C a

31 PREDICTION RESULTS  It can be seen in these figures, three different paths (one for each simulated fault)  The trajectories started from neurons classified as normal, passed through neurons classified as degradation, and arrived to a neuron that represents the failure  It is noteworthy that in this work, the temporal Kohonen map is just used as a visualization tool

32 CONCLUSION

33 CONCLUSIONS  A proactive maintenance scheme is proposed for the prediction of faults in electrical valves, used for flow control in an oil distribution network  This is the first attempt to apply a proactive maintenance methodology to this sort of valves  A implementation of temporal Kohonen maps is proposed to solve the valve maintenance problem

34 CONCLUSIONS  An system implements these maps for the prediction of faults in this valves  This technique can clearly be extended to any type of maintenance scheme including the on-line testing of heterogeneous chip with some kind of electro- mechanical systems (sensors or actuators) or other, for example

35 CONCLUSIONS  The results obtained point out to a promising solution for the maintenance in electrical valves  Acknowledgements  CNPq  CAPES  Petrobrás

Thank you!