DeltaV Neural - Expert In Expert mode, the user can select the training parameters, recommend you use the defaults for most applications.

Slides:



Advertisements
Similar presentations
Neural networks Introduction Fitting neural networks
Advertisements

Neural Networks  A neural network is a network of simulated neurons that can be used to recognize instances of patterns. NNs learn by searching through.
Efficiency of Algorithms
Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”
CMPUT 466/551 Principal Source: CMU
Lecture 13 – Perceptrons Machine Learning March 16, 2010.
Artificial Intelligence (CS 461D)
Genetic algorithms for neural networks An introduction.
Machine Learning Motivation for machine learning How to set up a problem How to design a learner Introduce one class of learners (ANN) –Perceptrons –Feed-forward.
October 14, 2010Neural Networks Lecture 12: Backpropagation Examples 1 Example I: Predicting the Weather We decide (or experimentally determine) to use.
MACHINE LEARNING 12. Multilayer Perceptrons. Neural Networks Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1)
Data mining and statistical learning - lecture 11 Neural networks - a model class providing a joint framework for prediction and classification  Relationship.
Neural Network Tools. Neural Net Concepts The package provides a “standard” multi-layer perceptron –Composed of layers of neurons –All neurons in a layer.
1 Validation & Verification Chapter VALIDATION & VERIFICATION Very Difficult Very Important Conceptually distinct, but performed simultaneously.
Matthew Greenstein | METEO 485 | Apr. 26, 2004 Using Neural Networks and Lagged Climate Indices to Predict Monthly Temperature and Precipitation Anomalies.
December 5, 2012Introduction to Artificial Intelligence Lecture 20: Neural Network Application Design III 1 Example I: Predicting the Weather Since the.
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Neural Networks Introduction – What is a neural network and what can it do for me? Terminology, Design and Topology Data Sets – When too much is not a.
Neural Networks Ellen Walker Hiram College. Connectionist Architectures Characterized by (Rich & Knight) –Large number of very simple neuron-like processing.
NEURAL NETWORKS FOR DATA MINING
CS 478 – Tools for Machine Learning and Data Mining Backpropagation.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 9: Ways of speeding up the learning and preventing overfitting Geoffrey Hinton.
CSC321 Introduction to Neural Networks and Machine Learning Lecture 3: Learning in multi-layer networks Geoffrey Hinton.
An Artificial Neural Network Approach to Surface Waviness Prediction in Surface Finishing Process by Chi Ngo ECE/ME 539 Class Project.
Neural Networks - Berrin Yanıkoğlu1 Applications and Examples From Mitchell Chp. 4.
Chapter 2 Single Layer Feedforward Networks
CSC321: Lecture 7:Ways to prevent overfitting
1 Creating Situational Awareness with Data Trending and Monitoring Zhenping Li, J.P. Douglas, and Ken. Mitchell Arctic Slope Technical Services.
Data Screening. What is it? Data screening is very important to make sure you’ve met all your assumptions, outliers, and error problems. Each type of.
Neural Networks - Berrin Yanıkoğlu1 MLP & Backpropagation Issues.
Ensemble Classifiers.
Neural Networks: An Introduction and Overview
Fall 2004 Backpropagation CS478 - Machine Learning.
Amos Tanay Nir Yosef 1st HCA Jamboree, 8/2017
Deep Feedforward Networks
Artificial Neural Networks
Advanced information retreival
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
Chapter 2 Single Layer Feedforward Networks
General principles in building a predictive model
OPSE 301: Lab13 Data Analysis – Fitting Data to Arbitrary Functions
James K Beard, Ph.D. April 20, 2005 SystemView 2005 James K Beard, Ph.D. April 20, 2005 April 122, 2005.
Neural Networks A neural network is a network of simulated neurons that can be used to recognize instances of patterns. NNs learn by searching through.
Final Year Project Presentation --- Magic Paint Face
CS 4/527: Artificial Intelligence
Counter propagation network (CPN) (§ 5.3)
Statistical Methods For Engineers
Introduction to Systems Analysis and Design
Biological and Artificial Neuron
Biological and Artificial Neuron
The Scientific Method.
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Chap. 7 Regularization for Deep Learning (7.8~7.12 )
Biological and Artificial Neuron
Artificial Neural Networks
Department of Electrical Engineering
DeltaV Neural – Lab Entry
The Organizational Impacts on Software Quality and Defect Estimation
Overfitting and Underfitting
Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Jan. 9, 2001
Neural Network Lab Develop a Neural Network to simulate the temperature exiting a heat exchanger: We will use a simulated heat exchanger in DeltaV, EX2_SIM.
Neural Networks II Chen Gao Virginia Tech ECE-5424G / CS-5824
Neural networks (1) Traditional multi-layer perceptrons
Neural Networks II Chen Gao Virginia Tech ECE-5424G / CS-5824
Neural Networks: An Introduction and Overview
David Kauchak CS158 – Spring 2019
Introduction to Neural Networks
Memory-Based Learning Instance-Based Learning K-Nearest Neighbor
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
Teaching Recurrent NN to be Dynamical Systems
Presentation transcript:

DeltaV Neural - Expert In Expert mode, the user can select the training parameters, recommend you use the defaults for most applications

Right click

max = sqrt( number inputs ) Number Hidden Neurons In DeltaV, number of hidden neurons is done by training the network with increasing number, max = sqrt( number inputs ) Training stops when less than 10% reduction in error for each node used

Using External Historical Data Lab data may not be collected in DeltaV, may be collected in a legacy system or recorded manually Historical data may be saved in another system not compatible with DeltaV DeltaV Neural is designed to use external data in development of a virtual sensor

Using Data Saved in a File Sensitivity analysis and Autogeneration may be done using the File selection

Specifying the Data File You select the file as a .dat file extension

Data File Format Line 1 The phrase DeltaV_NN_Data <eol> Line 2 List Input References <tab> Number of Outputs <eol> Line 3 Number of samples in file <tab> sample rate in seconds <eol> Line 4 An empty line <eol> Line 5 Identifiers separated by tabs <eol> Line 6 An empty line <eol> Line 7 The data in the following order Sample index <tab> output <tab> first input <tab> … <eol> Last Line An empty line <eol>

Start of Example File DeltaV_NN_Data 4 1 897 6.000000 4 1 897 6.000000 TT2-1 TT2-2 FC2-1 FC2-2 1 100.28817749 144.00000000 85.00000000 0.55000007 0.48933348 60.00000000 2 100.28817749 144.00000000 85.00000000 0.55000007 0.48949844 60.00000000 3 100.28817749 144.00000000 85.00000000 0.55000007 0.48989388 60.00000000 4 100.28817749 144.00000000 85.00000000 0.55000007 0.48989388 60.00000000 5 100.28817749 144.00000000 85.00000000 0.55000007 0.49091327 60.00000000 6 100.28817749 144.00000000 85.00000000 0.55000007 0.49092382 60.00000000 7 101.00279999 144.00000000 85.00000000 0.55000007 0.49185991 60.00000000 101.00279999 144.00000000 85.00000000 0.55000007 0.71004164 60.00000000

Example File DeltaV_NN_Data 4 1 897 6.000000 TT2-1 TT2-2 FC2-1 FC2-2 1 100.28817749 144.00000000 85.00000000 0.55000007 0.48933348 60.00000000 2 100.28817749 144.00000000 85.00000000 0.55000007 0.48949844 60.00000000 3 100.28817749 144.00000000 85.00000000 ## 0.48989388 60.00000000 4 100.28817749 144.00000000 85.00000000 0.55000007 0.48989388 60.00000000 5 100.28817749 144.00000000 85.00000000 0.55000007 0.49091327 60.00000000 6 100.28817749 144.00000000 85.00000000 0.55000007 ## 60.00000000 7 101.00279999 144.00000000 85.00000000 0.55000007 0.49185991 60.00000000 101.00279999 144.00000000 85.00000000 0.55000007 0.71004164 60.00000000 Use ## to indicate a point not used. Do not remove the point! Time shift is required to make the network converge properly!

Neural Network Applications Rules of Thumb NN needs data with accurate time stamps NN needs the correct input variables to get good correlation Be careful that input variables are not a function of output variables Need real, ground truth data to model (guesses don’t count) Watch out for even “minor” changes to the process NN is excellent at determining key input variables and the delays But… if all input values do not have a delay, can still build a prediction model if we assume inputs with zero delay will remain constant or have minor effect on estimation! NN can do fault diagnostics by modeling “normal” and watching for variation from “normal”

Neural Network Applications Rules of Thumb (Cont’d) NNs can be used with first principle models to build more accurate Hybrid models when the first principle theory has limitations If control problem is non-linear, NN is probably good choice If you model a poorly controlled process, you will likely have a controller that controls poorly Need to insure that “full operating range” is represented Uncontrolled variability in process can cause model inaccuracies Often need additional sensors for inferential measurement No matter how good the NN model (technology) it is useless if there is not enough justification to implement Although not a substitute for DOE (or structured data in general) significant results for knowledge discovery may be realized using historical data

Seven Deadly Sins of Neural Networks 1 - Bad Outlier Data 2 - Too Limited a Range 3 - Noisy Data 4 - Little to no Variation 5 - Too few hidden Neurons 6 - Over fitting 7 - Lack of Convergence

Bad Outlier Data These bad points will cause the algorithm to shift toward them, therefore cause the whole model to be in error

Too Limited a Range If the data is tightly gathered around a single value, the network will learn this gathering place rather than the whole process structure

Noisy Data If the data is too noisy, the network will learn the noise and not the process

Little to No Variation Same as limited range DeltaV Neural Network will exclude the data for you If you add it, and the process does vary, the network will show a variation, but how much? How does it know?

Too Few a Number of Neurons DeltaV Neural will select the number for you, this can become a problem with other programs. The opposite can be a problem, too many neurons can cause overfitting

Over Fitting Extra hidden neurons can change the weights of other neurons Possible to have an “Offset Neuron” with a value always + or – 1 Meaning less neuron with 0 output weight “Trim Neuron” with constant value on all but a few samples

Lack of Convergence Handling outputs that have no correlation with the inputs