Research Heaven, West Virginia Verification and Validation of Adaptive Systems Bojan Cukic, Eddie Fuller, Marcello Napolitano, Harshinder Singh, Tim Menzies,

Slides:



Advertisements
Similar presentations
Introduction to Support Vector Machines (SVM)
Advertisements

Support Vector Machine
Mining customer ratings for product recommendation using the support vector machine and the latent class model William K. Cheung, James T. Kwok, Martin.
Generative Models Thus far we have essentially considered techniques that perform classification indirectly by modeling the training data, optimizing.
Neural networks Introduction Fitting neural networks
1 Machine Learning: Lecture 4 Artificial Neural Networks (Based on Chapter 4 of Mitchell T.., Machine Learning, 1997)
Introduction to Neural Networks Computing
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
SVM - Support Vector Machines A new classification method for both linear and nonlinear data It uses a nonlinear mapping to transform the original training.
Multilayer Perceptrons 1. Overview  Recap of neural network theory  The multi-layered perceptron  Back-propagation  Introduction to training  Uses.
Support Vector Machines
CSCI 347 / CS 4206: Data Mining Module 07: Implementations Topic 03: Linear Models.
Lecture 13 – Perceptrons Machine Learning March 16, 2010.
Robust Multi-Kernel Classification of Uncertain and Imbalanced Data
Software Quality Ranking: Bringing Order to Software Modules in Testing Fei Xing Michael R. Lyu Ping Guo.
Support Vector Machines (SVMs) Chapter 5 (Duda et al.)
The Nature of Statistical Learning Theory by V. Vapnik
Simple Neural Nets For Pattern Classification
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
POWER SYSTEM DYNAMIC SECURITY ASSESSMENT – A.H.M.A.Rahim, S.K.Chakravarthy Department of Electrical Engineering K.F. University of Petroleum and Minerals.
Sparse Kernels Methods Steve Gunn.
SVM Support Vectors Machines
Computational aspects of motor control and motor learning Michael I. Jordan* Mark J. Buller (mbuller) 21 February 2007 *In H. Heuer & S. Keele, (Eds.),
Theory Simulations Applications Theory Simulations Applications.
Oral Defense by Sunny Tang 15 Aug 2003
Radial Basis Function Networks
An Introduction to Support Vector Machines Martin Law.
Research Heaven, West Virginia Lyapunov Stability Analysis and On-Line Monitoring Bojan Cukic, Edgar Fuller, Srikanth Gururajan, Martin Mladenovski, Sampath.
Soft Computing Colloquium 2 Selection of neural network, Hybrid neural networks.
Research Heaven, West Virginia Verification and Validation of Adaptive Systems Online Failure Detection and Identification for IFCS through Statistical.
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
CS 8751 ML & KDDSupport Vector Machines1 Support Vector Machines (SVMs) Learning mechanism based on linear programming Chooses a separating plane based.
Chapter 9 Neural Network.
NEURAL NETWORKS FOR DATA MINING
1 SUPPORT VECTOR MACHINES İsmail GÜNEŞ. 2 What is SVM? A new generation learning system. A new generation learning system. Based on recent advances in.
CS 478 – Tools for Machine Learning and Data Mining Backpropagation.
An Introduction to Support Vector Machine (SVM) Presenter : Ahey Date : 2007/07/20 The slides are based on lecture notes of Prof. 林智仁 and Daniel Yeung.
Machine Learning Using Support Vector Machines (Paper Review) Presented to: Prof. Dr. Mohamed Batouche Prepared By: Asma B. Al-Saleh Amani A. Al-Ajlan.
Johann Schumann and Pramod Gupta NASA Ames Research Center Bayesian Verification & Validation tools.
Kernel Methods A B M Shawkat Ali 1 2 Data Mining ¤ DM or KDD (Knowledge Discovery in Databases) Extracting previously unknown, valid, and actionable.
Classifiers Given a feature representation for images, how do we learn a model for distinguishing features from different classes? Zebra Non-zebra Decision.
An Introduction to Support Vector Machines (M. Law)
1 Pattern Recognition: Statistical and Neural Lonnie C. Ludeman Lecture 24 Nov 2, 2005 Nanjing University of Science & Technology.
Development of Methodologies for Independent Verification and Validation of Neural Networks NAG OSMA-F001-UNCLASS Methods and Procedures.
September Bound Computation for Adaptive Systems V&V Giampiero Campa September 2008 West Virginia University.
Support Vector Machines Project מגישים : גיל טל ואורן אגם מנחה : מיקי אלעד נובמבר 1999 הטכניון מכון טכנולוגי לישראל הפקולטה להנדסת חשמל המעבדה לעיבוד וניתוח.
Intelligent Systems Software Assurance Symposium 2004 Bojan Cukic & Yan Liu, Robyn Lutz & Stacy Nelson, Chris Rouff, Johann Schumann, Margaret Smith July.
University of Texas at Austin Machine Learning Group Department of Computer Sciences University of Texas at Austin Support Vector Machines.
Chapter 2 Single Layer Feedforward Networks
1  Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Final Exam Review CS479/679 Pattern Recognition Dr. George Bebis 1.
Chapter 8: Adaptive Networks
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Neural Networks 2nd Edition Simon Haykin
Perceptrons Michael J. Watts
1 SMART-T Briefing to OSMA SAS - July 19, 2004 SMART-T Project Overview Kurt D. Guenther AS&M / Dryden Flight Research Center July 19, 2004.
IEEE AI - BASED POWER SYSTEM TRANSIENT SECURITY ASSESSMENT Dr. Hossam Talaat Dept. of Electrical Power & Machines Faculty of Engineering - Ain Shams.
Neural networks (2) Reminder Avoiding overfitting Deep neural network Brief summary of supervised learning methods.
Machine Learning Artificial Neural Networks MPλ ∀ Stergiou Theodoros 1.
CS 9633 Machine Learning Support Vector Machines
Fall 2004 Backpropagation CS478 - Machine Learning.
Data Mining, Neural Network and Genetic Programming
Intelligent Systems Software Assurance Symposium 2004
EHPV® Technology Advanced Control Techniques for Electro-Hydraulic Control Valves by Patrick Opdenbosch Goals Develop a smarter and self-contained valve.
Chapter 3. Artificial Neural Networks - Introduction -
Neuro-Computing Lecture 4 Radial Basis Function Network
Recursively Adapted Radial Basis Function Networks and its Relationship to Resource Allocating Networks and Online Kernel Learning Weifeng Liu, Puskal.
Presentation transcript:

Research Heaven, West Virginia Verification and Validation of Adaptive Systems Bojan Cukic, Eddie Fuller, Marcello Napolitano, Harshinder Singh, Tim Menzies, Srikanth Gururajan, Yan Liu, Sampath Yeramalla West Virginia University

Research Heaven, West Virginia 2 Overview Introduction and motivation. Novelty detection: the data sniffing approach. Stability monitoring Experimentation Current status and perspectives.

Research Heaven, West Virginia 3 Introduction System performance evolves over time. –Evolution needed to address complex interactions between system and the environment. –Improved performance achieved through learning. Off-line and on-line adaptation. –Proper reactions to conditions not envisioned/identified/analyzed by system designers. NASA interests. –Autonomous navigation. –Intelligent flight control.

Research Heaven, West Virginia 4 Architectures for Adaptive NN-based Control Physical Process Feedback Control Adaptive NN Reference Model Command Error Learning Rule DCS Sigma-Pi Multilayer Perceptron (SHL) Radial Basis Function Desired Response Actual Response + -

Research Heaven, West Virginia 5 NASA IFCS Architecture (Gen 1) New V&V Techniques

Research Heaven, West Virginia 6 NASA IFCS Architecture (Gen II) pilot inputs Sensors Model Following Control Allocation Dynamic Inversion Controller - Direct Adaptive Neural Network + Feedback Error Implemented In ARTS II Implemented In SCE 3 New V&V Techniques

Research Heaven, West Virginia 7 Our Approach to V&V Feedback Control Adaptive NN Learning Rule Desired Response Physical Process Reference Model Command Error Actual Response + - Monitor Inputs to NN, Novelty Detection Monitor Stability of Learning Estimate Trustworthiness of Outputs

Research Heaven, West Virginia 8 The Role of Novelty Detection Block the penetration of unreliable or unreasonable training data into the online adaptive component. “Warn” the system about the incoming uncertainty. Provide architectural framework for backward and forward recovery capabilities.

Research Heaven, West Virginia 9 Support Vector Machines (SVM) Developed by Vapnik et. al., SVM is designed based on the Structural Risk Minimization Theory. In pattern recognition, used for efficient clustering in highly dimensional spaces. What SVM does? –Maps input space (by means of a nonlinear transformation) into a high dimensional (hidden) feature space.

Research Heaven, West Virginia 10 SVM finds the maximum margin hyperplane in the feature space. This hyperplane maximizes the minimum distance to the closest training point. Support Vector Machine (2) The maximum margin hyperplane is represented as linear combination of training points with non-zero weights (called support vectors).

Research Heaven, West Virginia 11 Support Vector Data Description Developed by Tax et. al., Finds a sphere with the minimal volume that contains all data points. Basically a one class classifier.

Research Heaven, West Virginia 12 Support Vector Data Description (2)

Research Heaven, West Virginia 13 5 Failure Modes, 3 Pairs of Parameters. Mode 1: Actuator Failure – stuck left stabilator at current position. ( 0 degree ) Mode 2: Actuator Failure – stuck left stabilator at pre-defined deflection. (+3 degree) Mode 3: Actuator Failure – stuck left stabilator at pre-defined deflection. (-3 degree) Mode 4: Actuator Failure – stuck right aileron at pre-defined deflection. (+3 degree) Mode 5: Actuator Failure – stuck right aileron at pre-defined deflection. (-3 degree) Pair 1: ( the pitch rate, the average of the left stabilator and the right stabilator) Pair 2:( the angle of attack, the average of the left stabilator and the right stabilator) Pair 3: ( the pitch altitude, the average of the left stabilator and the right stabilator) Experiments

Research Heaven, West Virginia 14 Data Collection

Research Heaven, West Virginia 15 SVDD and IFCS Simulation

Research Heaven, West Virginia 16 Novelty Detection for IFCS Parameterization of SVDD affects the treatment of novelties

Research Heaven, West Virginia 17 Monitoring Stability of Learning Traditional V&V techniques for a Neural Network code are not applicable. –The system changes following the deployment. The goal of the proposed approach: –Prove stability property of the learner. –Monitor convergence towards the stable state of the learner in real-time. –Provide a time varying measure of reliance that can be justifiably placed on the adaptive component. Smells like dependability, doesn’t it?

Research Heaven, West Virginia 18 Lyapunov (like) Stability Analysis We emphasize the role of Lyapunov-type self-stabilization analysis for V&V. –Think of NN as dynamical system –Lyapunov’s theorem says: find V such that V>0 and  V·0 then system moves towards given solution (stable). –Perturbations tend back to given solutions so variations in data will still give learnable states. DCS Neural Network algorithm is internally self-stabilizing.

Research Heaven, West Virginia 19 Lyapunov Theory and V&V Built in to this approach is a real-time measure for self- correction of a neural network based adaptive system

Research Heaven, West Virginia 20 A Simple Example Learning in DCS neural network. Two Spirals data set. –Move neurons to match data. –Connect regions that represent similar data. –Grow network. –Monitor self-correction.

Research Heaven, West Virginia 21 Stabilization Within DCS NN THEOREM: –During DCS network’s learning and representation from a fixed input manifold, the evolving state of the network due to neural unit’s positional adjustment is self-stabilizing in a globally asymptotically stable manner.

Research Heaven, West Virginia 22 Experimental Evaluation An F-15 simulator customized for WVU/NASA research needs. Input data sets obtained from simulated flights. DCS Cz network (Mach, altitude, alpha (angle of attack) WVU F-15 Flight Simulator

Research Heaven, West Virginia 23 Experimental Evaluation (2) Input data set (blue) Network training (red/green) Lyapunov monitoring function

Research Heaven, West Virginia 24 Summary The project is developing fundamentally new V&V technology applicable to a fundamentally different type of systems. Critical for future NASA missions (ASAP). –Autonomy and adaptivity anticipated to be critical. Multidisciplinary approach in research is a key to success. Research solves an engineering problem, which happens to have software implementation. This is a systems engineering exercise.

Research Heaven, West Virginia 25 Summary (2) Separating nominal flight conditions from failure modes by SVDD appears very promising research direction. –Computationally efficient. Lyapunov self-stabilization theory can guarantee that the network actually preserves and learns the input feature data manifold –The central V&V issue of IFCS. Effective monitoring of performance aspects of the neural network controllers.

Research Heaven, West Virginia 26 Further work Investigating real-time application of SVDD. Extending Lyapunov type analysis to variable input manifolds. –Stochastic stability analysis. Continual maintenance of the flight simulation capability. Investigating the “output trustworthiness” issue. Continuing collaborations with NASA (Ames, Dryden, IV&V), ISR, contractors… Keeping up with V&V needs of GEN II and beyond.