Artificial Neural Networks

Slides:

Advertisements

Similar presentations

Text mining Gergely Kótyuk Laboratory of Cryptography and System Security (CrySyS) Budapest University of Technology and Economics

Advertisements

Neural Networks Dr. Peter Phillips. The Human Brain (Recap of week 1)

Training and Testing Neural Networks 서울대학교 산업공학과 생산정보시스템연구실 이상진.

Neural Networks Chapter 9 Joost N. Kok Universiteit Leiden.

Unsupervised learning. Summary from last week We explained what local minima are, and described ways of escaping them. We investigated how the backpropagation.

Self Organization: Competitive Learning

Kohonen Self Organising Maps Michael J. Watts

Decision Support Systems

Neural Networks Part 4 Dan Simon Cleveland State University 1.

November 19, 2009Introduction to Cognitive Science Lecture 20: Artificial Neural Networks I 1 Artificial Neural Network (ANN) Paradigms Overview: The Backpropagation.

Neural Network-based Face Recognition, using ARENA Algorithm. Gregory Tambasis Supervisor: Dr T. Windeatt.

CONTENT BASED FACE RECOGNITION Ankur Jain 01D05007 Pranshu Sharma Prashant Baronia 01D05005 Swapnil Zarekar 01D05001 Under the guidance of Prof.

November 9, 2010Neural Networks Lecture 16: Counterpropagation 1 Unsupervised Learning So far, we have only looked at supervised learning, in which an.

8 th Iranian workshop of Chemometrics 7-9 February 2009 Progress of Chemometrics in Iran Mehdi Jalali-Heravi February 2009 In the Name of God.

Implementing a reliable neuro-classifier

Introduction to Neural Networks John Paxton Montana State University Summer 2003.

Data mining and statistical learning - lecture 11 Neural networks - a model class providing a joint framework for prediction and classification  Relationship.

Geographical Information System GIS By: Yahia Dahash.

Multilayer feed-forward artificial neural networks for Class-modeling F. Marini, A. Magrì, R. Bucci Dept. of Chemistry - University of Rome “La Sapienza”

SOMTIME: AN ARTIFICIAL NEURAL NETWORK FOR TOPOLOGICAL AND TEMPORAL CORRELATION FOR SPATIOTEMPORAL PATTERN LEARNING.

Projection methods in chemistry Autumn 2011 By: Atefe Malek.khatabi M. Daszykowski, B. Walczak, D.L. Massart* Chemometrics and Intelligent Laboratory.

Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.

CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.

Soft Computing Colloquium 2 Selection of neural network, Hybrid neural networks.

KOHONEN SELF ORGANISING MAP SEMINAR BY M.V.MAHENDRAN., Reg no: III SEM, M.E., Control And Instrumentation Engg.

Multimodal Interaction Dr. Mike Spann

Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.

Self Organizing Maps (SOM) Unsupervised Learning.

Self Organized Map (SOM)

Artificial Neural Networks Dr. Abdul Basit Siddiqui Assistant Professor FURC.

-Artificial Neural Network- Chapter 9 Self Organization Map(SOM) 朝陽科技大學資訊管理系李麗華教授.

Chapter 9 Neural Network.

Chapter 3 Neural Network Xiu-jun GONG (Ph. D) School of Computer Science and Technology, Tianjin University

A Scalable Self-organizing Map Algorithm for Textual Classification: A Neural Network Approach to Thesaurus Generation Dmitri G. Roussinov Department of.

NEURAL NETWORKS FOR DATA MINING

Applying Neural Networks Michael J. Watts

Institute for Advanced Studies in Basic Sciences – Zanjan Kohonen Artificial Neural Networks in Analytical Chemistry Mahdi Vasighi.

Institute for Advanced Studies in Basic Sciences – Zanjan Mahdi Vasighi Supervised Kohonen Artificial Neural Networks.

Martin Waldseemüller's World Map of 1507 Zanjan. Roberto Todeschini Viviana Consonni Davide Ballabio Andrea Mauri Alberto Manganaro chemometrics molecular.

IE 585 Competitive Network – Learning Vector Quantization & Counterpropagation.

BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.

1 Lecture 6 Neural Network Training. 2 Neural Network Training Network training is basic to establishing the functional relationship between the inputs.

Neural Networks Demystified by Louise Francis Francis Analytics and Actuarial Data Mining, Inc.

Unsupervised Learning Networks 主講人 : 虞台文. Content Introduction Important Unsupervised Learning NNs – Hamming Networks – Kohonen’s Self-Organizing Feature.

Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science Górecki 1,2, Bachniak 1,2, Liput 2, Rauch 1,2, Kitowski 2,3, Pietrzyk 1,2.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A self-organizing map for adaptive processing of structured.

Principal Component Analysis Zelin Jia Shengbin Lin 10/20/2015.

Roberto Todeschini Viviana Consonni Manuela Pavan Andrea Mauri Davide Ballabio Alberto Manganaro chemometrics molecular descriptors QSAR multicriteria.

ViSOM － A Novel Method for Multivariate Data Projection and Structure Visualization Advisor : Dr. Hsu Graduate : Sheng-Hsuan Wang Author : Hujun Yin.

Supervised Learning – Network is presented with the input and the desired output. – Uses a set of inputs for which the desired outputs results / classes.

A Self-organizing Semantic Map for Information Retrieval Xia Lin, Dagobert Soergel, Gary Marchionini presented by Yi-Ting.

1 Neural Networks MUMT 611 Philippe Zaborowski April 2005.

Big data classification using neural network

Principal Component Analysis (PCA)

Self-Organizing Network Model (SOM) Session 11

Applying Neural Networks

Ch 12. Continuous Latent Variables ~ 12

Final Year Project Presentation --- Magic Paint Face

Unsupervised Learning and Neural Networks

Self organizing networks

Unsupervised learning

Lecture 22 Clustering (3).

Neural Networks and Their Application in the Fields of Coporate Finance By Eric Séverin Hanna Viinikainen.

Competitive Networks.

network of simple neuron-like computing elements

Chap 8: Adaptive Networks

Competitive Networks.

Introduction to Cluster Analysis

Review NNs Processing Principles in Neuron / Unit

Artificial Neural Networks

Presentation transcript:

Artificial Neural Networks Davide Ballabio Milano Chemometrics and QSAR Research Group Università Milano - Bicocca Kohonen Maps and Counterpropagation Artificial Neural Networks Toolbox for MATLAB

Kohonen and CPANN Toolbox for MATLAB Kohonen Maps (or Self Organizing Maps) and Counterpropagation Artificial Neural Networks (CPANNs) are two of the most popular Neural Networks (algorithms that simulate the human learning). can handle both supervised and unsupervised problems Kohonen and CP-ANN toolbox is a collection of MATLAB modules freely available via internet: http://michem.disat.unimib.it/chm

Kohonen maps Kohonen Maps (or Self Organizing Maps) can handle unsupervised problems SOM are made of neurons and need time (iterations) to learn to describe the data. The time (number of iterations) and the size (number of neurons) must be defined by the user

Kohonen maps Kohonen Maps (or Self Organizing Maps) can handle unsupervised problems TOP MAP A x1 x2 x3 x4 Kohonen layers p Kohonen layers (p = number of variables)

Kohonen maps Kohonen Maps (or Self Organizing Maps) can handle unsupervised problems Toroidal geometry X

CPANN Counterpropagation Artificial neural Networks can handle supervised problems (in this case classification problems) CPANNs are an evolution of Kohonen Maps

CPANN Class unfolding: transform the class vector in a matrix of zeros and ones Class (n x 1) Multi-y (n x G) 1 2 3 .. G 1 0 0 … … … 0 0 1 0 … … … 0 0 0 1 … … … 0 0 0 0 … … … 1 unfolding

CPANN Counterpropagation Artificial neural Networks can handle supervised problems (in this case classification problems) A x1 x2 x3 x4 TOP MAP Kohonen layers y1 y2 y3 Output layers

CPANN Counterpropagation Artificial neural Networks can handle supervised problems (in this case classification problems): For each sample, for each epoch: 1) Find the winning neuron

CPANN Counterpropagation Artificial neural Networks can handle supervised problems (in this case classification problems): For each sample, for each epoch: 2) Update the Kohonen weights learning rate topological distance

CPANN Counterpropagation Artificial neural Networks can handle supervised problems (in this case classification problems): For each sample, for each epoch: 3) Update the output weights

Kohonen Maps and CPANN In order to better understand how variables can characterize the data, we can do Principal Component Analysis on the Kohonen weights: variables 1. Eigenvalues: decide how many component we can retain PCA W Weights matrix N x p neurons 2. Eigenvectors (loadings) analyse the variables 3. Scores analyse the neurons relate neurons (and samples placed in neurons) and variables in a global way

Kohonen Maps and CPANN toolbox Features of the toolbox: user defined data scaling + automatic range scaling modules for fitting and validating models main available settings: size and epochs (required) boundary condition learning rates can be modified missing values are handled visualize top map with Graphical User Interface visualize PCA on weights with Graphical User Interface The toolbox is based on the algorithm explained in: Zupan J, Novic M, Ruisánchez I. Chemometrics and Intelligent Laboratory Systems (1997) 38 1-23.

Kohonen Maps and CPANN toolbox Example of application on the ITAOILS dataset: 572 olive oil samples, each sample is described by the percentage composition of 8 fatty acids (variables) samples belong to 9 different Italian areas of productions (classes) the final aim of the classification model is the geographical origin determination of the samples. Data reference: M. Forina, C. Armanino, S. Lanteri, E. Tiscornia, in: Food Research and Data Analysis, Classification of olive oils from their fatty acid composition, Applied Science Publishers, London, 1983.

Kohonen Maps and CPANN toolbox Principal Component Analysis for data structure evaluation

Thanks for your attention ! Davide Ballabio Milano Chemometrics and QSAR Research Group Department of Environmental Sciences Università Milano – Bicocca You can download the Kohonen and CP-ANN toolbox 1.0 here: http://michem.disat.unimib.it/chm Version 2.0 will be available soon… Paper in preparation, to be submitted to Chemometrics and Intelligent Laboratory Systems Thanks for your attention !