Global Visualization of Neural Dynamics

Slides:



Advertisements
Similar presentations
Visualization of the hidden node activities or hidden secrets of neural networks. Włodzisław Duch Department of Informatics Nicolaus Copernicus University,
Advertisements

Introduction to Support Vector Machines (SVM)
ECG Signal processing (2)
Feature Selection as Relevant Information Encoding Naftali Tishby School of Computer Science and Engineering The Hebrew University, Jerusalem, Israel NIPS.
Universal Learning Machines (ULM) Włodzisław Duch and Tomasz Maszczyk Department of Informatics, Nicolaus Copernicus University, Toruń, Poland ICONIP 2009,
Electrophysiology. Electroencephalography Electrical potential is usually measured at many sites on the head surface More is sometimes better.
Heterogeneous Forests of Decision Trees Krzysztof Grąbczewski & Włodzisław Duch Department of Informatics, Nicholas Copernicus University, Torun, Poland.
Subdural Grid Intracranial electrodes typically cannot be used in human studies It is possible to record from the cortical surface Subdural grid on surface.
Computational model of the brain stem functions Włodzisław Duch, Krzysztof Dobosz, Grzegorz Osiński Department of Informatics/Physics Nicolaus Copernicus.
RBF Neural Networks x x1 Examples inside circles 1 and 2 are of class +, examples outside both circles are of class – What NN does.
K-separability Włodzisław Duch Department of Informatics Nicolaus Copernicus University, Torun, Poland School of Computer Engineering, Nanyang Technological.
Fuzzy rule-based system derived from similarity to prototypes Włodzisław Duch Department of Informatics, Nicolaus Copernicus University, Poland School.
Almost Random Projection Machine with Margin Maximization and Kernel Features Tomasz Maszczyk and Włodzisław Duch Department of Informatics, Nicolaus Copernicus.
Coloring black boxes: visualization of neural network decisions Włodzisław Duch School of Computer Engineering, Nanyang Technological University, Singapore,
Support Vector Neural Training Włodzisław Duch Department of Informatics Nicolaus Copernicus University, Toruń, Poland School of Computer Engineering,
Attractors in Neurodynamical Systems Włodzisław Duch, Krzysztof Dobosz Department of Informatics Nicolaus Copernicus University, Toruń, Poland Google:
An Illustrative Example
Dimension reduction : PCA and Clustering Christopher Workman Center for Biological Sequence Analysis DTU.
Support Feature Machine for DNA microarray data Tomasz Maszczyk and Włodzisław Duch Department of Informatics, Nicolaus Copernicus University, Toruń, Poland.
CHAPTER 11 Back-Propagation Ming-Feng Yeh.
CS Instance Based Learning1 Instance Based Learning.
Aula 4 Radial Basis Function Networks
Introduction to Neural Networks Kenji Nakayama Kanazawa University, JAPAN 適応システム理論 ガイダンス.
Radial-Basis Function Networks
Soft Computing Colloquium 2 Selection of neural network, Hybrid neural networks.
Fuzzy Symbolic Dynamics for Neurodynamical Systems Krzysztof Dobosz 1 and Włodzisław Duch 2 1 Faculty of Mathematics and Computer Science, 2 Department.
Polynomial Chaos For Dynamical Systems Anatoly Zlotnik, Case Western Reserve University Mohamed Jardak, Florida State University.
CZ5225: Modeling and Simulation in Biology Lecture 5: Clustering Analysis for Microarray Data III Prof. Chen Yu Zong Tel:
Artificial Neural Networks Shreekanth Mandayam Robi Polikar …… …... … net k   
Self organizing maps 1 iCSC2014, Juan López González, University of Oviedo Self organizing maps A visualization technique with data dimension reduction.
Matlab Matlab Sigmoid Sigmoid Perceptron Perceptron Linear Linear Training Training Small, Round Blue-Cell Tumor Classification Example Small, Round Blue-Cell.
IJCNN 2012 Competition: Classification of Psychiatric Problems Based on Saccades Włodzisław Duch 1,2, Tomasz Piotrowski 1 and Edward Gorzelańczyk 3 1 Department.
Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos VC 14/15 – TP19 Neural Networks & SVMs Miguel Tavares.
Time Series Data Analysis - I Yaji Sripada. Dept. of Computing Science, University of Aberdeen2 In this lecture you learn What are Time Series? How to.
MATLAB.
Methodology of Simulations n CS/PY 399 Lecture Presentation # 19 n February 21, 2001 n Mount Union College.
So Far……  Clustering basics, necessity for clustering, Usage in various fields : engineering and industrial fields  Properties : hierarchical, flat,
Towards CI Foundations Włodzisław Duch Department of Informatics, Nicolaus Copernicus University, Toruń, Poland Google: W. Duch WCCI’08 Panel Discussion.
Analysis of Movement Related EEG Signal by Time Dependent Fractal Dimension and Neural Network for Brain Computer Interface NI NI SOE (D3) Fractal and.
Akram Bitar and Larry Manevitz Department of Computer Science
Neural Nets: Something you can use and something to think about Cris Koutsougeras What are Neural Nets What are they good for Pointers to some models and.
Computational Intelligence: Methods and Applications Lecture 8 Projection Pursuit & Independent Component Analysis Włodzisław Duch Dept. of Informatics,
Are worms more complex than humans? Rodrigo Quian Quiroga Sloan-Swartz Center for Theoretical Neurobiology. Caltech.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Automated Interpretation of EEGs: Integrating Temporal and Spectral Modeling Christian Ward, Dr. Iyad Obeid and Dr. Joseph Picone Neural Engineering Data.
Towards Science of DM Włodzisław Duch Department of Informatics, Nicolaus Copernicus University, Toruń, Poland Google: W. Duch WCCI’08 Panel Discussion.
Review – Objectives Transitioning 4-5 Spikes can be detected from many neurons near the electrode tip. What are some ways to determine which spikes belong.
References: [1] E. Tognoli, J. Lagarde, G.C. DeGuzman, J.A.S. Kelso (2006). The phi complex as a neuromarker of human social coordination. PNAS 104:
Neural Networks for EMC Modeling of Airplanes Vlastimil Koudelka Department of Radio Electronics FEKT BUT Metz,
IEEE AI - BASED POWER SYSTEM TRANSIENT SECURITY ASSESSMENT Dr. Hossam Talaat Dept. of Electrical Power & Machines Faculty of Engineering - Ain Shams.
Exploring the Landscape of Brain States Włodzisław Duch & Krzysztof Dobosz (Nicolaus Copernicus University, Toruń, Poland), Aleksandar Jovanovic (University.
Electrophysiology. Neurons are Electrical Remember that Neurons have electrically charged membranes they also rapidly discharge and recharge those membranes.
Big data classification using neural network
Support Feature Machine for DNA microarray data
Deep Learning Amin Sobhani.
Learning in Neural Networks
A critical review of RNN for sequence learning Zachary C
Projection of network outputs
Neuro-Computing Lecture 4 Radial Basis Function Network
Fuzzy rule-based system derived from similarity to prototypes
The use of Neural Networks to schedule flow-shop with dynamic job arrival ‘A Multi-Neural Network Learning for lot Sizing and Sequencing on a Flow-Shop’
Visualization of the hidden node activities or hidden secrets of neural networks. Włodzisław Duch Department of Informatics Nicolaus Copernicus University,
Dynamic Coding for Cognitive Control in Prefrontal Cortex
Visualization of the hidden node activities or hidden secrets of neural networks. Włodzisław Duch Department of Informatics Nicolaus Copernicus University,
Computational model of the brain stem functions
Machine Learning for Visual Scene Classification with EEG Data
Stefano Panzeri, Jakob H. Macke, Joachim Gross, Christoph Kayser 
Attractors in Neurodynamical Systems
Computational Intelligence: Methods and Applications
Akram Bitar and Larry Manevitz Department of Computer Science
Presentation transcript:

Global Visualization of Neural Dynamics Krzysztof Dobosz, Włodzisław Duch Department of Informatics Nicolaus Copernicus University, Toruń, Poland Google: W. Duch Neuromath, Jena, April 2008

Example of a pathological signal analysis Brain Spirography Example of a pathological signal analysis

Motivation Analysis of multi-channel, non-stationary, time series data. Neural respiratory rhythm generator (RRG): hundreds of neurons, what is the system doing? Information is in the trajectories, how to see them? Component-based analysis. Time-frequency analysis. Recurrence plots. Fuzzy Symbolic Dynamics (FSD), visualize + understand. Understand FSD mappings using model data. First look at RRG data. First look at real EEG data.

Fuzzy Symbolic Dynamics (FSD) Trajectory of dynamical system (neural activities, av. rates): 1. Standardize data. 2. Find cluster centers (e.g. by k-means algorithm): m1, m2 ... 3. Use non-linear mapping to reduce dimensionality: Localized probe function: sharp indicator functions => symbolic dynamics; soft membership functions => fuzzy symbolic dynamics.

Model, radial/linear sources Sources generate waves on a grid Flat wave Radial wave Relatively simple patterns arise, but slow sampling shows numerical artifacts. Ex: one and two radial waves.

Respiratory Rhythm Generator 3 layers, spiking neurons, output layer with 50 neurons

Sensitive differences?

FSD development Optimization of parameters of probe functions to see more structure from the point of view of relevant task. Learning: supervised clustering, projection pursuit based on quality of clusters => projection on interesting directions. Measures to characterize dynamics: position and size of basins of attractors, transition probabilities, types of oscillations around each attractor. Visualization in 3D and higher (lattice projections etc). Tests on model data and on the real data.

Complex logic What is needed to understand data with complex logic? cluster non-local areas in the X space, use projections W.X capture local clusters after transformation, use G(W.X-q) SVMs fail because the number of directions W that should be considered grows exponentially with the size of the problem n. What will solve it? A class of constructive neural network solution with G(W.X-q) functions with special training algorithms. Maximize the leave-one-out error after projection: take localized function G, count in a soft way cases from the same class as X. Projection may be done directly to 1D, 2D or higher. Examples: parity, monks.

Parity n=9 Pursuite of the best “point of view” using simple gradient learning; cluster quality index shown below. No problem with large variance noise in 6 channels.

EEG example Data from two electrodes, BCI IIIa

Alcoholics vs. controls Colors: from blue at the beginning of the sequence, to red at the end. Left: normal subject; right: alcoholic; task: two matched stimuli, 64 channels (3 after PP), 256 Hz sampling, 1 sec, 10 trials; single st alc.

What can we learn? FSD shows global mapping of the whole trajectory. Pairs of probe functions show different aspects. Where is the trajectory most of the time? Low/high energy synchronization. Supervised clustering for characterization of the basins of attractors, transition probabilities, types of oscillations around each attractor. Clear differences between different conditions, perhaps useful in classification and diagnosis, if standardized. More tests on real data needed.

Future plans More complex models to understand how to interpret the FSD plots. Effects of various component-based transformations. Projection pursuit is important, raw signals quite messy. Identifying interesting segments: projection pursuit in space and time. Learning of parameters of probe functions that show interesting structures. Analysis of types of behavior using the models of spiking networks (RRG and other models). BCI applications? Many other things …

Thank you for lending your ears ... Google: W. Duch => Papers & presentations See also http:www.e-nns.org