Can brains generate random numbers? joint work with Mark Goldsmith.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
Advertisements

Learning in Neural and Belief Networks - Feed Forward Neural Network 2001 년 3 월 28 일 안순길.
Introduction to Neural Networks Computing
Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
 What Do Neurons Have to Do With Psychology?  How Do Neurons Communicate?  How Can Neurons Produce Complex Processes?  How is the Nervous System.
Canada Research Chairs In 2000, the Government of Canada created a permanent program to establish 2000 research professorships—Canada Research Chairs—in.
B.Macukow 1 Lecture 3 Neural Networks. B.Macukow 2 Principles to which the nervous system works.
ILAE Commission for Classification and Terminology.
Cognitive Computing…. Computational Neuroscience Jerome Swartz The Swartz Foundation May 10, 2006.
1 Introduction to Bio-Inspired Models During the last three decades, several efficient machine learning tools have been inspired in biology and nature:
Neural Networks.
Real Neurons for Engineers (Lecture 2) Harry R. Erwin, PhD COMM2E University of Sunderland.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
How does the mind process all the information it receives?
Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?
The McCulloch-Pitts Neuron. Characteristics The activation of a McCulloch Pitts neuron is binary. Neurons are connected by directed weighted paths. A.
Eduardo Garcia, MD Assistant Clinical Professor
Seizure Disorder.
Pathophysiology of Epilepsy Dr Taha Sadig Ahmed. Definition of seizure and Epilepsy Seizures are symptoms of a disturbance in brain function, which can.
Definition The epilepsies are a group of disorders characterized by chronic recurrent paroxysmal changes in neurologic function caused by abnormalities.
Artificial neural networks:
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
Neural Networks Applications Versatile learners that can be applied to nearly any learning task: classification numeric prediction unsupervised pattern.
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
Epilepsy Lecture Neuro Course 4th year. Objectives – To Review: What the term epilepsy means Basic mechanisms of epilepsy How seizures and epilepsies.
Establishing the Equivalence between Recurrent Neural Networks and Turing Machines. Ritesh Kumar Sinha(02d05005) Kumar Gaurav Bijay( )
Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos VC 14/15 – TP19 Neural Networks & SVMs Miguel Tavares.
1 Machine Learning The Perceptron. 2 Heuristic Search Knowledge Based Systems (KBS) Genetic Algorithms (GAs)
1 Financial Informatics –XIV: Basic Principles 1 Khurshid Ahmad, Professor of Computer Science, Department of Computer Science Trinity College, Dublin-2,
 Diagram of a Neuron  The Simple Perceptron  Multilayer Neural Network  What is Hidden Layer?  Why do we Need a Hidden Layer?  How do Multilayer.
Evolutionary Approach to Investigations of Cognitive Systems Vladimir Red ’ ko a), Anton Koval ’ b) a) Scientific Research Institute for System Analysis,
PSY105 Neural Networks 1/5 1. “Patterns emerge”. π.
Logical Calculus of Ideas Immanent in Nervous Activity McCulloch and Pitts Deep Learning Fatima Al-Raisi.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
Canada Research Chairs In 2000, the Government of Canada created a permanent program to establish 2000 research professorships—Canada Research Chairs—in.
PSY105 Neural Networks 2/5 2. “A universe of numbers”
Neural Networks and Fuzzy Systems Hopfield Network A feedback neural network has feedback loops from its outputs to its inputs. The presence of such loops.
Activity 2-1: The Game of Life
Introduction to Lattice Simulations. Cellular Automata What are Cellular Automata or CA? A cellular automata is a discrete model used to study a range.
Parallel Programming 0024 Spring Semester 2010 May 6, 2010.
Review Recursion Call Stack. Two-dimensional Arrays Visualized as a grid int[][] grays = {{0, 20, 40}, {60, 80, 100}, {120, 140, 160}, {180, 200, 220}};
Figure 2.6 Synapses (Part 1). EM of synapses on cell body.
Differential Diagnosis. Salient Features Often observed to be absent minded Brief episodes of blank staring and inattention Eye blinking Reflex scratching.
Neurons: The Building Blocks of the Nervous System
 Episodes of abnormal sudden, excessive, uncontrolled electrical discharge of neurons within the brain  May result in alteration in consciousness,
ICS 586: Neural Networks Dr. Lahouari Ghouti Information & Computer Science Department.
Pathophysiology of Epilepsy
© SEMINAR ON ARTIFICIAL NEURAL NETWORK AND ITS APPLICATIONS By Mr. Susant Kumar Behera Mrs. I. Vijaya.
CS 478 – Tools for Machine Learning and Data Mining Perceptron.
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
A neuron is the functioning cell unit in the nervous system that is also known as a nerve cell. Neurons are responsible for sending impulse messages to.
Artificial Intelligence Methods Neural Networks Lecture 1 Rakesh K. Bissoondeeal Rakesh K.
Spiking Neural Networks Banafsheh Rekabdar. Biological Neuron: The Elementary Processing Unit of the Brain.
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Neural Networks Si Wu Dept. of Informatics PEV III 5c7 Spring 2008.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
Introduction to Connectionism Jaap Murre Universiteit van Amsterdam en Universiteit Utrecht
Neurons FG4&feature=related.
ANTICONVULSANTS/ ANTISEIZURE Agents EPILEPSY: Disorder of Brain function (a disease) characterized by periodic and unpredictable occurrence of seizures.
Introduction to Neural Network Session 1 Course: T0293 – NEURO COMPUTING Year: 2013.
Pathophysiology of Epilepsy
Neural Networks.
CONVULSION & EPILEPSY Dr. Kifah Alubaidy.
Cognitive Computing…. Computational Neuroscience
One of the oldest Known conditions
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Introduction to Neural Network
Machine Learning.
Presentation transcript:

Can brains generate random numbers? joint work with Mark Goldsmith

Canada Research Chairs In 2000, the Government of Canada created a permanent program to establish 2000 research professorships—Canada Research Chairs—in eligible degree-granting institutions across the country. Communication Guidelines for Chairholders In all professional publications, presentations and conferences, we ask you to identify yourself as a Canada Research Chair and acknowledge the contribution of the program to your research.

seizure ictal periodpre-ictal period post-ictal period

I. PARTIAL (FOCAL, LOCAL) SEIZURES II. GENERALIZED SEIZURES (CONVULSIVE OR NOT) A. Simple partial seizures B. Complex partial seizures C. Simple partial seizures evolving to secondarily generalized seizures A. Absence seizures B. Myoclonic seizures C. Clonic seizures D. Tonic seizures E. Tonic-clonic seizures F. Atonic seizures 1981 scheme for classification of epileptic seizures (International League Against Epilepsy)

pre-ictal period post-ictal period irregular disorderly erratic chaotic random ictal period rhytmic organized synchronized

Digression: Conway’s Game of Life 1. Any live cell with fewer than two live neighbours dies, as if caused by under-population. 2. Any live cell with more than three live neighbours dies, as if by overcrowding. 3. Any dead cell with exactly three live neighbours becomes a live cell, as if by reproduction. 4. All other cells remain as they are. 2 1 x

Nithum Thain Is there an initial conguration that causes Conway's Game of Life to evolve in a way resembling a partial seizure, proceeding from an erratic flutter of apparently unpredictable patterns to sustained rhythmic changes that would begin in a small part of the grid and gradually spread, synchronized, over a larger area before subsiding to give way to the initial erratic mode? Seminar at Concordia, July 2009

Walter Harry Pitts, Jr. (1923 – 1969) Warren Sturgis McCulloch (1898 – 1969) Bulletin of Mathematical Biophysics 5 (1943) A logical calculus of the ideas immanent in nervous activity,

synapse axon soma (and its dendrites) neuron McCulloch-Pitts neuron

synaptic weights:

Is there an initial conguration that causes Conway's Game of Life to evolve in a way resembling a partial seizure, proceeding from an erratic flutter of apparently unpredictable patterns to sustained rhythmic changes that would begin in a small part of the grid and gradually spread, synchronized, over a larger area before subsiding to give way to the initial erratic mode? Nithum Thain’s question: Is there a McCulloch-Pitts network that evolves in a way resembling a partial seizure, proceeding from an erratic flutter of apparently unpredictable patterns to sustained rhythmic changes that would begin in a small part of the grid and gradually spread, synchronized, over a larger area before subsiding to give way to the initial erratic mode? Our variation: Is there a McCulloch-Pitts network that evolves in a way resembling the pre-ictal period of a partial seizure, an erratic flutter of apparently unpredictable patterns? An easier question: First step towards the easier question: Are there a McCulloch-Pitts networks with n neurons and period 2 ? n

Theorem: For every positive integer n there is a McCulloch-Pitts network with n neurons and period 2. n Related previous work: Any other references ??? P.C. McGuire, H. Bohr, J.W. Clark, R. Haschke, C.L. Pershing, J. Rafelski, Threshold disorder as a source of diverse and complex behavior in random nets, Neural Networks 15 (2002), R. Legenstein, W. Maass, What makes a dynamical system computationally powerful? In: S. Haykin, J.C. Principe, T. Sejnowski, J. McWhirter (Eds.), New Directions in Statistical Signal Processing: From Systems to Brain, pp , The MIT Press, Cambridge, 2005.

+1 synaptic weights: +1

Trajectory of our 4-neuron McCulloch-Pitts network: Trajectory of another 4-neuron McCulloch-Pitts network: the last bit flips only twice! the second bit flips 10 times; all other bits flip 6 times

2 with 2 neurons; 1 isomorphism class 48 with 3 neurons; 2 isomorphism classes 9984 with 4 neurons; 56 isomorphism classes The number of McCulloch-Pitts networks with n neurons and period 2 : n

Trajectory of our 4-neuron McCulloch-Pitts network as a generator of uniform random numbers in the interval [0,1): buckets [0,0.5) and [0.5,1) the same bucket is never repeated three times in a row the last bit flips only twice but the last bit is negligible: it contributes only to the total

Batteries of statistical tests for sequences of uniform random numbers in the interval [0,1). Is there a McCulloch-Pitts random number generator which passes all ten tests of SmallCrush ? P. L'Ecuyer, R. Simard, TestU01: A C library for empirical testing of random number generators, ACM Transactions on Mathematical Software, 33 (2007), Article 22, 40 pages. The least stringent of these batteries: SmallCrush