Biological Inspiration for Artificial Neural Networks Nick Mascola.

Slides:



Advertisements
Similar presentations
NEU Neural Computing MSc Natural Computation Department of Computer Science University of York.
Advertisements

NEURAL NETWORKS Biological analogy
Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
1 Image Classification MSc Image Processing Assignment March 2003.
G53MLE | Machine Learning | Dr Guoping Qiu
Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
Navneet Goyal, BITS-Pilani Perceptrons. Labeled data is called Linearly Separable Data (LSD) if there is a linear decision boundary separating the classes.
2 1 Discrete Markov Processes (Markov Chains) 3 1 First-Order Markov Models.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Pattern Recognition 9/23/2008 Instructor: Wen-Hung Liao, Ph.D.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Introduction to Neural Network Justin Jansen December 9 th 2002.
Introduction to Neural Networks Simon Durrant Quantitative Methods December 15th.
Power Systems Application of Artificial Neural Networks. (ANN)  Introduction  Brief history.  Structure  How they work  Sample Simulations. (EasyNN)
Presenting: Itai Avron Supervisor: Chen Koren Characterization Presentation Spring 2005 Implementation of Artificial Intelligence System on FPGA.
IT 691 Final Presentation Pace University Created by: Robert M Gust Mark Lee Samir Hessami Mark Lee Samir Hessami.
Artificial Neural Networks KONG DA, XUEYU LEI & PAUL MCKAY.
Neural Networks Lab 5. What Is Neural Networks? Neural networks are composed of simple elements( Neurons) operating in parallel. Neural networks are composed.
Hub Queue Size Analyzer Implementing Neural Networks in practice.
SE367 Project Final Presentation By: Sujith Thomas Parimi Krishna Chaitanya In charge:- Prof Amitabha Mukerjee.
CEN 592 PATTERN RECOGNITION Spring Term CEN 592 PATTERN RECOGNITION Spring Term DEPARTMENT of INFORMATION TECHNOLOGIES Assoc. Prof.
Introduction Mohammad Beigi Department of Biomedical Engineering Isfahan University
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
Neural Networks.
Machine Learning. Learning agent Any other agent.
1 st Neural Network: AND function Threshold(Y) = 2 X1 Y X Y.
Artificial Neural Network Theory and Application Ashish Venugopal Sriram Gollapalli Ulas Bardak.
Parallel Artificial Neural Networks Ian Wesley-Smith Frameworks Division Center for Computation and Technology Louisiana State University
An Example of Course Project Face Identification.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
Explorations in Neural Networks Tianhui Cai Period 3.
ANNs (Artificial Neural Networks). THE PERCEPTRON.
Self organizing maps 1 iCSC2014, Juan López González, University of Oviedo Self organizing maps A visualization technique with data dimension reduction.
NEURAL NETWORKS FOR DATA MINING
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
An informal description of artificial neural networks John MacCormick.
Yang, Luyu.  Postal service for sorting mails by the postal code written on the envelop  Bank system for processing checks by reading the amount of.
Neural Networks Dr. Thompson March 19, Artificial Intelligence Robotics Computer Vision & Speech Recognition Expert Systems Pattern Recognition.
Different Features. Glasses vs. No Glasses Beard vs. No Beard.
A note about gradient descent: Consider the function f(x)=(x-x 0 ) 2 Its derivative is: By gradient descent. x0x0 + -
1 Machine Learning 1.Where does machine learning fit in computer science? 2.What is machine learning? 3.Where can machine learning be applied? 4.Should.
An Artificial Neural Network Approach to Surface Waviness Prediction in Surface Finishing Process by Chi Ngo ECE/ME 539 Class Project.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
Lecture notes for Stat 231: Pattern Recognition and Machine Learning 1. Stat 231. A.L. Yuille. Fall Perceptron Rule and Convergence Proof Capacity.
CPE542: Pattern Recognition Course Introduction Dr. Gheith Abandah د. غيث علي عبندة.
An ANN Approach to Identify if Driver is Wearing Safety Belts Hanwen Chen 12/9/2013.
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Web-Mining Agents Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Tanya Braun (Übungen)
Neural Networks Si Wu Dept. of Informatics PEV III 5c7 Spring 2008.
Pattern Recognition NTUEE 高奕豪 2005/4/14. Outline Introduction Definition, Examples, Related Fields, System, and Design Approaches Bayesian, Hidden Markov.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
Feasibility of Using Machine Learning Algorithms to Determine Future Price Points of Stocks By: Alexander Dumont.
Intro. ANN & Fuzzy Systems Lecture 3 Basic Definitions of ANN.
INTRODUCTION TO NEURAL NETWORKS 2 A new sort of computer What are (everyday) computer systems good at... and not so good at? Good at..Not so good at..
Applying Deep Neural Network to Enhance EMPI Searching
Recognition of biological cells – the beginning of study
Schizophrenia Classification Using
Self organizing networks
FUNDAMENTAL CONCEPT OF ARTIFICIAL NETWORKS
Artificial Neural Networks
دانشگاه صنعتی امیرکبیر Instructor : Saeed Shiry & Bishop Ch. 1
شبکه عصبی تنظیم: بهروز نصرالهی-فریده امدادی استاد محترم: سرکار خانم کریمی دانشگاه آزاد اسلامی واحد شهرری.
Face Recognition with Neural Networks
Neural Networks and Deep Learning
CRCV REU 2019 Aaron Honculada.
Presentation transcript:

Biological Inspiration for Artificial Neural Networks Nick Mascola

Artificial Neuron Output=f(Σ(Weights*Inputs)) Basic Structure

Several Layered Network A Typical Network Organizes these Neurons into layers that feed into each other sequentially

Typical Transfer Functions

Recall that Over Time:

Finite Amount of Resources

Implementation  void distributeweightpoints(Connections con){  vector list = con.weights;  int totalpoints=con.points;  double total=weightsummation(list);  double temp;  for(unsigned int i=0; i<con.weights.size(); i++){  temp=list[i].value/total;  if(temp<1/totalpoints){  con.weights[i]=0;}  else{  con.weights[i]=temp;}  }

Long Term Potentiation SpecificityCooperativity Features Similar to ANN Functionality:

Distinct Feature Associativity

Possible Solution

…Or More Generally

References   Matlab Neural Network Toolbox  Pattern Classification (2nd ed) by Richard O. Duda, Peter E. Hart and David G. Stork  Pattern Recognition and Machine Learning. Christopher M. Bishop   The long-term potential of LTP Robert C.Malenka