Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 1 CS564 - Brain Theory and Artificial Intelligence University of Southern California.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

Lect.3 Modeling in The Time Domain Basil Hamed
DYNAMICS OF RANDOM BOOLEAN NETWORKS James F. Lynch Clarkson University.
Work & Energy Principles
Work & Energy Principles
5/16/2015Intelligent Systems and Soft Computing1 Introduction Introduction Hebbian learning Hebbian learning Generalised Hebbian learning algorithm Generalised.
Artificial neural networks:
Introduction to Statics
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
ME 746 Spring Dynamic Models Differential Equations in State-Variable Form.
Dynamic Systems Thanks to Derek Harter for having notes on the web. Also see, Port & Van Gelder and Beltrami.
Neural Networks Marco Loog.
Kinematics of Particles Lecture II. Subjects Covered in Kinematics of Particles Rectilinear motion Curvilinear motion Rectangular coords n-t coords Polar.
Teknik kendali priyatmadi.
MECH 221 FLUID MECHANICS (Fall 06/07) Chapter 3: FLUID IN MOTIONS
November 21, 2012Introduction to Artificial Intelligence Lecture 16: Neural Network Paradigms III 1 Learning in the BPN Gradients of two-dimensional functions:
Objectives Identify the conditions of simple harmonic motion.
Room 2032 China Canada Winnipeg Manitoba.
WORK AND ENERGY PRINCIPLE. Work and Kinetic Energy In the previous article we applied Newton’s second law to various problems of particle motion to establish.
MA4248 Weeks 1-3. Topics Coordinate Systems, Kinematics, Newton’s Laws, Inertial Mass, Force, Momentum, Energy, Harmonic Oscillations (Springs and Pendulums)
1 System physiology – on the design Petr Marsalek Class: Advances in biomedical engineering Graduate course, biomedical engineering.
Systems of Particles.
JJ205 ENGINEERING MECHANICS COURSE LEARNING OUTCOMES : Upon completion of this course, students should be able to: CLO 1. apply the principles of statics.
Ch 9.5: Predator-Prey Systems In Section 9.4 we discussed a model of two species that interact by competing for a common food supply or other natural resource.
Ch 9.8: Chaos and Strange Attractors: The Lorenz Equations
Daily Challenge, 10/2 Give 3 examples of motions that are periodic, or repeating.
Control 1 Keypoints: The control problem Forward models: –Geometric –Kinetic –Dynamic Process characteristics for a simple linear dynamic system.
Dynamical Systems Model of the Simple Genetic Algorithm Introduction to Michael Vose’s Theory Rafal Kicinger Summer Lecture Series 2002.
Introduction to Dynamics. Dynamics is that branch of mechanics which deals with the motion of bodies under the action of forces. Dynamics has two distinct.
20/10/2009 IVR Herrmann IVR:Control Theory OVERVIEW Control problems Kinematics Examples of control in a physical system A simple approach to kinematic.
 Law 1: › Every object in a state of uniform motion tends to remain in that state of motion unless an external force is applied to it.  Law 2 : › The.
Chapter 11 Preview Objectives Hooke’s Law Sample Problem
Dr. Tamer Samy Gaafar.   Teaching Assistant:- Eng. Hamdy Soltan.
Professor Walter W. Olson Department of Mechanical, Industrial and Manufacturing Engineering University of Toledo System Solutions y(t) t +++++… 11 22.
Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 19. Systems Concepts 1 Michael Arbib: CS564 - Brain Theory and.
1 Dynamics Differential equation relating input torques and forces to the positions (angles) and their derivatives. Like force = mass times acceleration.
Lecture 7: State-Space Modeling 1.Introduction to state-space modeling Definitions How it relates to other modeling formalisms 2.State-space examples 3.Transforming.
Professor Walter W. Olson Department of Mechanical, Industrial and Manufacturing Engineering University of Toledo Linear Systems m k u x m k u x Fixed.
Control and Synchronization of Chaos Li-Qun Chen Department of Mechanics, Shanghai University Shanghai Institute of Applied Mathematics and Mechanics Shanghai.
Chapter 14 Systems of Particles.
Quantum New way of looking at our world. Classical vs Quantum Typically a student develops an intuition about how the world works using classical mechanics.
Chapter 11 Preview Objectives Hooke’s Law Sample Problem
Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 1 L. Itti: CS564 - Brain Theory and Artificial Intelligence University of Southern.
Signals and Systems Analysis NET 351 Instructor: Dr. Amer El-Khairy د. عامر الخيري.
Spring 2002 Lecture #18 Dr. Jaehoon Yu 1.Simple Harmonic Motion 2.Energy of the Simple Harmonic Oscillator 3.The Pendulum Today’s Homework Assignment.
Introduction to Dynamics. Dynamics is that branch of mechanics which deals with the motion of bodies under the action of forces. Dynamics has two distinct.
State Equations BIOE Processes A process transforms input to output States are variables internal to the process that determine how this transformation.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
PHY 151: Lecture Motion of an Object attached to a Spring 12.2 Particle in Simple Harmonic Motion 12.3 Energy of the Simple Harmonic Oscillator.
Ch 7. Computing with Population Coding Summarized by Kim, Kwonill Bayesian Brain: Probabilistic Approaches to Neural Coding P. Latham & A. Pouget.
CS621: Artificial Intelligence Lecture 10: Perceptrons introduction Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
MESB374 System Modeling and Analysis
Modeling and Simulation Dr. Mohammad Kilani
What is statics? Lecture 1
Advanced Control Systems (ACS)
State Space Representation
OSE801 Engineering System Identification Spring 2010
Linear Control Systems
Modern Control Systems (MCS)
One- and Two-Dimensional Flows
Autonomous Cyber-Physical Systems: Dynamical Systems
Digital Control Systems (DCS)
State Space Analysis UNIT-V.
Stability Analysis of Linear Systems
Physics 111: Mechanics Lecture 2
Presentation transcript:

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 1 CS564 - Brain Theory and Artificial Intelligence University of Southern California Lecture 14. Systems Concepts Reading Assignment: TMB2 Section 3.1 Note: To prepare for Lecture 15 make sure that you have mastered the basic ideas on eigenvectors and eigenvalues that are briefly reviewed in TMB2 Section 3.1.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 2 A System is Defined by Five Elements The set of inputs The set of outputs (These involve a choice by the modeler) The set of states: those internal variables of the system — which may or may not also be output variables — which determine the relationship between input and output. state = the system's "internal residue of the past" The state-transition function : how the state will change when the system is provided with inputs. The output function : what output the system will yield with a given input when in a given state.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 3 Finite Automata and Identification Theory Formally, we describe an automaton by the sets X, Y and Q of inputs, outputs and states, respectively, together with the next-state function  : Q x X  Q and the output function  : Q  Y. If the automaton in state q receives input x, next state will be  (q, x) next output will be  (q).

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 4 External versus Internal Descriptions We distinguish between a system characterized by an internal structure or process, & a system characterized by an external pattern of behavior X*: the set of strings of inputs (input sequences) wx:following string w by the input x Extend  to a map  *: Q x X*  Q such that  *(q, w) is the state obtained on starting in state q and reading in input string w. q ———————————  wx ——————   *(q, wx) q ———— w —————   *(q, w) — x  (  *(q, w), x) If M is started in state q and fed input sequence w, it will emit a sequence of outputs whose last element M q (w) is just  (  *(q, w)).

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 5 The Identification Problem It is thus straightforward to go from an internal description to the corresponding external description. The reverse process is a special case of the identification problem. (. (See TMB Sec. 3.4.) For an introduction to the formal theory, see Section 3.2 of Brains, Machines and Mathematics, Second Edition. Exact computation of the minimal automaton consistent with noise-free input-output data. The theory of adaptive neural nets provides one approach to approximate identification.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 6 From Newton to Dynamic Systems Newton's mechanics describes the behavior of a system on a continuous time scale. Rather than use the present state and input to predict the next state, the present state and input determine the rate at which the state changes. Newton's third law says that the force F applied to the system equals the mass m times the acceleration a. F = ma Position x(t) Velocity v(t) = Acceleration a(t) = x

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 7 Newtonian Systems According to Newton's laws, the state of the system is given by the position and velocity of the particles of the system. We now use u(t) for the input = force; and y(t) (equals x(t)) for the output = position. Note: In general, input, output, and state are more general than in the following, simple example.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 8 State Dynamics With only one particle, the state is the 2-dimensional vector q(t) = Then yielding the single vector equation The output is given by y(t) = x(t) = The point of the exercise: Think of the state vector as a single point in a multi-dimensional space.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 9 Linear Systems This is an example of a Linear System: = A q + B u y = C q where the state q, input u, and output y are vectors (not necessarily 2- dimensional) and A, B, and C are linear operators (i.e., can be represented as matrices). Generally a physical system can be expressed by State Change: q(t) = f(q(t), u(t)) Output: y(t) = g(q(t)) where f and g are general (i.e., possibly nonlinear) functions For a network of leaky integrator neurons: the state m i (t) = arrays of membrane potentials of neurons, the output M(t) =  m i (t)) = the firing rates of output neurons, obtained by selecting the corresponding membrane potentials and passing them through the appropriate sigmoid functions.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 10 Attractors 1. The state vector comes to rest, i.e. the unit activations stop changing. This is called a fixed point. For given input data, the region of initial states which settles into a fixed point is called its basin of attraction. 2. The state vector settles into a periodic motion, called a limit cycle. For all recurrent networks of interest (i.e., neural networks comprised of leaky integrator neurons, and containing loops), given initial state and fixed input, there are just three possibilities for the asymptotic state:

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 11 Strange attractors 3. Strange attractors describe such complex paths through the state space that, although the system is deterministic, a path which approaches the strange attractor gives every appearance of being random. Two copies of the system which initially have nearly identical states will grow more and more dissimilar as time passes. Such a trajectory has become the accepted mathematical model of chaos,and is used to describe a number of physical phenomena such as the onset of turbulence in weather.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 12 Stability The study of stability of an equilibrium is concerned with the issue of whether or not a system will return to the equilibrium in the face of slight disturbances: A is an unstable equilibrium B is a neutral equilibrium C is a stable equilibrium, since small displacements will tend to disappear over time. Note: in a nonlinear system, a large displacement can move the ball from the basin of attraction of one equilibrium to another.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 13 General Feedback Setup

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 14 Negative Feedback Controller (Servomechanism)

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 15 Judging the Stretching of an Elastic Band

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 16 Using Spindles to Tell  -Neurons if a Muscle Needs to Contract What’s missing in this Scheme?

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 17 Using  -Neurons to Set the Resting Length of the Muscle   

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 18

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 19

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 20 Discrete-Activation Feedforward “Cortex” “Spinal Cord”

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 21 “Ballistic” Correction then Feedback This long latency reflex was noted by Navas and Stark. Reminder: To prepare for next lecture’s treatment of a mathematical model of the mass-spring muscle model, review the basic theory of eigenvectors and eigenvalues.