Asymptotic behaviour of blinking (stochastically switched) dynamical systems Vladimir Belykh Mathematics Department Volga State Academy Nizhny Novgorod.

Slides:



Advertisements
Similar presentations
COMMON WEAK LYAPUNOV FUNCTIONS and OBSERVABILITY Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois.
Advertisements

NONLINEAR HYBRID CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois.
TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.
INTRODUCTION to SWITCHED SYSTEMS ; STABILITY under ARBITRARY SWITCHING
PROCESS MODELLING AND MODEL ANALYSIS © CAPE Centre, The University of Queensland Hungarian Academy of Sciences Analysis of Dynamic Process Models C13.
1 A class of Generalized Stochastic Petri Nets for the performance Evaluation of Mulitprocessor Systems By M. Almone, G. Conte Presented by Yinglei Song.
Example System: Predator Prey Model
10 Further Time Series OLS Issues Chapter 10 covered OLS properties for finite (small) sample time series data -If our Chapter 10 assumptions fail, we.
Lecture #13 Stability under slow switching & state-dependent switching João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched.
STABILITY under CONSTRAINED SWITCHING Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois at Urbana-Champaign.
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
TCP Stability and Resource Allocation: Part II. Issues with TCP Round-trip bias Instability under large bandwidth-delay product Transient performance.
ODE and Discrete Simulation or Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL MLQA, Aachen, September
Algorithmic and Economic Aspects of Networks Nicole Immorlica.
1 L-BFGS and Delayed Dynamical Systems Approach for Unconstrained Optimization Xiaohui XIE Supervisor: Dr. Hon Wah TAM.
CS 8751 ML & KDDEvaluating Hypotheses1 Sample error, true error Confidence intervals for observed hypothesis error Estimators Binomial distribution, Normal.
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
AWESOME: A General Multiagent Learning Algorithm that Converges in Self- Play and Learns a Best Response Against Stationary Opponents Vincent Conitzer.
Dynamic Network Security Deployment under Partial Information George Theodorakopoulos (EPFL) John S. Baras (UMD) Jean-Yves Le Boudec (EPFL) September 24,
13. The Weak Law and the Strong Law of Large Numbers
MTH-471 Integral Equations Sheikh Irfan Ullah Khan Assistant Professor Department of Mathematics COMSTAS Institute of Information Technology.
Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,
Solving Non-Linear Equations (Root Finding)
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL ACCESS Distinguished Lecture Series, Stockholm, May 28,
Artificial Neural Networks
Limits and the Law of Large Numbers Lecture XIII.
Example System: Predator Prey Model
Lecture #9 Analysis tools for hybrid systems: Impact maps João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched Systems.
2.4 Sequences and Summations
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology The Weak Law and the Strong.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
An Analysis of Phase Noise and Fokker-Planck Equations Hao-Min Zhou School of Mathematics Georgia Institute of Technology Partially Supported by NSF Joint.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Lecture #11 Stability of switched system: Arbitrary switching João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched Systems.
Biological Modeling of Neural Networks Week 8 – Noisy output models: Escape rate and soft threshold Wulfram Gerstner EPFL, Lausanne, Switzerland 8.1 Variation.
Lecture 21 Neural Modeling II Martin Giese. Aim of this Class Account for experimentally observed effects in motion perception with the simple neuronal.
Synchronization in complex network topologies
LEAST MEAN-SQUARE (LMS) ADAPTIVE FILTERING. Steepest Descent The update rule for SD is where or SD is a deterministic algorithm, in the sense that p and.
1 Partial Synchronization in Coupled Chaotic Systems  Cooperative Behaviors in Three Coupled Maps Sang-Yoon Kim Department of Physics Kangwon National.
Architecture and Equilibra 结构和平衡 Chapter Chapter 6 Architecture and Equilibria Perface lyaoynov stable theorem.
AUTOMATIC CONTROL THEORY II Slovak University of Technology Faculty of Material Science and Technology in Trnava.
Lecture #14 Computational methods to construct multiple Lyapunov functions & Applications João P. Hespanha University of California at Santa Barbara Hybrid.
Feedback Stabilization of Nonlinear Singularly Perturbed Systems MENG Bo JING Yuanwei SHEN Chao College of Information Science and Engineering, Northeastern.
Lecture #12 Controller realizations for stable switching João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched Systems.
NanJing University of Posts & Telecommunications Synchronization and Fault Diagnosis of Complex Dynamical Networks Guo-Ping Jiang College of Automation,
Architecture and Equilibria 结构和平衡 Chapter 6 神经网络与模糊系统 学生: 李 琦 导师:高新波.
NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois at.
Lecture #7 Stability and convergence of ODEs João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched Systems NO CLASSES.
17 1 Stability Recurrent Networks 17 3 Types of Stability Asymptotically Stable Stable in the Sense of Lyapunov Unstable A ball bearing, with dissipative.
Giansalvo EXIN Cirrincione unit #4 Single-layer networks They directly compute linear discriminant functions using the TS without need of determining.
On the behaviour of an edge number in a power-law random graph near a critical points E. V. Feklistova, Yu.
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL Network Science Workshop Hong Kong July
Krishnendu ChatterjeeFormal Methods Class1 MARKOV CHAINS.
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
Stability and instability in nonlinear dynamical systems
Reinforcement Learning Dynamics in Social Dilemmas
NEURONAL DYNAMICS 2: ACTIVATION MODELS
§7-4 Lyapunov Direct Method
Autonomous Cyber-Physical Systems: Dynamical Systems
Stability.
Lecture #10 Switched systems
13. The Weak Law and the Strong Law of Large Numbers
Stability Analysis of Linear Systems
EUROPEAN UNION EUROPEAN SOCIAL FUND OPERATIONAL PROGRAMME
Guosong Yang1, A. James Schmidt2, and Daniel Liberzon2
16. Mean Square Estimation
On Topological Entropy and Stability of Switched Linear Systems
13. The Weak Law and the Strong Law of Large Numbers
Presentation transcript:

Asymptotic behaviour of blinking (stochastically switched) dynamical systems Vladimir Belykh Mathematics Department Volga State Academy Nizhny Novgorod Russia Blinking dynamical system and averaged system Finite time properties: 1 example Asymptotic properties: 1 example Igor Belykh Mathematics Department Georgia State University Atlanta GA USA Martin Hasler Laboratory of nonlinear systems School of Computer and Communication Sciences Swiss Federal Institute of Technology Lausanne (EPFL) Switzerland Torino, Nov.5, 2010

Blinking dynamical system Time axis: t t+Q  t+  t+  In each time interval one of the 2 M systems is chosen at random. Random variables S i k : value of i-th component of s during the time interval from (k-1)  to k . Hypothesis: all S i k independent, value 1 with probability p, 0 with prob. 1-p Terminology: s k : k = 1,2,…: switching sequence

Blinking dynamical system Torino, Nov.5,  t s 1 (t) Switching signals:

Torino, Nov.5, 2010 Averaged system For fixed x: Asymptotic time average = Ensemble average (law of large numbers)

Conjecture Torino, Nov.5, 2010 If switching is fast enough, the solution of the blinking system follows the solutions of the averaged system forever? for almost all switching sequences, or only with high probability? can we prove this?

Blinking system: stochastic averaging Torino, Nov.5, 2010, Theorem: Under some weak hypotheses, for any  > 0, T > 0, the probability that converges to 1 as   0 Clearly: as  increases,  decreases and/or T increases the probability decreases. But: Can we get an explicit lower bound the probability? or, equivalently, an upper bound for  for a given prob. A.V.Skorokhod, F.C.Hoppensteadt, H. Salehi, « Random Perturbation Methods », Springer Series in Applied Mathematical Sciences, vol. 150, 2002

Example 1: Lorenz System Torino, Nov.5, 2010  = 10, b = 8/3 Blinking: r is switched between r- = 28 and r+ = 33, probability p= 0.5  mean value 30.5

Example 1: Lorenz System Torino, Nov.5, 2010 x2 vs. x1 black: r = 30.5, blue: r = 28, red: r = 33

Example 1: Lorenz System Torino, Nov.5, 2010 x1 vs. time r = 30.5 r = 28 r = 33

Example 1: Lorenz System Torino, Nov.5, 2010 averaged system blinking system,  =10 -2 blinking - averaged

Example 1: Lorenz System Torino, Nov.5, 2010 blinking – averaged,  =10 -4 blinking – averaged,  =10 -2 Reducing  reduces much less the difference between blinking and averaged Reducing  practically does not extend the time interval

General theorem for finite time Torino, Nov.5, 2010 Theorem: Under some weak hypotheses, for each  > 0, T > 0 with probability converging to 1 as the switching time  goes to zero: where and c 1, c 2 are constants composed of bounds and Lipschitz constants of F and 

General theorem for finite time Torino, Nov.5, 2010 Case a: decrease of  is slow with  Case b:  must decrease rapidly as T increases is a soft limit for the validity of the averaging approximation

Can blinking follow averaged forever? Torino, Nov.5, 2010 In general: NO Exception: Solution of averaged system converges to an asymptotically stable equilibrium point x ∞ x ∞ is also an equilibrium point of the blinking system. If x ∞ is also asymptotically stable for the blinking system, corresponding solutions of the averaged and the blinking system stay always close together x∞x∞

Can blinking follow averaged forever? Torino, Nov.5, 2010 More generally: Solution of the averaged system converges towards an attractor (or attracting set) A A is an invariant set for the blinking system Possible that the solution of the blinking systems starting at the same initial state converges to A But the two solutions eventually separate A

Technical assumption: Averaged system has Lyapunov function Torino, Nov.5, 2010 Function with 1) 2) 3)

Technical assumption: Averaged system has Lyapunov function Torino, Nov.5, 2010 Lyapunov function  solutions converge to attractor (or attracting set) A A

Torino, Nov.5, 2010 Example 2: Synchronization of Lorenz systems 5 diffusively coupled Lorenz systems: Can we choose the diffusion constant d and the switching time  such that the dynamical systems synchronize completely and globally, i.e. All links are turned on and off independently with probability p = 0.5  most of the time the network is not connected!

Example 2: Synchronization of Lorenz systems Torino, Nov.5, 2010 For a large enough coupling constant d the diagonal linear subspace is an attracting set of the averaged system Then, as Lyapunov function can be taken with a suitable positive definite matrix M The attracting set of the averaged system is invariant for the blinking system

Torino, Nov.5, 2010 Example 2: 5 coupled Lorenz systems, d = 30, no switching (averaged system) x 2 – x 1 x 3 – x 1 x 4 – x 1 x 5 – x 1

Torino, Nov.5, 2010 Example 2: 5 coupled Lorenz systems, d = 60, p = 0.5,  = 0.1 x 2 – x 1 x 3 – x 1 x 4 – x 1 x 5 – x 1 Time axis: 0  

Torino, Nov.5, 2010 Example 2: 5 coupled Lorenz systems, d = 60, p = 0.5,  = 5 x 2 – x 1 x 3 – x 1 x 4 – x 1 x 5 – x 1

Example 2: Synchronization of Lorenz systems Torino, Nov.5, 2010, Almost all solutions of the blinking system synchronize if the switching time is smaller than some threshold and the coupling constant is large enough The solutions of the blinking and the averaged system do not stay close forever, but they both synchronize for large enough coupling constant and small enough switching time. Exponential speed of synchronization is similar for averaged and blinking model. Observations:

General theorem for infinite time when the attactor of the averaged system is invariant under the blinking system Torino, Nov.5, 2010 Theorem: Under some weak hypotheses and if there is a Lyapunov function W and an attractor (or attracting set) A of the averaged system such that A is invariant under the blinking system and there is a constant  >0 such that for all solutions  (t) of the averaged system Then, if  is small enough such that almost all solutions of the blinking system converge to A and there is a constant c 4 such that