Linear Model Measurements with Application to Bird Flocking Scott A. Smolka Linear Model Measurements with Application to Bird Flocking Scott A. Smolka.

Slides:



Advertisements
Similar presentations
1 Verification by Model Checking. 2 Part 1 : Motivation.
Advertisements

Warm-up Is the following set of ordered pairs a function? Explain why or why not. {(-1, -2), (0, 2), ( 1, 4), (3, 8)} Make a table, or T-chart, using.
Model Checking Lecture 3. Specification Automata Syntax, given a set A of atomic observations: Sfinite set of states S 0 Sset of initial states S S transition.
October 29, 2004SAVCBS04 Presented by: Gaoyan Xie CTL Model-checking for Systems with Unspecified Components Gaoyan Xie and Zhe Dang School of Electrical.
Reinforcement Learning
Metodi formali dello sviluppo software a.a.2013/2014 Prof.Anna Labella.
CS 267: Automated Verification Lecture 2: Linear vs. Branching time. Temporal Logics: CTL, CTL*. CTL model checking algorithm. Counter-example generation.
Design Rule Generation for Interconnect Matching Andrew B. Kahng and Rasit Onur Topaloglu {abk | rtopalog University of California, San Diego.
Copyright , Doron Peled and Cesare Tinelli. These notes are based on a set of lecture notes originally developed by Doron Peled at the University.
Automatic Verification Book: Chapter 6. What is verification? Traditionally, verification means proof of correctness automatic: model checking deductive:
Chapter 7 - Local Stabilization1 Chapter 7: roadmap 7.1 Super stabilization 7.2 Self-Stabilizing Fault-Containing Algorithms 7.3 Error-Detection Codes.
Model Checking I What are LTL and CTL?. and or dreq q0 dack q0bar.
Hybrid Systems Presented by: Arnab De Anand S. An Intuitive Introduction to Hybrid Systems Discrete program with an analog environment. What does it mean?
SA-1 Probabilistic Robotics Planning and Control: Partially Observable Markov Decision Processes.
1 Temporal Claims A temporal claim is defined in Promela by the syntax: never { … body … } never is a keyword, like proctype. The body is the same as for.
Model Checking I What are LTL and CTL?. and or dreq q0 dack q0bar D D.
Integration of sensory modalities
1 Monte Carlo Methods Week #5. 2 Introduction Monte Carlo (MC) Methods –do not assume complete knowledge of environment (unlike DP methods which assume.
Entropy Rates of a Stochastic Process
Junction Trees: Motivation Standard algorithms (e.g., variable elimination) are inefficient if the undirected graph underlying the Bayes Net contains cycles.
1 Carnegie Mellon UniversitySPINFlavio Lerda SPIN An explicit state model checker.
*Sponsored in part by the DARPA IT-MANET Program, NSF OCE Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks Rahul.
Temporal Logic and Model Checking. Reactive Systems We often classify systems into two types: Transformational: functions from inputs available at the.
Specification Formalisms Book: Chapter 5. Properties of formalisms Formal. Unique interpretation. Intuitive. Simple to understand (visual). Succinct.
August 2006Scott Stoller, Stony Brook University1 Research in Formal Methods, Concurrent & Distributed Systems, and Programming Languages at Scott D. Stoller.
Reinforcement Learning: Learning algorithms Yishay Mansour Tel-Aviv University.
Copyright © 2010 Pearson Education, Inc. All rights reserved Sec Linear Inequalities in One Variable.
Monte Carlo Analysis of Security Protocols: Needham-Schroeder Revisited Radu Grosu SUNY at Stony Brook Joint work with Xiaowan Huang, Scott Smolka, & Ping.
Monte Carlo Model Checking Scott Smolka SUNY at Stony Brook Joint work with Radu Grosu Main source of support: ARO – David Hislop.
Flavio Lerda 1 LTL Model Checking Flavio Lerda. 2 LTL Model Checking LTL –Subset of CTL* of the form: A f where f is a path formula LTL model checking.
Linear Systems The definition of a linear equation given in Chapter 1 can be extended to more variables; any equation of the form for real numbers.
C++ Programming: From Problem Analysis to Program Design, Fifth Edition Chapter 1: An Overview of Computers and Programming Languages Updated by: Dr\Ali-Alnajjar.
Pipelined Two Step Iterative Matching Algorithms for CIOQ Crossbar Switches Deng Pan and Yuanyuan Yang State University of New York, Stony Brook.
CS Reinforcement Learning1 Reinforcement Learning Variation on Supervised Learning Exact target outputs are not given Some variation of reward is.
Linear Functions and Their Properties Section 4.1.
1 Carnegie Mellon UniversitySPINFlavio Lerda Bug Catching SPIN An explicit state model checker.
15-820A 1 LTL to Büchi Automata Flavio Lerda A 2 LTL to Büchi Automata LTL Formulas Subset of CTL* –Distinct from CTL AFG p  LTL  f  CTL. f.
Distributed Constraint Optimization Michal Jakob Agent Technology Center, Dept. of Computer Science and Engineering, FEE, Czech Technical University A4M33MAS.
1 ECE-517 Reinforcement Learning in Artificial Intelligence Lecture 7: Finite Horizon MDPs, Dynamic Programming Dr. Itamar Arel College of Engineering.
Defining Programs, Specifications, fault-tolerance, etc.
An Event-Driven Approach to Modeling Excitable Cells using Hybrid Automata Mike True, SUNY at Stony Brook A Joint Work with: Emilia Entcheva Radu Grosu.
Copyright , Doron Peled and Cesare Tinelli. These notes are based on a set of lecture notes originally developed by Doron Peled at the University.
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
Quantitative Model Checking Radu Grosu SUNY at Stony Brook Joint work with Scott A. Smolka.
Verification & Validation By: Amir Masoud Gharehbaghi
1 Monte-Carlo Planning: Policy Improvement Alan Fern.
Constraints Assisted Modeling and Validation Presented in CS294-5 (Spring 2007) Thomas Huining Feng Based on: [1]Constraints Assisted Modeling and Validation.
Seminar on random walks on graphs Lecture No. 2 Mille Gandelsman,
Exact Inference in Bayes Nets. Notation U: set of nodes in a graph X i : random variable associated with node i π i : parents of node i Joint probability:
/ PSWLAB S PIN Search Optimization from “THE SPIN MODEL CHECKER” by G. Holzmann Presented by Hong,Shin 23 th Nov SPIN Search.
Discriminative n-gram language modeling Brian Roark, Murat Saraclar, Michael Collins Presented by Patty Liu.
Abstraction and Abstract Interpretation. Abstraction (a simplified view) Abstraction is an effective tool in verification Given a transition system, we.
Algebra 1 Section 4.2 Graph linear equation using tables The solution to an equation in two variables is a set of ordered pairs that makes it true. Is.
1 Passive Reinforcement Learning Ruti Glick Bar-Ilan university.
Logical time Causality between events is fundamental to the design of parallel and distributed systems. In distributed systems, it is not possible to have.
Basic concepts of Model Checking
Chapter 1: An Overview of Computers and Programming Languages
1 Equations, Inequalities, and Mathematical Modeling
Planning as model checking, (OBDDs)
Chapter 1: An Overview of Computers and Programming Languages
Copyright © Cengage Learning. All rights reserved.
Markov Decision Processes
Markov Decision Processes
Chapter 1: An Overview of Computers and Programming Languages
CSEP590 – Model Checking and Automated Verification
Chapter 1: An Overview of Computers and Programming Languages
Abstraction.
Local Search Algorithms
Presentation transcript:

Linear Model Measurements with Application to Bird Flocking Scott A. Smolka Linear Model Measurements with Application to Bird Flocking Scott A. Smolka Stony Brook University Joint work with Radu Grosu, Doron Peled, C.R. Ramakrishnan, Scott Stoller, Junxing Yang

Congratulations Ed! I first met Ed at Harvard in 1980, on occasion of visit by Amir Pnueli Closely followed Ed’s work throughout his illustrious career Finally got to work with Ed in 2009 with launch of NSF CMACS Expedition in Computing Ed is mentor, friend, colleague, and inspiration!

Talk Outline Flocking Model Neighborhood-based Measurements Path-based Measurements Application to Flocking Goal: Model-measurement framework provides fitness values for parameter-optimization framework

Flocking Model Cucker’s modelReynold’s model

Velocity Matching Measures how well the velocities are aligned: LTL property to be “measured”:

Neighborhood-Based Measurement State space is a tuple is finite set of states is initial state is transition relation Components in each state Tuple of measurement variables Well-founded value set Expressions based on that result in values from Constants Update function

Measurement Algorithm With each clock tick, execute in each state If is not minimal, then do Send to all neighbors Receive from neighbors Update decreasing

Example Measurements Find maximal value in a graph Well-founded domain is the natural numbers with usual < Decreasing expression E assigned to each state is simply d current maximal counter, initialized to width of the structure

Example Measurements (contd.) LTL Model Checking: Let. Measure linear combination of how fast becomes true in + average value of VM while is true. CTL Model Checking Variable for each subformula Two counters: phase-counter and down-counter For sub-formula e.g. :

Path Measurements 1.Paths may be infinite. 2.Multiple paths in the structure (possibly infinite). Assume measurements are affected mainly by a finite prefix of sequences. Impose a limit on the length. Use generalized Monte Carlo measurements to conclude that a large enough number of executions has guaranteed some measurement threshold.

Generalized Monte-Carlo Measurements Obtain joint estimate of mean values of Boolean-real pairs Additive approximation (AAA algorithm): Multiplicative approximation (SRA and OAA algorithms):

Experimental Results Runs μRμR N Avg Std2.7e Table 1. Results obtained from OAA Runs μRμR N Avg Std Table 2. Results obtained from AAA Figure 1. Birds’ positions and velocities after 50 steps of simulation

V-formation Figure 2. Birds’ positions and velocities after 500 steps of simulation Model measurements as fitness in Genetic Algorithm To achieve V-formation, measure clear view + upwash benefit