Models and Theory of Computation (MTC) EPFL Dirk Beyer, Jasmin Fisher, Nir Piterman Simon Kramer: Logic for cryptography Marc Schaub: Models for biological.

Slides:



Advertisements
Similar presentations
From Graph Models to Game Models Tom Henzinger EPFL.
Advertisements

Interface Theories With Component Reuse Laurent DoyenEPFL Thomas HenzingerEPFL Barbara JobstmannEPFL Tatjana PetrovEPFL.
Game Theory Assignment For all of these games, P1 chooses between the columns, and P2 chooses between the rows.
Distributed Markov Chains P S Thiagarajan School of Computing, National University of Singapore Joint work with Madhavan Mukund, Sumit K Jha and Ratul.
Mixed Strategies For Managers
Energy and Mean-Payoff Parity Markov Decision Processes Laurent Doyen LSV, ENS Cachan & CNRS Krishnendu Chatterjee IST Austria MFCS 2011.
MIT and James Orlin © Game Theory 2-person 0-sum (or constant sum) game theory 2-person game theory (e.g., prisoner’s dilemma)
Nash Equilibria In Graphical Games On Trees Edith Elkind Leslie Ann Goldberg Paul Goldberg.
Game Theory: introduction and applications to computer networks Game Theory: introduction and applications to computer networks Zero-Sum Games (follow-up)
Interface-based design Philippe Giabbanelli CMPT 894 – Spring 2008.
Krishnendu Chatterjee1 Graph Games with Reachabillity Objectives: Mixing Chess, Soccer and Poker Krishnendu Chatterjee 5 th Workshop on Reachability Problems,
Krishnendu Chatterjee1 Partial-information Games with Reachability Objectives Krishnendu Chatterjee Formal Methods for Robotics and Automation July 15,
Randomness for Free Laurent Doyen LSV, ENS Cachan & CNRS joint work with Krishnendu Chatterjee, Hugo Gimbert, Tom Henzinger.
Luca de Alfaro Thomas A. Henzinger Ranjit Jhala UC Berkeley Compositional Methods for Probabilistic Systems.
Fault-Tolerant Real-Time Networks Tom Henzinger UC Berkeley MURI Kick-off Workshop Berkeley, May 2000.
Discounting the Future in Systems Theory Chess Review May 11, 2005 Berkeley, CA Luca de Alfaro, UC Santa Cruz Tom Henzinger, UC Berkeley Rupak Majumdar,
Interface Automata 29-September Modeling Temporal Behavior of Component Component behaves with Environment Traditional (pessimistic) approach –
Convertibility Verification and Converter Synthesis: Two Faces of the Same Coin Jie-Hong Jiang EE249 Discussion 11/21/2002 Passerone et al., ICCAD ’ 02.
Stochastic Zero-sum and Nonzero-sum  -regular Games A Survey of Results Krishnendu Chatterjee Chess Review May 11, 2005.
Interface-based Design of Embedded Systems Thomas A. Henzinger University of California, Berkeley.
Chapter Twenty-Eight Game Theory. u Game theory models strategic behavior by agents who understand that their actions affect the actions of other agents.
Games, Times, and Probabilities: Value Iteration in Verification and Control Krishnendu Chatterjee Tom Henzinger.
Type System, March 12, Data Types and Behavioral Types Yuhong Xiong Edward A. Lee Department of Electrical Engineering and Computer Sciences University.
Matrix Games Mahesh Arumugam Borzoo Bonakdarpour Ali Ebnenasir CSE 960: Selected Topics in Algorithms and Complexity Instructor: Dr. Torng.
Stochastic Games Games played on graphs with stochastic transitions Markov decision processes Games against nature Turn-based games Games against adversary.
Approaches to Reactive System Synthesis J.-H. Roland Jiang.
An Introduction to Game Theory Part III: Strictly Competitive Games Bernhard Nebel.
Rich Interface Theories for Component-based Design Dirk Beyer ┼, Arindam Chakrabarti *, Luca de Alfaro **, Thomas A Henzinger * ┼, Marcin Jurdziński *,
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
Nash Q-Learning for General-Sum Stochastic Games Hu & Wellman March 6 th, 2006 CS286r Presented by Ilan Lobel.
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
Chess Review November 21, 2005 Berkeley, CA Edited and presented by Advances in Hybrid System Theory: Overview Claire J. Tomlin UC Berkeley.
Department of Electrical Engineering and Computer Sciences University of California at Berkeley System-Level Types for Component-Based Design Edward A.
From Boolean to Quantitative System Specifications Tom Henzinger EPFL.
Chess Review November 18, 2004 Berkeley, CA Hybrid Systems Theory Edited and Presented by Thomas A. Henzinger, Co-PI UC Berkeley.
On Bounded Rationality and Computational Complexity Christos Papadimitriou and Mihallis Yannakakis.
Designing Predictable and Robust Systems Tom Henzinger UC Berkeley and EPFL.
Computing Equilibria Christos H. Papadimitriou UC Berkeley “christos”
Theory of Computing Lecture 22 MAS 714 Hartmut Klauck.
Stochastic Games Krishnendu Chatterjee CS 294 Game Theory.
Verification of Hierarchical Component-Based Designs in FRESCO Tom Henzinger, Marius Minea, Vinayak Prabhu.
System-Level Types for Component-Based Design Paper by: Edward A. Lee and Yuhong Xiong Presentation by: Dan Patterson.
NSF Foundations of Hybrid and Embedded Software Systems UC Berkeley: Chess Vanderbilt University: ISIS University of Memphis: MSI Program Review May 10,
6.896: Topics in Algorithmic Game Theory Spring 2010 Constantinos Daskalakis vol. 1:
Minimax strategies, Nash equilibria, correlated equilibria Vincent Conitzer
Solving Games Without Determinization Nir Piterman École Polytechnique Fédéral de Lausanne (EPFL) Switzerland Joint work with Thomas A. Henzinger.
Computing Equilibria Christos H. Papadimitriou UC Berkeley “christos”
Games of Strategy (Game Theory) Topic 1 – Part IV.
Energy Parity Games Laurent Doyen LSV, ENS Cachan & CNRS Krishnendu Chatterjee IST Austria.
Game theory & Linear Programming Steve Gu Mar 28, 2008.
Epistemic Strategies and Games on Concurrent Processes Prakash Panangaden: Oxford University (on leave from McGill University). Joint work with Sophia.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Tuomas Raivio and Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki.
Games. Adversaries Consider the process of reasoning when an adversary is trying to defeat our efforts In game playing situations one searches down the.
Games with Secure Equilibria Krishnendu Chatterjee (Berkeley) Thomas A. Henzinger (EPFL) Marcin Jurdzinski (Warwick)
The Science of Networks 6.1 Today’s topics Game Theory Normal-form games Dominating strategies Nash equilibria Acknowledgements Vincent Conitzer, Michael.
Modeling Reasoning in Strategic Situations Avi Pfeffer MURI Review Monday, December 17 th, 2007.
Rational Cryptography Some Recent Results Jonathan Katz University of Maryland.
Shall we play a game? Game Theory and Computer Science Game Theory /06/05 - Zero-sum games - General-sum games.
1. 2 Some details on the Simplex Method approach 2x2 games 2xn and mx2 games Recall: First try pure strategies. If there are no saddle points use mixed.
CIS 540 Principles of Embedded Computation Spring Instructor: Rajeev Alur
SOFTWARE TESTING LECTURE 9. OBSERVATIONS ABOUT TESTING “ Testing is the process of executing a program with the intention of finding errors. ” – Myers.
Q 2.1 Nash Equilibrium Ben
Chapter 28 Game Theory.
Sequential Flexibility
Stochastic -Regular Games
Operating Systems : Overview
Quantitative Modeling, Verification, and Synthesis
Operating Systems : Overview
Presentation transcript:

Models and Theory of Computation (MTC) EPFL Dirk Beyer, Jasmin Fisher, Nir Piterman Simon Kramer: Logic for cryptography Marc Schaub: Models for biological systems Vasu Singh: Software interface derivation Gregory Theoduloz: Combining model checking and program analysis Arindam Chakrabarti: Web service interfaces Krishnendu Chatterjee: Stochastic games Slobodan Matic: Time-triggered programming Vinayak Prabhu: Robust hybrid systems

Model Checking: From Graphs to Games Tom Henzinger EPFL

Graph Models of Systems vertices = states edges = transitions paths = behaviors

Game Models of Systems vertices = states edges = transitions paths = behaviors players = components

graph Game Models of Systems INDEPENDENT COMPONENTS: game FAIRNESS:  -automaton PROBABILITIES: Markov decision process stochastic game  regular game

Graphs vs. Games a ba a b a

-synthesis [Church, Rabin, Ramadge/Wonham, Pnueli/Rosner et al.] -receptiveness [Dill, Abadi/Lamport] -semantics of interaction [Abramsky] -reasoning about adversarial behavior -interface-based design -modular reasoning [Kupferman/Vardi et al.] -early error detection [deAlfaro/H/Mang] -model-based testing [Gurevich et al.] -scheduling [Sifakis et al.] -reasoning about security [Raskin et al.] -etc. Game Models enable

Game Models Always about open systems: -players = processes / components / agents -input vs. output -demonic vs. angelic nondeterminism

Game Models Always about open systems: -players = processes / components / agents -input vs. output -demonic vs. angelic nondeterminism 1.Output games: input demonic (adversarial) 2.Input games: output demonic

Output Games P1: init x := 0 loop choice | x := x+1 mod 2 | x := 0 end choice end loop S1:  (  x ¸ y ) P2: init y := 0 loop choice | y := x | y := x+1 mod 2 end choice end loop S2:  even(y)

Graph Questions 8  (x ¸ y) 9  (x ¸ y)

Graph Questions 8  (x ¸ y) 9  (x ¸ y)  X

Zero-Sum Game Questions hhP1ii  (x ¸ y) hhP2ii  even(y)

Zero-Sum Game Questions hhP1ii  (x ¸ y) hhP2ii  even(y) ATL [Alur/H/Kupferman]  X

Nonzero-Sum Game Questions hhP1ii  (x ¸ y)  hhP2ii  even(y)

Nonzero-Sum Game Questions hhP1ii  (x ¸ y)  hhP2ii  even(y) Secure equilibrium [Chatterjee/H/Jurdzinski] 

Classical Notion of Rationality Nash equilibrium: none of the players gains by deviation. 3,11,0 4,23,2 (row, column)

Refined Notion of Rationality Nash equilibrium: none of the players gains by deviation. Secure equilibrium: none hurts the opponent by deviation. 3,11,0 4,23,2 (row, column)

Secure Equilibrium Natural notion of rationality for multi-component systems: –First, a component tries to meet its specification. –Second, a component may obstruct the other components. A secure equilibrium is a contract: if one player deviates to lower the other player’s payoff, then her own payoff decreases as well, and vice versa.

Theorem W 10 hhP1ii (S1 Æ : S2 ) W 01 hhP2ii (S2 Æ : S1) W 11 W 00 hhP1iiS1  hhP2iiS2

Generalization of Determinacy W 10 W 01 W 11 W 00 W1W1 W2W2 Zero-sum games: S1 = :S2Nonzero-sum games: S1, S2 hhP2iiS2 hhP1iiS1

Game Models Always about open systems: -players = processes / components / agents -input vs. output -demonic vs. angelic nondeterminism 1.Output games: input demonic (adversarial) 2.Input games: output demonic

Input Games x! y! x! z! a? b? a? Control objective:  : z

Input Games x! y! x! z! a? b? a? Control objective:  : z

Input Games x! y! x! z! a? b? a? Control objective:  : z

Input Games x! y! x! z! a? b? a? Controller: x? y? a!b! [Ramadge/Wonham et al.]

Input Games x! y! x! z! a? b? a? Not input enabling

Input Games x! y! x! z! a? b? a? Environment avoids deadlock = Input assumption Interface automata [deAlfaro/H]

Input Games x! y! x! z! a? b? a? x,y? a! Legal environment

Input Games x! y! x! z! a? b? a? x,y? b! Illegal environment

open data close read open? read?data! close? File server Interface Compatibility

open data close read open? read?data! close? open! data? read! close! Good client Interface Compatibility File server

open data close read open? read?data! close? open! Interface Compatibility Bad clientFile server

Incremental Design

Input assumption Incremental Design Input assumption

Propagated weakest input assumption Incremental Design

x y ab a?b? x!y! a?b? y!x! a? x! y! Input Assumption Propagation

x y aabb a? x,y? a,b? y? a?b? x!y! a?b? y!x! a? x! y! Input Assumption Propagation

x y aabb a? x,y? a,b? y? a?b? x!y! a?b? y!x! a? x! y! Input Assumption Propagation

x y aabb a? x,y? a,b? y? a?b? x!y! a?b? y!x! a? x! y! Two interfaces are compatible if they can be used together in some environment.

ab a? x!y! b?a? xy y! The Composite Interface

Refinement x! y! x! z! a? b? a? x,y? a! Every legal environment should be a legal environment of the refined process. y! x,z?y?

Refinement x! y! x! z! a? b? a? x,y? a! Every legal environment should be a legal environment of the refined process. y! x,z?y?

Refinement x! y! x! z! a? b? a? x,y? a! Every legal environment should be a legal environment of the refined process. y! x,z?y? b?

Refinement x! y! x! z! a? b? a? x,y? a! Every legal environment should be a legal environment of the refined process. y! x,z?y?

Refinement x! y! x! z! a? b? a? x,y? a! Every legal environment should be a legal environment of the refined process. y! x,z?y? z!

Interface Refinement: I/O Alternating Simulation A’  A iff 1. for all inputs i, if A –i?-> B, then there exists B’ such that A’ –i?-> B’ and B’  B, and 2. for all outputs o, if A’ –o!-> B’, then there exists B such that A –o!-> B and B’  B.

Interface Refinement: I/O Alternating Simulation A’  A iff 1. for all inputs i, if A –i?-> B, then there exists B’ such that A’ –i?-> B’ and B’  B, and 2. for all outputs o, if A’ –o!-> B’, then there exists B such that A –o!-> B and B’  B.

Interface Refinement: I/O Alternating Simulation A’  A iff 1. for all inputs i, if A –i?-> B, then there exists B’ such that A’ –i?-> B’ and B’  B, and 2. for all outputs o, if A’ –o!-> B’, then there exists B such that A –o!-> B and B’  B. Every environment (i.e., input strategy that avoids deadlock) for A is an environment for A’ [Alur/H/Kupferman/Vardi].

If A and B is are compatible and A'  A and B'  B, then A’ and B' are compatible and A'||B'  A||B. A’ · A … A’ refines / implements A The Principle of Independent Implementability

If A and B is are compatible and A'  A and B'  B, then A’ and B' are compatible and A'||B'  A||B. A’ · A … A’ refines / implements A The Principle of Independent Implementability This is a theorem if -A, B, A’, B’ are two-player games Input vs. Output -two games are compatible if player Input has a winning strategy in the composite game

Interface-based Design

Summary There are many models of computation (e.g. pushdown, timed, stochastic) and many models of interaction (e.g. synchronous). Similarly, there are many variants of games (e.g. concurrent vs. turn-based moves; pure vs. randomized strategies).

Summary There are many models of computation (e.g. pushdown, timed, stochastic) and many models of interaction (e.g. synchronous). Similarly, there are many variants of games (e.g. concurrent vs. turn-based moves; pure vs. randomized strategies). The technical details are different, but to ask and answer the kind of questions we discussed, the only important feature of a model is the presence of multiple players.

References Interface Automata: de Alfaro, H FSE 2001 Secure Equilibria: Chatterjee, H, Jurdzinski LICS 2004