Congestion Games (Review and more definitions), Potential Games, Network Congestion games, Total Search Problems, PPAD, PLS completeness, easy congestion.

Slides:



Advertisements
Similar presentations
Inefficiency of equilibria, and potential games Computational game theory Spring 2008 Michal Feldman TexPoint fonts used in EMF. Read the TexPoint manual.
Advertisements

Congestion and crowding Games Pasquale Ambrosio* Vincenzo Bonifaci + Carmine Ventre* *University of Salerno + University “La Sapienza” Roma.
Price Of Anarchy: Routing
Bilinear Games: Polynomial Time Algorithms for Rank Based Subclasses Ruta Mehta Indian Institute of Technology, Bombay Joint work with Jugal Garg and Albert.
COMP 553: Algorithmic Game Theory Fall 2014 Yang Cai Lecture 21.
Computation of Nash Equilibrium Jugal Garg Georgios Piliouras.
Algorithmic Game Theory and Scheduling Eric Angel, Evripidis Bampis, Fanny Pascual IBISC, University of Evry, France GOTha, 12/05/06, LIP 6.
Introduction to Algorithms
The Stable Circuit Problem A Short Introduction Brendan Juba.
Congestion Games with Player- Specific Payoff Functions Igal Milchtaich, Department of Mathematics, The Hebrew University of Jerusalem, 1993 Presentation.
Multicut Lower Bounds via Network Coding Anna Blasiak Cornell University.
Mechanism Design without Money Lecture 4 1. Price of Anarchy simplest example G is given Route 1 unit from A to B, through AB,AXB OPT– route ½ on AB and.
by Vincent Conitzer of Duke
1 The Complexity of Pure Nash Equilibria Alex Fabrikant Christos Papadimitriou Kunal Talwar CS Division, UC Berkeley.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Computational Game Theory
Local Connection Game. Introduction Introduced in [FLMPS,PODC’03] A LCG is a game that models the creation of networks two competing issues: players want.
Beyond selfish routing: Network Formation Games. Network Formation Games NFGs model the various ways in which selfish agents might create/use networks.
1 Computing Nash Equilibrium Presenter: Yishay Mansour.
The Price Of Stability for Network Design with Fair Cost Allocation Elliot Anshelevich, Anirban Dasgupta, Jon Kleinberg, Eva Tardos, Tom Wexler, Tim Roughgarden.
On the Price of Stability for Designing Undirected Networks with Fair Cost Allocations Svetlana Olonetsky Joint work with Amos Fiat, Haim Kaplan, Meital.
On the Price of Stability for Designing Undirected Networks with Fair Cost Allocations M.Sc. Thesis Defense Svetlana Olonetsky.
Near-Optimal Network Design with Selfish Agents By Elliot Anshelevich, Anirban Dasgupta, Eva Tardos, Tom Wexler STOC’03 Presented by Mustafa Suleyman CIFTCI.
Potential games, Congestion games Computational game theory Spring 2010 Adapting slides by Michal Feldman TexPoint fonts used in EMF. Read the TexPoint.
Algorithms and Economics of Networks Abraham Flaxman and Vahab Mirrokni, Microsoft Research.
Network Formation Games. Netwok Formation Games NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models:
The Computational Complexity of Finding a Nash Equilibrium Edith Elkind, U. of Warwick.
Second case study: Network Creation Games (a.k.a. Local Connection Games)
Near-Optimal Network Design With Selfish Agents Elliot Anshelevich, Anirban Dasgupta, Éva Tardos, Tom Wexler STOC’03, June 9–11, 2003, San Diego, California,
Network Formation Games. Netwok Formation Games NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models:
Price of Anarchy Bounds Price of Anarchy Convergence Based on Slides by Amir Epstein and by Svetlana Olonetsky Modified/Corrupted by Michal Feldman and.
Inefficiency of equilibria, and potential games Computational game theory Spring 2008 Michal Feldman.
1 Issues on the border of economics and computation נושאים בגבול כלכלה וחישוב Congestion Games, Potential Games and Price of Anarchy Liad Blumrosen ©
Computer Science 112 Fundamentals of Programming II Introduction to Graphs.
Beyond Routing Games: Network (Formation) Games. Network Games (NG) NG model the various ways in which selfish users (i.e., players) strategically interact.
Design Techniques for Approximation Algorithms and Approximation Classes.
1 The Price of Defense M. Mavronicolas , V. Papadopoulou , L. Michael ¥, A. Philippou , P. Spirakis § University of Cyprus, Cyprus  University of Patras.
Ásbjörn H Kristbjörnsson1 The complexity of Finding Nash Equilibria Ásbjörn H Kristbjörnsson Algorithms, Logic and Complexity.
Maximum Flow. p2. Maximum Flow A flow network G=(V, E) is a DIRECTED graph where each has a nonnegative capacity u.
1/24 Introduction to Graphs. 2/24 Graph Definition Graph : consists of vertices and edges. Each edge must start and end at a vertex. Graph G = (V, E)
Beyond selfish routing: Network Games. Network Games NGs model the various ways in which selfish agents strategically interact in using a network They.
Beyond selfish routing: Network Games. Network Games NGs model the various ways in which selfish users (i.e., players) strategically interact in using.
CS 3343: Analysis of Algorithms Lecture 25: P and NP Some slides courtesy of Carola Wenk.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
CSCI-256 Data Structures & Algorithm Analysis Lecture Note: Some slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved. 25.
Strings Basic data type in computational biology A string is an ordered succession of characters or symbols from a finite set called an alphabet Sequence.
Vasilis Syrgkanis Cornell University
Exercise 6.1 Find the number of different shortest paths from point A to point B in a city with perfectly horizontal streets and vertical avenues as shown.
NP-completeness NP-complete problems. Homework Vertex Cover Instance. A graph G and an integer k. Question. Is there a vertex cover of cardinality k?
6.853: Topics in Algorithmic Game Theory Fall 2011 Constantinos Daskalakis Lecture 8.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
The Price of Routing Unsplittable Flow Yossi Azar Joint work with B. Awerbuch and A. Epstein.
Local Connection Game. Introduction Introduced in [FLMPS,PODC’03] A LCG is a game that models the creation of networks two competing issues: players want.
Second case study: Network Creation Games (a.k.a. Local Connection Games)
Network Formation Games. NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models: Global Connection Game.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Network Formation Games. NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models: Global Connection Game.
More NP-Complete and NP-hard Problems
Shop Scheduling Problem
Local Connection Game.
Computability and Complexity
Alternating tree Automata and Parity games
Network Formation Games
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
Computing a Nash Equilibrium of a Congestion Game: PLS-completeness
Network Formation Games
Vertex Covers and Matchings
Presentation transcript:

Congestion Games (Review and more definitions), Potential Games, Network Congestion games, Total Search Problems, PPAD, PLS completeness, easy congestion problems, hard congestion problems Credit to slides by Carmine Ventre (part of cogestion game slide) Added/modified by Michal Feldman and Amos Fiat

(General) Congestion Games resources  roads 1,2,3,4 players  driver A, driver B strategies: which roads I use for reach my destination?  A wants to go in Salerno  e.g. S A ={{1,2},{3,4}}  B wants to go in Napoli  e.g. S B ={{1,4},{2,3}} what about the payoffs? Roma Salerno Milano Napoli road 1 road 2 road 3 road 4 AB

Payoffs in (G)CG: an example A choose path 1,2 B choose path 1,4 u A = - (c 1 (2) + c 2 (1)) = - 4 u B = - (c 1 (2) + c 4 (1)) = - 5 Roma Salerno Milano Napoli road 1 road 2 road 3 road 4 A B c 1 (1)=2c 1 (2)= 3 c 2 (1)=1c 2 (2)= 4 c 3 (1)=4c 3 (2)= 6 c 4 (1)=2c 4 (2)= 5 Costs for the roads SIRF (Small Index Road First) (-4,-5)(-6,-8) (-9,-7)(-8,-7) {1,2} {3,4} {1,4}{2,3} B A

Congestion games: special cases Symmetric CG  S i are all the same and payoffs are identical symmetric function of n-1 variables Network CG  Each player has a starting and terminal node and the strategies are the paths in the network

Rosenthal’s result The class of GCG is “nice” A pure Nash equilibrium exists Introduces the potential function:

Potential functions Several kind of potential functions:  Ordinal potential function  Weighted potential function  (Exact) potential function  Generalized ordinal potential function

Ordinal potential function (2,1)(0,0) (1,2) u 1 (B,B) – u 1 (S,B) > 0 implies that P 1 (B,B) – P 1 (S,B) > 0 P 1 (B,B) – P 1 (S,B) > 0 implies that u 1 (B,B) – u 1 (S,B) > 0 and that u 2 (B,B) – u 2 (S,B) > 0 P 1 is an ordinal potential function for BoS game u 1 (B,S) – u 1 (S,S) < 0 implies that P 1 (B,S) – P 1 (S,S) < 0 A function P (from S to R) is an OPF for a game G if for every player i u i (s -i, x) - u i (s -i, z) > 0 iff P(s -i, x) - P(s -i, z) > 0 for every x, z in S i and for every s -i BoS = P 1 =

Weighted potential function (1,1)(9,0) (0,9)(6,6) PD = 23/2 0 P 2 = u 1 (C,C) – u 1 (D,C) = 1 = 2 (P 2 (C,C) – P 2 (D,C)) u 2 (D,C) – u 2 (D,D) = 3 = 2 (P 2 (D,C) – P 2 (D,D)) C C D D u 1 (C,D) – u 1 (D,D) = 3 = 2 (P 2 (C,D) – P 2 (D,D)) u 2 (C,C) – u 2 (C,D) = 1 = 2 (P 2 (C,C) – P 2 (C,D)) P 2 is a (2,2)-potential function for PD game A function P (from S to R) is a w-PF for a game G if for every player i u i (s -i, x) - u i (s -i, z) = w i (P(s -i, x) - P(s -i, z)) for every x, z in S i and for every s -i G’ = (1,0)(2,4) (4,0)(3,1) P 3 = u 1 (A,A) – u 1 (B,A) = = 1/3 (P 3 (A,A) – P 3 (B,A)) u 2 (B,A) – u 2 (B,B) = = 1/2 (P 3 (B,A) – P 3 (B,B)) A A B B u 1 (A,B) – u 1 (B,B) = = 1/3 (P 3 (A,B) – P 3 (B,B)) u 2 (A,A) – u 2 (A,B) = = 1/2 (P 3 (A,A) – P 3 (A,B)) P 3 is a (1/3,1/2)- potential function for the game G’

Weighted potential function m identical machines, n jobs, and {w i } i=1..n the weights of the jobs Jobs seek to minimize the makespan on their machine, Take If job i moves from machine j to j’, then the difference in load is and the difference in the potential function is

Weighted potential function (example) m identical machines, {w i } i=1..n job weights If job i moves from machine j to j’, then the difference in load is

Ordinal potential function (example) m machines, {w ij } i=1..n,j=1..m job weights w ij – weight of job i on machine j If job i moves from machine j to j’, then the difference in load is

(Exact) potential function (1,1)(9,0) (0,9)(6,6) PD = P 4 = u 1 (C,C) – u 1 (D,C) = P 4 (C,C) – P 4 (D,C) u 2 (D,C) – u 2 (D,D) = P 4 (D,C) – P 4 (D,D) C C D D u 1 (C,D) – u 1 (D,D) = P 4 (C,D) – P 4 (D,D) u 2 (C,C) – u 2 (C,D) = P 4 (C,C) – P 4 (C,D) P 4 is a potential function for PD game A function P (from S to R) is an (exact) PF for a game G if it is a w-potential function for G with w i = 1 for every i

Generalized ordinal potential function (1,0)(2,0) (0,1) G’’ = P 5 = P 5 (A,B) – P 5 (A,A) > 0 implies that u 1 (A,B) – u 1 (A,A) > 0 but not that u 2 (A,B) – u 2 (A,A) > 0 A function P (from S to R) is an GOPF for a game G if for every player i u i (s -i, x) - u i (s -i, z) > 0 implies P(s -i, x) - P(s -i, z) > 0 for every x, z in S i and for every s -i in S -i P 5 is a generalized ordinal potential function for the game G’’ P 5 is not an ordinal potential function for the game G’’ A A B B

Potential games A game that admits an OPF is called an ordinal potential game A game that admits a weighted PF is called a weighted potential game A game that admits an exact PF is called a potential game In such games a Nash equilibrium is a local maximum for the potential

Equilibria in Potential Games Thm (MS96) Let G be an ordinal potential game (P is an OPF). A strategy profile s in S is a pure equilibrium point for G iff for every player i it holds P(s) ≥ P(s -i, x) for every x in S i Therefore, if P has maximal value in S, then G has a pure Nash equilibrium. Corollary Every finite OP game has a pure Nash equilibrium.

Nash equilibrium P 4 maximal value An example (1,1)(9,0) (0,9)(6,6) PD = C C D D P 4 = (4,4)(3,3) (0,0) PD(P 4 ) = C C D D Thm (MS96)

FIP: an important property A path in S is a sequence of states s.t. between every consecutive pair of states there is only one deviator A path is an improvement path w.r.t. G if each deviator has a strict advantage u i (s k ) > u i (s k-1 ) G has the FIP if every improvement path is finite Clearly if G has the FIP then G has at least one pure equilibrium  Every improvement path terminates in an equilibrium point

FIP: an important property (2) Lemma Every finite OP game has the FIP. The converse is true? Lemma Let G be a finite game. Then, G has the FIP iff G has a generalized ordinal potential function. (1,0)(2,0) (0,1) G’’ = A A B B G’’ has the FIP ((B,A) is an equilibrium) any OPF must satisfies the following impossible relations: P(A,A) < P(B,A) < P(B,B) < P(A,B) = P(A,A) “No”

FIP: an important property (3) Lemma Let G be a finite game. Then, G has the FIP iff G has a generalized ordinal potential function. Proof: Consider the graph of strict improvement moves. Give v the potential function value = the length of the longest path to a sink

Congestion vs (Exact) Potential Games Thm Every congestion game is an (exact) potential game. Thm Every finite (exact) potential game is isomorphic to a congestion game.

Congestion vs (Exact) Potential Games Thm Every finite (exact) potential game is isomorphic to a congestion game. Potential game: n players, k pure strategies each, potential P Congestion game: n players, k pure strategies each, 2 kn resources resource associated with {0,1} kn vector

Congestion vs (Exact) Potential Games Thm Every finite (exact) potential game is isomorphic to a congestion game. Congestion game: player 1 ≤ i ≤n plays pure strategy 0 ≤ q ≤ k-1: uses all resources r b where bit b ik+q = 1 (2 kn-1 res.) For every strategy vector s (for both games) b(s) where b(s) ik+q = 1 iff player i uses q in s For n agents, the cost of r b(s) is P(s), for less agents the cost is 0 For agent i, let b’ be such that b’ jk+q = 0 if user j≠i uses strategy q, 1 otherwise. Cost of resource r b’ with one user u i (s)-P(s)

Final project part 1 Improve the construction (use less resources) Why?

Computing NE in congestion games Sometimes easy (polytime) – symmetric network congestion games Sometimes hard (PLS complete) – general congestion games, symmetric congestion games, general network congestion games

Symmetric network congestion games (easy) Graph G=(V,E), source vertex v, sink t n players need to find a path from v to t. Congestion on edge e is given by c(e,k) where k is the number of players using the edge (c ≥ 0) Cost to player is sum of costs of edges player uses.

Symmetric network congestion games (easy) (s –strategy, v – source, confusing) Convert to min-cost flow Replace edge e in G with n parallel links, of capacity 1, and with costs c(e,1), c(e,2), … c(e,n) The cost of a min cost flow of value n, (strategy s), from v to t is equal to the potential function

Hardness results: Total Search Problems – TFNP A search problem S is a set of inputs I S  * Such that:  For every x  I S there is an associated set of solutions  Recognizing if y is a solution can be done in polytime  A search problem is total if S x is not empty, for all x  r-Nash (r player Nash, normal form) is total, needs accuracy parameter as input (true Nash can be irrational)

Total Search Problems – TFNP A search problem S is a set of inputs I S  * Such that:  For every x  I S there is an associated set of solutions  Recognizing if y is a solution can be done in polytime  A search problem is total if S x is not empty, for all x  r-Nash (r player Nash, normal form) is total, needs accuracy parameter as input (true Nash can be irrational)

Subclasses of TFNP – PPAD and PLS PPAD: Polynomial Parity Argument, Directed Version (or just that Papadimitriou has two p’s). End of Line problem:  n input bit circuits P and S (predecessor and successor)  S(00…0) ≠ 00….0, P(00…0)=00…0  Find the end of the line (S(x)=x) or a loop (P(S(x))=x. PPAD – class of total search problems reducible to “end of line”. In particular – includes Brower Fixed point (discrete version) PPAD complete – natural notion. Brower is complete, 2 Player Nash is also complete. We saw how to use Brower to solve Nash, other direction also works (major recent result – we will return to it when I understand it).

Subclasses of TFNP – PPAD and PLS PLS: Polynomial Local Search A local search problem P belongs to PLS if:  For every instance I, a polytime algorithm A computes an initial feasible solution  A polytime algorithm B that computes, for every instance I and every feasible solution S, the objective function value c(S)  A polytime algorithm C that determines if S is locally optimal for instance I, and if not gives a better solution in the neighborhood of I

PLS reductions PLS: Polynomial Local Search A PLS reduction from Problem P to Problem Q:  A polytime function f that takes instances of P {I P } to instances of Q {I Q }  A polytime function g that maps pairs (S Q,I P ) to solutions S P of I P. (S Q is a solution of f(I P )).  For all instances I P of P, if S Q is a local optimum of f(I P ) then g(S Q,IP) is a local optimum of I P. P is PLS-Complete – all problems in PLS are PLS reducible to P

PLS Complete problem – max cut (political party game) Undirected graph G, weights on edges Find a partition of the vertices so that the sum of the weights of edges crossing the cut is maximized (minimize disagreements within the party, high weight – high disagreement)

NE in a congestion game is PLS complete (even a symmetric congestion game) For every edge e of weight w: two resources: r e R and r e L Every player u has two pure strategies:  Use all resources (r e L ) for e = (u,v)  Use all resources (r e R ) for e = (u,v)  If r e {L,R} is used by one player only, the cost is zero, if used by two, the cost is the weight of e