Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign.

Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign

Acknowledgements Shripad Gade Lili Su

x x1 x2 Applications f1(x) f2(x) i
fi(x) = cost for robot i to go to location x Minimize total cost of rendezvous x f1(x) f2(x) x1 x2 Other examples may be: resource allocation (which is similar to robotic rendezvous problems), large-scale distributed machine learning, where data are generated at different locations i

Applications f1(x) f2(x) Learning Minimize cost Σ fi(x) i f3(x) f4(x)

Outline i Privacy Fault-tolerance Distributed Optimization 𝑓 3 𝑓 2 𝑓 4
𝑓 5 𝑓 1 Privacy 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 Fault-tolerance 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 Distributed Optimization

Distributed Optimization
Server 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 𝑓 1 𝑓 2 𝑓 3

Client-Server Architecture
f1(x) f2(x) 𝑓 1 𝑓 2 𝑓 3 f3(x) f4(x)

Server maintains estimate 𝑥 𝑘 Client i knows 𝑓 𝑖 (𝑥) 𝑥 𝑘 𝑓 1 Server 𝑓 2 𝑓 3

Server maintains estimate 𝑥 𝑘 Client i knows 𝑓 𝑖 (𝑥) In iteration k+1 Client i Download 𝑥 𝑘 from server Upload gradient 𝛻 𝑓 𝑖 ( 𝑥 𝑘 ) 𝑥 𝑘 𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 )

Server maintains estimate 𝑥 𝑘 Client i knows 𝑓 𝑖 (𝑥) In iteration k+1 Client i Download 𝑥 𝑘 from server Upload gradient 𝛻 𝑓 𝑖 ( 𝑥 𝑘 ) Server 𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝑖 𝛻 𝑓 𝑖 𝑥 𝑘 𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 )

Variations Stochastic Asynchronous …

Peer-to-Peer Architecture
f1(x) f2(x) 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 f3(x) f4(x)

Each agent maintains local estimate x Consensus step with neighbors Apply own gradient to own estimate 𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝛻 𝑓 𝑖 𝑥 𝑘 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 )

Server observes gradients  privacy compromised
𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 ) Server observes gradients  privacy compromised

Achieve privacy and yet collaboratively optimize
𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 ) Server observes gradients  privacy compromised Achieve privacy and yet collaboratively optimize

Related Work Cryptographic methods (homomorphic encryption)
Function transformation Differential privacy

Differential Privacy 𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 𝑥 𝑘 +𝜺𝒌

Trade-off privacy with accuracy
Differential Privacy 𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 𝑥 𝑘 +𝜺𝒌 Trade-off privacy with accuracy

Proposed Approach Motivated by secret sharing
Exploit diversity … Multiple servers / neighbors

Privacy if subset of servers adversarial
Proposed Approach Server 1 Server 2 𝑓 1 𝑓 2 𝑓 3 Privacy if subset of servers adversarial

Privacy if subset of neighbors adversarial
Proposed Approach 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 Privacy if subset of neighbors adversarial

Proposed Approach Structured noise that “cancels” over servers/neighbors

Intuition x1 x2 Server 1 Server 2 𝑓 1 𝑓 2 𝑓 3

x2 x1 Intuition 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31 𝑓 32 Server 1 Server 2
Each client simulates multiple clients

𝑓 𝑖𝑗 (𝑥) not necessarily convex
Intuition x1 x2 Server 1 Server 2 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31 𝑓 32 𝑓 11 (𝑥) + 𝑓 𝑥 = 𝑓 𝑥 𝑓 𝑖𝑗 (𝑥) not necessarily convex

Algorithm Each server maintains an estimate In each iteration Client i
Download estimates from corresponding server Upload gradient of 𝑓 𝑖 Each server updates estimate using received gradients

Algorithm Each server maintains an estimate In each iteration Client i
Download estimates from corresponding server Upload gradient of 𝑓 𝑖 Each server updates estimate using received gradients Servers periodically exchange estimates to perform a consensus step

Claim Under suitable assumptions, servers eventually reach consensus in i

Privacy 𝑓 11 + 𝑓 21 + 𝑓 31 𝑓 21 + 𝑓 22 + 𝑓 32 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31
𝑓 𝑓 21 + 𝑓 31 𝑓 𝑓 22 + 𝑓 32 Server 1 Server 2 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31 𝑓 32

Privacy 𝑓 11 + 𝑓 21 + 𝑓 31 𝑓 21 + 𝑓 22 + 𝑓 32 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31
𝑓 𝑓 21 + 𝑓 31 𝑓 𝑓 22 + 𝑓 32 Server 1 may learn 𝑓 11 , 𝑓 21 , 𝑓 31 , 𝑓 𝑓 22 + 𝑓 32 Not sufficient to learn 𝑓 𝑖 Server 1 Server 2 𝑓 11 𝑓 12 𝑓 21 𝑓 22 𝑓 31 𝑓 32

𝑓 11 (𝑥) + 𝑓 𝑥 = 𝑓 𝑥 Function splitting not necessarily practical Structured randomization as an alternative

Structured Randomization
Multiplicative or additive noise in gradients Noise cancels over servers

Multiplicative Noise x1 x2 Server 1 Server 2 𝑓 1 𝑓 2 𝑓 3

x2 x1 𝛼𝛻 𝑓 1 (x1) 𝛽𝛻 𝑓 1 (𝑥2) 𝛼+𝛽=1 Multiplicative Noise 𝑓 1 𝑓 2 𝑓 3
Server 1 Server 2 𝛼𝛻 𝑓 1 (x1) 𝛽𝛻 𝑓 1 (𝑥2) 𝑓 1 𝑓 2 𝑓 3 𝛼+𝛽=1

Server 1 Server 2 𝛼𝛻 𝑓 1 (x1) 𝛽𝛻 𝑓 1 (𝑥2) 𝑓 1 𝑓 2 𝑓 3 Suffices for this invariant to hold over a larger number of iterations 𝛼+𝛽=1

Server 1 Server 2 𝛼𝛻 𝑓 1 (x1) 𝛽𝛻 𝑓 1 (𝑥2) 𝑓 1 𝑓 2 𝑓 3 Noise from client i to server j not zero-mean 𝛼+𝛽=1

Claim Under suitable assumptions, servers eventually reach consensus in i

𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝛻 𝑓 𝑖 𝑥 𝑘 Reminder … 𝑓 1 𝑓 3 𝑓 2 𝑓 5 𝑓 4
Each agent maintains local estimate x Consensus step with neighbors Apply own gradient to own estimate 𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝛻 𝑓 𝑖 𝑥 𝑘 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

Proposed Approach 𝑓 1 𝑓 3 𝑓 2 𝑓 5 𝑓 4
Each agent shares noisy estimate with neighbors Scheme 1 – Noise cancels over neighbors Scheme 2 – Noise cancels network-wide 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

ε1 + ε2 = 0 (over iterations)
Proposed Approach Each agent shares noisy estimate with neighbors Scheme 1 – Noise cancels over neighbors Scheme 2 – Noise cancels network-wide x + ε1 ε1 + ε2 = (over iterations) 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1 x + ε2

Poster today Shripad Gade

Fault-Tolerance Some agents may be faulty
Need to produce “correct” output despite the faults

Byzantine Fault Model No constraint on misbehavior of a faulty agent
May send bogus messages Faulty agents can collude

fi(x) = cost for robot i to go to location x Faulty agent may choose arbitrary cost function x f1(x) f2(x) x1 x2 Other examples may be: resource allocation (which is similar to robotic rendezvous problems), large-scale distributed machine learning, where data are generated at different locations

𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

𝑓 1 Server 𝑓 2 𝑓 3 𝛻 𝑓 𝑖 ( 𝑥 𝑘 )

Fault-Tolerant Optimization
The original problem is not meaningful i

The original problem is not meaningful Optimize cost over only non-faulty agents i i good

The original problem is not meaningful Optimize cost over only non-faulty agents i i good Impossible!

Optimize weighted cost over only non-faulty agents With 𝛂i as close to 1/ good as possible 𝛂i i good

Optimize weighted cost over only non-faulty agents 𝛂i i good With t Byzantine faulty agents: t weights may be 0

Optimize weighted cost over only non-faulty agents 𝛂i i good t Byzantine agents, n total agents At least n-2t weights guaranteed to be > 1/2(n-t)

Centralized Algorithm
Of the n agents, any t may be faulty How to filter cost functions of faulty agents? X

Centralized Algorithm: Scalar argument x
Define a virtual function G(x) whose gradient is obtained as follows

Define a virtual function G(x) whose gradient is obtained as follows At a given x Sort the gradients of the n local cost functions

Define a virtual function G(x) whose gradient is obtained as follows At a given x Sort the gradients of the n local cost functions Discard smallest t and largest t gradients

Define a virtual function G(x) whose gradient is obtained as follows At a given x Sort the gradients of the n local cost functions Discard smallest t and largest t gradients Mean of remaining gradients = Gradient of G at x

Define a virtual function G(x) whose gradient is obtained as follows At a given x Sort the gradients of the n local cost functions Discard smallest t and largest t gradients Mean of remaining gradients = Gradient of G at x Virtual function G(x) is convex

Define a virtual function G(x) whose gradient is obtained as follows At a given x Sort the gradients of the n local cost functions Discard smallest t and largest t gradients Mean of remaining gradients = Gradient of G at x Virtual function G(x) is convex  Can optimize easily

Peer-to-Peer Fault-Tolerant Optimization
Gradient filtering similar to centralized algorithm … require “rich enough” connectivity … correlation between functions helps Vector case harder … redundancy between functions helps

Summary i Privacy Fault-tolerance Distributed Optimization 𝑓 3 𝑓 2 𝑓 4

Thanks! disc.ece.illinois.edu

Distributed Peer-to-Peer Optimization
Each agent maintains local estimate x In each iteration Compute weighted average with neighbors’ estimates 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

Each agent maintains local estimate x In each iteration Compute weighted average with neighbors’ estimates Apply own gradient to own estimate 𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝛻 𝑓 𝑖 𝑥 𝑘 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

Each agent maintains local estimate x In each iteration Compute weighted average with neighbors’ estimates Apply own gradient to own estimate Local estimates converge to 𝑥 𝑘+1 ⟵ 𝑥 𝑘 − 𝛼 𝑘 𝛻 𝑓 𝑖 𝑥 𝑘 i 𝑓 3 𝑓 2 𝑓 4 𝑓 5 𝑓 1

RSS – Locally Balanced Perturbations Add to zero (locally per node)
Bounded (≤Δ) Algorithm Node j selects d k j,i such that i d k j,i =0 and 𝑑 𝑘 𝑗,𝑖 ≤Δ Share w k j,i = x k j + d k j,i with node i Consensus and (Stochastic) Gradient Descent

RSS – Network Balanced Perturbations Add to zero (over network)
Bounded (≤Δ) Algorithm Node j computes perturbation d k j - sends s j,i to i - add received s i,j and subtract sent s j,i ⇒ d k j = rcvd − sent Obfuscate state w k j = x k j + d k j shared with neighbors Consensus and (Stochastic) Gradient Descent

Convergence Let x j T = T α k x k j / T α k and α k =1/ k
𝑓 x j T −𝑓 𝑥 ∗ ≤𝒪 log 𝑇 𝑇 +𝒪 Δ 2 log 𝑇 𝑇 Asymptotic convergence of iterates to optimum Privacy-Convergence Trade-off Stochastic gradient updates work too

Function Sharing Let f i (x) be bounded degree polynomials Algorithm
Node j shares s j,i x with node i Node j obfuscates using p j x =∑ s i,j x −∑ s j,i (x) Use f j x = f j x + p j (x) and use distributed gradient descent

Function Sharing - Convergence
Function Sharing iterates converge to correct optimum (∑ f i x =f(x)) Privacy: If vertex connectivity of graph ≥ f then no group of f nodes can estimate true functions 𝑓 𝑖 (or any good subset) p j (x) is also similar to f j (x) then it can hide f i x well

Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign.

Similar presentations

Presentation on theme: "Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign.

Similar presentations

Presentation on theme: "Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign."— Presentation transcript:

Similar presentations

About project

Feedback