Distributed Placement of Service Facilities in Large-Scale Networks *Nikolaos Laoutaris Postdoc Fellow Harvard University Joint.

Slides:



Advertisements
Similar presentations
Topology The physical topology of a network refers to the configuration of cables, computers and other peripherals. The main types of network topologies.
Advertisements

1 Computational Asset Description for Cyber Experiment Support using OWL Telcordia Contact: Marian Nodine Telcordia Technologies Applied Research
Kick-off Meeting, July 28, 2008 ONR MURI: NexGeNetSci Distributed Coordination, Consensus, and Coverage in Networked Dynamic Systems Ali Jadbabaie Electrical.
Cloud Computing Resource provisioning Keke Chen. Outline  For Web applications statistical Learning and automatic control for datacenters  For data.
All Hands Meeting, 2006 Title: Grid Workflow Scheduling in WOSE (Workflow Optimisation Services for e- Science Applications) Authors: Yash Patel, Andrew.
Progress in inferring business relationships between ASs Dmitri Krioukov 4 th CAIDA-WIDE Workshop.
Navigating Nets: Simple algorithms for proximity search Robert Krauthgamer (IBM Almaden) Joint work with James R. Lee (UC Berkeley)
Implications of Selfish Neighbor Selection in Overlay Networks *Nikolaos Laoutaris Postdoc Fellow Harvard University Joint work.
The Cache Location Problem IEEE/ACM Transactions on Networking, Vol. 8, No. 5, October 2000 P. Krishnan, Danny Raz, Member, IEEE, and Yuval Shavitt, Member,
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
IPlane: An Information Plane for Distributed Services Offence by: Anup Goyal Sagar Vemuri.
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
Correctness. Until now We’ve seen how to define dataflow analyses How do we know our analyses are correct? We could reason about each individual analysis.
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University
1 GENI: Global Environment for Network Innovations Jennifer Rexford On behalf of Allison Mankin (NSF)
FI-WARE – Future Internet Core Platform FI-WARE Cloud Hosting July 2011 High-level description.
Building Low-Diameter P2P Networks Eli Upfal Department of Computer Science Brown University Joint work with Gopal Pandurangan and Prabhakar Raghavan.
Overlay Network Creation and Maintenance with Selfish Users Georgios Smaragdakis Dissertation committee members: Azer Bestavros, Nikolaos Laoutaris, John.
1 Caching/storage problems and solutions in wireless sensor network Bin Tang CSE 658 Seminar on Wireless and Mobile Networking.
Version Control Systems Phil Pratt-Szeliga Fall 2010.
Scaling Service Requests Linux: ipvsadm & iptoip.
Object Naming & Content based Object Search 2/3/2003.
“A Feedback Control Approach to Mitigating Mistreatment in Distributed Caching Groups ” Georgios Smaragdakis, Nikolaos Laoutaris, Azer Bestavros, Ibrahim.
1 Mistreatment in Distributed Caching Groups: Causes and Implications Nikolaos Laoutaris †‡, Georgios Smaragdakis †, Azer Bestavros †, ‡ Ioannis Stavrakakis.
Swarming on Optimized Graphs for n-way Broadcast Georgios Smaragdakis joint work with Nikolaos Laoutaris, Pietro Michiardi, Azer Bestavros, John Byers,
1 Distributed Selfish Replication Nikolaos Laoutaris Orestis Telelis Vassilios Zissimopoulos Ioannis Stavrakakis
Geographic Routing Without Location Information A. Rao, C. Papadimitriou, S. Shenker, and I. Stoica In Proceedings of the 9th Annual international Conference.
1 Introducing Scenario Network Data Editing and Enterprise GIS January 27, 2010 Minhua Wang, Ph.D. Citilabs, Inc.
Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)
Jennifer Rexford Princeton University MW 11:00am-12:20pm Data-Center Traffic Management COS 597E: Software Defined Networking.
Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.
Damian Gordon.  When we hook up computers together using data communication facilities, we call this a computer network.
Introduction to compact routing Dmitri Krioukov UCSD/CAIDA IDRWS 2004.
(ITI310) By Eng. BASSEM ALSAID SESSIONS 8: Network Load Balancing (NLB)
ACDN: A CDN for Applications Pradnya Karbhari Michael Rabinovich Zhen Xiao Fred Douglis AT&T Labs -- Research.
INTRODUCTION TO CLOUD COMPUTING Cs 595 Lecture 5 2/11/2015.
Dynamics AX Technical Overview Application Architecture Dynamics AX Technical Overview.
C LIENT /S ERVER AND P EER TO P EER National 4/5 Computing Science.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
A Projection Framework for Near- Potential Polynomial Games Nikolai Matni Control and Dynamical Systems, California.
PIC: Practical Internet Coordinates for Distance Estimation Manuel Costa joint work with Miguel Castro, Ant Rowstron, Peter Key Microsoft Research Cambridge.
The Minimal Communication Cost of Gathering Correlated Data over Sensor Networks EL 736 Final Project Bo Zhang.
GeoGrid: A scalable Location Service Network Authors: J.Zhang, G.Zhang, L.Liu Georgia Institute of Technology presented by Olga Weiss Com S 587x, Fall.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
Network Aware Resource Allocation in Distributed Clouds.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
Scalable and Fully Distributed Localization With Mere Connectivity.
Optimal Client-Server Assignment for Internet Distributed Systems.
INTRODUCTION TO NETWORKING: DEFINITIONS BY QUINN FRANKLIN.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
Microsoft Management Seminar Series SMS 2003 Change Management.
Introduction to Computer Networks Dr. Sanjay P. Ahuja, Ph.D FIS Distinguished Professor of Computer Science School of Computing, UNF.
Introduction to compact routing Dmitri Krioukov UCSD/CAIDA 3 rd CAIDA-WIDE Workshop.
Efficient Live Checkpointing Mechanisms for computation and memory-intensive VMs in a data center Kasidit Chanchio Vasabilab Dept of Computer Science,
Network Computing Laboratory 1 Vivaldi: A Decentralized Network Coordinate System Authors: Frank Dabek, Russ Cox, Frans Kaashoek, Robert Morris MIT Published.
Alex Chee Daniel LaBare Mike Oster John Spann Bryan Unbangluang Collaborative Document Sharing In Conjunction With.
Middleware issues: From P2P systems to Ad Hoc Networks
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Incrementally Improving Lookup Latency in Distributed Hash Table Systems Hui Zhang 1, Ashish Goel 2, Ramesh Govindan 1 1 University of Southern California.
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
Experience of PROOF cluster Installation and operation
Topology The physical topology of a network refers to the configuration of cables, computers and other peripherals. The main types of network topologies.
Network Configurations
Call to Fix QuickBooks Error
QuickBooks Error Support for QuickBooks Errors
VDN: Virtual Machine Image Distribution Network for Cloud Data Centers
Introducing Scenario Network Data Editing and Enterprise GIS
Introducing Citilabs’ Scenario Based Master Network Data Model
Client/Server and Peer to Peer
Presentation transcript:

Distributed Placement of Service Facilities in Large-Scale Networks *Nikolaos Laoutaris Postdoc Fellow Harvard University Joint work with: Georgios Smaragdakis †, Konstantinos Oikonomou ‡, Ioannis Stavrakakis §, Azer Bestavros † § U. Athens, ‡ Ionian U., † Boston U. IEEE INFOCOM 2007 – Anchorage * Sponsored under a Marie Curie Outgoing International Fellowship of the EU at Boston University and the University of Athens

2/14 Where to install the service facility? Distribution of software updates and patches (e.g., Windows Update) Real time distribution of virus definition files Fixed deployment Dynamic deployment time-of-day effects flash crowds Being able to adjust the number and the location of service facilities dynamically should be more economic than fixed over-provisioning…

3/14 A setting for dynamic service deployment Generic Service Host Service Facility Flash Crowd

4/14 Let’s abstract the problem We have: a network (let’s think AS-level granularity) a demand (# downloads from each AS) We want: [the number of service facilities] their location Theory has the solution Uncapacitated k-median Uncapacitated facility location a server (software) a request a really nice read

5/14 UKM and UFL Uncapacited K-median (UKM): Given a set of points V with pair-wise distance function d and service demands s(v j ), ∀ v j ∈ V, select up to k points to act as medians (facilities) so as to minimize the service cost C(V,s,k): where m(v j ) is the median that is closer to v j. Uncapacited Facility Location (UFL): Given a set of points V with pair-wise distance function d, service demands s(v j ), ∀ v j ∈ V, and facility costs f(v j ), ∀ v j ∈ V, select a subset of points F to act as facilities so as to minimize:

6/14 Centralized UKM and UFL: Not very practical for Internet-scale applications Limitations: need entire topology and demand information in one place one BIG computation no way for incremental re-optimization We need distributed versions: using limited local topology/demand info employing multiple small computations keeping changes local Previous work: Moscibroda & Wattenhofer (PODC’05)

7/14 Common framework for distributed UKM and UFL Initialization: select an initial set of nodes to be the facilities Iterative improvement: select an existing facility and “process” it using local information only change its location (in the case of UKM) change its location and/or merge it with other facilities or spawn additional copies of it (in the case of UFL) continue with the next facility in round-robin manner Stopping condition: when “processing” yields no improvement for any facility

8/14 r-ball (r=2) r-ball (r=1) Processing a facility const # facilities  1-median in r-ball var # facilities  UFL in r-ball but there is a PROBLEM nodes outside the r-ball … are totally neglected and a SOLUTION to it map ring demand on the “skin” of the r-ball “ring” nodes

9/14 Intersecting r-balls merge into r-shapes when 2 or more r-balls intersect we merge them if J facilities in the r- shape J-median (const facilities) UFL (var facilities) r-shape provides for a way to reduce the # facilities if needed we put a restriction on the max-size of r-shapes r-ball r-shape

10/14 Selecting the radius r Small radius: + limited local information for the r-balls (scalability) − performance penalty (easier to run into bad local minima) Since most networks are small- worlds  we keep r small (1≤r≤3)

11/14 Case Study: The AS-level Topology 497 peer AS’s in the core of the Internet (Subramanian et al. ’02) load s(v j )= # AS’s with costumer-provider relationship to v j distance d(v i,v j )= # intermediate AS’s from v i  v j centralized vs distributed UKM vs dUKM(r) UFL vs dUFL(r) social cost and # iterations

12/14 Placing k servers on the AS-level map 1% 3% 5% #facilities: % of nodes 1% 3% 5% #facilities: % of nodes

13/14 Selecting the right number of servers aka dUFL(r) Need a model for f(v j ), the cost of placing a server at GSH v j Uniform: all GSH’s charge the same Degree-based: proportional to the degree of v j

14/14 Wrap up Placement of service facility can be casted as a discrete location problem Existing centralized solutions are not practical Instead  multiple local re-optimizations exact info for a limited neighborhood of radius r approximate info for the surrounding “ring” Good approximation (experimental) even for very small radius

Thank you Q ?