S-Chord: Using Symmetry to Improve Lookup Efficiency in Chord

Slides:



Advertisements
Similar presentations
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
Advertisements

Peer to Peer and Distributed Hash Tables
Pastry Peter Druschel, Rice University Antony Rowstron, Microsoft Research UK Some slides are borrowed from the original presentation by the authors.
Scalable Content-Addressable Network Lintao Liu
CHORD – peer to peer lookup protocol Shankar Karthik Vaithianathan & Aravind Sivaraman University of Central Florida.
PDPTA03, Las Vegas, June S-Chord: Using Symmetry to Improve Lookup Efficiency in Chord Valentin Mesaros 1, Bruno Carton 2, and Peter Van Roy 1 1.
Technische Universität Chemnitz Kurt Tutschku Vertretung - Professur Rechner- netze und verteilte Systeme Chord - A Distributed Hash Table Yimei Liao.
The Chord P2P Network Some slides have been borowed from the original presentation by the authors.
CHORD: A Peer-to-Peer Lookup Service CHORD: A Peer-to-Peer Lookup Service Ion StoicaRobert Morris David R. Karger M. Frans Kaashoek Hari Balakrishnan Presented.
Chord: A Scalable Peer-to-peer Lookup Protocol for Internet Applications Speaker: Cathrin Weiß 11/23/2004 Proseminar Peer-to-Peer Information Systems.
Ion Stoica, Robert Morris, David Liben-Nowell, David R. Karger, M
Chord: A scalable peer-to- peer lookup service for Internet applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashock, Hari Balakrishnan.
1 1 Chord: A scalable Peer-to-peer Lookup Service for Internet Applications Dariotaki Roula
Peer-to-Peer Distributed Search. Peer-to-Peer Networks A pure peer-to-peer network is a collection of nodes or peers that: 1.Are autonomous: participants.
Common approach 1. Define space: assign random ID (160-bit) to each node and key 2. Define a metric topology in this space,  that is, the space of keys.
Peer to Peer File Sharing Huseyin Ozgur TAN. What is Peer-to-Peer?  Every node is designed to(but may not by user choice) provide some service that helps.
Topics in Reliable Distributed Systems Lecture 2, Fall Dr. Idit Keidar.
Scalable Resource Information Service for Computational Grids Nian-Feng Tzeng Center for Advanced Computer Studies University of Louisiana at Lafayette.
Chord: A Scalable Peer-to-Peer Lookup Protocol for Internet Applications Stoica et al. Presented by Tam Chantem March 30, 2007.
University of Oregon Slides from Gotz and Wehrle + Chord paper
Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek and Hari alakrishnan.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
Topics in Reliable Distributed Systems Fall Dr. Idit Keidar.
1 CS 194: Distributed Systems Distributed Hash Tables Scott Shenker and Ion Stoica Computer Science Division Department of Electrical Engineering and Computer.
Wide-area cooperative storage with CFS
File Sharing : Hash/Lookup Yossi Shasho (HW in last slide) Based on Chord: A Scalable Peer-to-peer Lookup Service for Internet ApplicationsChord: A Scalable.
INTRODUCTION TO PEER TO PEER NETWORKS Z.M. Joseph CSE 6392 – DB Exploration Spring 2006 CSE, UT Arlington.
Effizientes Routing in P2P Netzwerken Chord: A Scalable Peer-to- peer Lookup Protocol for Internet Applications Dennis Schade.
Content Overlays (Nick Feamster). 2 Content Overlays Distributed content storage and retrieval Two primary approaches: –Structured overlay –Unstructured.
Overlay network concept Case study: Distributed Hash table (DHT) Case study: Distributed Hash table (DHT)
1 Reading Report 5 Yin Chen 2 Mar 2004 Reference: Chord: A Scalable Peer-To-Peer Lookup Service for Internet Applications, Ion Stoica, Robert Morris, david.
Chord: A Scalable Peer-to-peer Lookup Protocol for Internet Applications Xiaozhou Li COS 461: Computer Networks (precept 04/06/12) Princeton University.
Network Computing Laboratory Scalable File Sharing System Using Distributed Hash Table Idea Proposal April 14, 2005 Presentation by Jaesun Han.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
PSI Peer Search Infrastructure. Introduction What are P2P Networks? The term "peer-to-peer" refers to a class of systems and applications that employ.
A Scalable Content-Addressable Network (CAN) Seminar “Peer-to-peer Information Systems” Speaker Vladimir Eske Advisor Dr. Ralf Schenkel November 2003.
Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications.
Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan Presented.
SIGCOMM 2001 Lecture slides by Dr. Yingwu Zhu Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications.
Lecture 2 Distributed Hash Table
1 Peer-to-Peer Technologies Seminar by: Kunal Goswami (05IT6006) School of Information Technology Guided by: Prof. C.R.Mandal, School of Information Technology.
Lecture 12 Distributed Hash Tables CPE 401/601 Computer Network Systems slides are modified from Jennifer Rexford.
Algorithms and Techniques in Structured Scalable Peer-to-Peer Networks
LOOKING UP DATA IN P2P SYSTEMS Hari Balakrishnan M. Frans Kaashoek David Karger Robert Morris Ion Stoica MIT LCS.
Two Peer-to-Peer Networking Approaches Ken Calvert Net Seminar, 23 October 2001 Note: Many slides “borrowed” from S. Ratnasamy’s Qualifying Exam talk.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
CS694 - DHT1 Distributed Hash Table Systems Hui Zhang University of Southern California.
Distributed Hash Tables (DHT) Jukka K. Nurminen *Adapted from slides provided by Stefan Götz and Klaus Wehrle (University of Tübingen)
Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications * CS587x Lecture Department of Computer Science Iowa State University *I. Stoica,
Chapter 29 Peer-to-Peer Paradigm Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
The Chord P2P Network Some slides taken from the original presentation by the authors.
A Survey of Peer-to-Peer Content Distribution Technologies Stephanos Androutsellis-Theotokis and Diomidis Spinellis ACM Computing Surveys, December 2004.
Ion Stoica, Robert Morris, David Liben-Nowell, David R. Karger, M
The Chord P2P Network Some slides have been borrowed from the original presentation by the authors.
Distributed Hash Tables
A Scalable Peer-to-peer Lookup Service for Internet Applications
Peer-to-Peer Data Management
(slides by Nick Feamster)
Improving and Generalizing Chord
P2PS: a Peer-to-Peer Development Platform
EE 122: Peer-to-Peer (P2P) Networks
DHT Routing Geometries and Chord
Dewan Tanvir Ahmed and Shervin Shirmohammadi
Prof. Leonardo Mostarda University of Camerino
Koorde: A simple degree optimal DHT
P2P Systems and Distributed Hash Tables
A Semantic Peer-to-Peer Overlay for Web Services Discovery
MIT LCS Proceedings of the 2001 ACM SIGCOMM Conference
P2P: Distributed Hash Tables
#02 Peer to Peer Networking
Presentation transcript:

S-Chord: Using Symmetry to Improve Lookup Efficiency in Chord Valentin Mesaros1, Bruno Carton2, and Peter Van Roy1 1 Univ. catholique de Louvain, Belgium 2 Centre d’excellence CETIC, Belgium PDPTA03, Las Vegas, June 2003

Contents Context of the problem Chord overview Using symmetry to improve lookup in Chord Conclusion and further work PDPTA03, Las Vegas, June 2003

Context of the problem what is p2p? why p2p? - a system where the components are “equal” - there is no central point of failure - virtual (overlay) network at the application level - ... why p2p? - increase system scalability - avoid single point of failure - achieve better load balancing - enable resource aggregation PDPTA03, Las Vegas, June 2003

Examples of p2p systems hybrid (client/server) “pure” p2p R = N-1 (hub) R = 1 (others) H = 1 hybrid (client/server) - Napster “pure” p2p - Gnutella Distributed Hash Table (DHT) - Chord R = ? (variable) H = 1…7 (but no guarantee) R = log N H = log N (with guarantee) PDPTA03, Las Vegas, June 2003

Chord: overview Chord is a p2p system based on binary search the search space is organized as a virtual ring of size N - an entity is assigned an m-bit identifier, - a node has a well determined place within the virtual ring - a node has a predecessor and a successor - a node has log2N fingers (= entries in routing table): finger start finger node - a node stores the keys between its predecessor and itself PDPTA03, Las Vegas, June 2003

The fingers at node 1 in a poorly populated Chord system of size 64 PDPTA03, Las Vegas, June 2003

Chord: scalable lookup given a system of size N with each node having a routing table of size log2N, resolve any key in max log2N hops to look for key k at node n - check whether k is found between n and the successor of n - otherwise, forward the request to the closest finger preceding k PDPTA03, Las Vegas, June 2003

Path queries for keys 14 and 58, starting node 1, in a poorly populated Chord system of size 64 PDPTA03, Las Vegas, June 2003

Chord: drawbacks weak support for full-duplex protocols/applications - due to the asymmetric routing cost : nr_of_hops( p  n )  nr_of_hops( n  p ) a node can not make in-place notifications (joining/leaving) - due to the asymmetric organization the routing exploiting the underlying network proximity is not straightforward - the choice for the nearest neighborhood is not flexible - each node must connect the right corresponding predecessor and successor PDPTA03, Las Vegas, June 2003

Using symmetry to improve Chord S-Chord: possible solution to some of the drawbacks of Chord - introduce symmetry in the routing organization * routing cost symmetry : nr_of_hops( p  n )  nr_of_hops( n  p ) * routing entry symmetry : if n points to p then p points to n improve lookup efficiency - for the same size of the routing table, resolve a key in 25% less hops for the worst case, and in 10% less hops in average PDPTA03, Las Vegas, June 2003

S-Chord: the finger table S-Chord is based on Chord the search space is organized as a virtual ring of size N - a node has a predecessor and a successor - a node stores the keys between its predecessor and itself - a node has 2*m fingers (where m = ) finger start finger node PDPTA03, Las Vegas, June 2003

The fingers at node 1 in a poorly populated S-Chord system of size 64 PDPTA03, Las Vegas, June 2003

S-Chord: the finger responsibility the finger responsibility is used when routing the lookup queries the search space at a node is split among its fingers a finger is situated inside the domain it is responsible for PDPTA03, Las Vegas, June 2003

The fingers and their responsibility at node 1 in a fully populated S-Chord system of size 64 The responsibility of finger i of a node starts from the half way point between it and finger i-1, and ends at the half way point between it and finger i+1 PDPTA03, Las Vegas, June 2003

The fingers and their responsibilities at node 1 in a poorly populated S-Chord system of size 64 PDPTA03, Las Vegas, June 2003

S-Chord: scalable lookup to look for key k at node n - check whether k is found between the predecessor and successor of n - otherwise, forward the request to the finger whose responsibility includes k resolve any key in max hops (i.e., 25% better than log2N in Chord) at each suite of three steps the distance to the node storing the key is reduced by a factor of 16, while in Chord it’s reduced by 8 e.g., in S-Chord the distance is reduced by 256 in 6 hops, rather than in 8 hops in Chord PDPTA03, Las Vegas, June 2003

R1(3) ]1233] R18(5) ]8 15] R1(5) ]5563] Path queries for keys 14 and 58, starting node 1, in a poorly populated S_Chord system of size 64 PDPTA03, Las Vegas, June 2003

S-Chord: simulation (I) distribution of the path length in Chord and S-Chord for N = 216 PDPTA03, Las Vegas, June 2003

S-Chord: simulation (II) worst case and average path length function the network size for Chord and S-Chord (fully populated) PDPTA03, Las Vegas, June 2003

S-Chord: simulation (III) distance variation between pairs of nodes in Chord and S-Chord, measured for two poorly populated (1024 nodes) systems of size 212 and 220 PDPTA03, Las Vegas, June 2003

Conclusion and further work S-Chord improves lookup efficiency in terms of hops - investigation an optimal method to select fingers - parameterize finger selection in order to choose the tradeoff between routing table size and lookup efficiency S-Chord improves routing table update by enabling in-place notifications investigation of other benefits of the symmetry bring other functionality than key based routing such as Decentralized Object Location and Routing (DOLR) and group anycast/multicast PDPTA03, Las Vegas, June 2003