Building of P2P Overlay Networks via Voronoi and Gossip Ranieri Baraglia.

Slides:



Advertisements
Similar presentations
C. Mastroianni, D. Talia, O. Verta - A Super-Peer Model for Resource Discovery Services in Grids A Super-Peer Model for Building Resource Discovery Services.
Advertisements

Scalable and Dynamic Quorum Systems Moni Naor & Udi Wieder The Weizmann Institute of Science.
Peer to Peer and Distributed Hash Tables
Scalable Content-Addressable Network Lintao Liu
1 Greedy Forwarding in Dynamic Scale-Free Networks Embedded in Hyperbolic Metric Spaces Dmitri Krioukov CAIDA/UCSD Joint work with F. Papadopoulos, M.
A P2P REcommender system based on Gossip Overlays (PREGO) ‏ R.Baraglia, P.Dazzi M.Mordacchini, L.Ricci A P2P REcommender system based on Gossip Overlays.
Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp, Scott Schenker Presented by Greg Nims.
Self-Organizing Hierarchical Routing for Scalable Ad Hoc Networking David B. Johnson Department of Computer Science Rice University Monarch.
Common approach 1. Define space: assign random ID (160-bit) to each node and key 2. Define a metric topology in this space,  that is, the space of keys.
A Scalable Content Addressable Network (CAN)
Chien-Hao Chien, Shun-Yun Hu, Jehn-Ruey Jiang Adaptive Computing and Networking (ACN) Laboratory Department of Computer Science and Information Engineering.
Peer to Peer File Sharing Huseyin Ozgur TAN. What is Peer-to-Peer?  Every node is designed to(but may not by user choice) provide some service that helps.
Topics in Reliable Distributed Systems Lecture 2, Fall Dr. Idit Keidar.
CMPE 150- Introduction to Computer Networks 1 CMPE 150 Fall 2005 Lecture 22 Introduction to Computer Networks.
Dissemination protocols for large sensor networks Fan Ye, Haiyun Luo, Songwu Lu and Lixia Zhang Department of Computer Science UCLA Chien Kang Wu.
Geometric Spanners for Routing in Mobile Networks Jie Gao, Leonidas Guibas, John Hershberger, Li Zhang, An Zhu.
Mercury: Scalable Routing for Range Queries Ashwin R. Bharambe Carnegie Mellon University With Mukesh Agrawal, Srinivasan Seshan.
A Scalable Content-Addressable Network Authors: S. Ratnasamy, P. Francis, M. Handley, R. Karp, S. Shenker University of California, Berkeley Presenter:
Overlay Networks EECS 122: Lecture 18 Department of Electrical Engineering and Computer Sciences University of California Berkeley.
AOI cast Based Compass Routing in Distributed Virtual Environments Michele Albano, Luca Genovali Antonio Quartulli, Laura Ricci AOI CAST TOLERANCE BASED.
LSDS-IR’08, October 30, Peer-to-Peer Similarity Search over Widely Distributed Document Collections Christos Doulkeridis 1, Kjetil Nørvåg 2, Michalis.
XtreemOS IP project is funded by the European Commission under contract IST-FP XtreemOS WP3.2 - T3.2.3 Scalable Directory Service Design State.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
Ranking by Odds Ratio A Probability Model Approach let be a Boolean random variable: document d is relevant to query q otherwise Consider document d as.
Topics in Reliable Distributed Systems Fall Dr. Idit Keidar.
1 Random Walks in WSN 1.Efficient and Robust Query Processing in Dynamic Environments using Random Walk Techniques, Chen Avin, Carlos Brito, IPSN 2004.
Spatial Indexing I Point Access Methods. Spatial Indexing Point Access Methods (PAMs) vs Spatial Access Methods (SAMs) PAM: index only point data Hierarchical.
Hierarchical P2P Overlays for DVE: An Additively Weighted Voronoi Based Approach Michele Albano Luca Genovali Laura Ricci HIERARCHICAL P2P OVERLAYS FOR.
ICDE A Peer-to-peer Framework for Caching Range Queries Ozgur D. Sahin Abhishek Gupta Divyakant Agrawal Amr El Abbadi Department of Computer Science.
“Umbrella”: A novel fixed-size DHT protocol A.D. Sotiriou.
Spatial Indexing I Point Access Methods. Spatial Indexing Point Access Methods (PAMs) vs Spatial Access Methods (SAMs) PAM: index only point data Hierarchical.
Peer-to-peer file-sharing over mobile ad hoc networks Gang Ding and Bharat Bhargava Department of Computer Sciences Purdue University Pervasive Computing.
1CS 6401 Peer-to-Peer Networks Outline Overview Gnutella Structured Overlays BitTorrent.
Algorithms for Self-Organization and Adaptive Service Placement in Dynamic Distributed Systems Artur Andrzejak, Sven Graupner,Vadim Kotov, Holger Trinks.
Mobile Ad-hoc Pastry (MADPastry) Niloy Ganguly. Problem of normal DHT in MANET No co-relation between overlay logical hop and physical hop – Low bandwidth,
Roger ZimmermannCOMPSAC 2004, September 30 Spatial Data Query Support in Peer-to-Peer Systems Roger Zimmermann, Wei-Shinn Ku, and Haojun Wang Computer.
Other Structured P2P Systems CAN, BATON Lecture 4 1.
Peer-to-Peer Overlay Networks. Outline Overview of P2P overlay networks Applications of overlay networks Classification of overlay networks – Structured.
A Delaunay Triangulation Architecture Supporting Churn and User Mobility in MMVEs Mohsen Ghaffari, Behnoosh Hariri and Shervin Shirmohammadi Advanced Communications.
GeoGrid: A scalable Location Service Network Authors: J.Zhang, G.Zhang, L.Liu Georgia Institute of Technology presented by Olga Weiss Com S 587x, Fall.
A Distributed Architecture for Multi-dimensional Indexing and Data Retrieval in Grid Environments Athanasia Asiki, Katerina Doka, Ioannis Konstantinou,
Research Interests Georgia Koloniari Computer Science Department University of Ioannina, Greece.
Jonathan Walpole CSE515 - Distributed Computing Systems 1 Teaching Assistant for CSE515 Rahul Dubey.
Document retrieval Similarity –Vector space model –Multi dimension Search –Range query –KNN query Query processing example.
SOS: Security Overlay Service Angelos D. Keromytis, Vishal Misra, Daniel Rubenstein- Columbia University ACM SIGCOMM 2002 CONFERENCE, PITTSBURGH PA, AUG.
Systems and Internet Infrastructure Security (SIIS) LaboratoryPage Systems and Internet Infrastructure Security Network and Security Research Center Department.
Content Addressable Network CAN. The CAN is essentially a distributed Internet-scale hash table that maps file names to their location in the network.
A Scalable Content-Addressable Network (CAN) Seminar “Peer-to-peer Information Systems” Speaker Vladimir Eske Advisor Dr. Ralf Schenkel November 2003.
Gennaro Cordasco - How Much Independent Should Individual Contacts be to Form a Small-World? - 19/12/2006 How Much Independent Should Individual Contacts.
Scalable Content- Addressable Networks Prepared by Kuhan Paramsothy March 5, 2007.
A Membership Management Protocol for Mobile P2P Networks Mohamed Karim SBAI, Emna SALHI, Chadi BARAKAT.
P2P Group Meeting (ICS/FORTH) Monday, 28 March, 2005 A Scalable Content-Addressable Network Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp,
Semantic Overlay Networks in P2P systems A. Crespo, H. Garcia-Molina Speaker: Pavel Serdyukov Tutor: Jens Graupmann.
Plethora: Infrastructure and System Design. Introduction Peer-to-Peer (P2P) networks: –Self-organizing distributed systems –Nodes receive and provide.
BATON A Balanced Tree Structure for Peer-to-Peer Networks H. V. Jagadish, Beng Chin Ooi, Quang Hieu Vu.
Algorithms and Techniques in Structured Scalable Peer-to-Peer Networks
LOOKING UP DATA IN P2P SYSTEMS Hari Balakrishnan M. Frans Kaashoek David Karger Robert Morris Ion Stoica MIT LCS.
A configuration method for structured P2P overlay network considering delay variations Tomoya KITANI (Shizuoka Univ. 、 Japan) Yoshitaka NAKAMURA (NAIST,
Two Peer-to-Peer Networking Approaches Ken Calvert Net Seminar, 23 October 2001 Note: Many slides “borrowed” from S. Ratnasamy’s Qualifying Exam talk.
PeerNet: Pushing Peer-to-Peer Down the Stack Jakob Eriksson, Michalis Faloutsos, Srikanth Krishnamurthy University of California, Riverside.
INTERNET TECHNOLOGIES Week 10 Peer to Peer Paradigm 1.
P2P Search COP6731 Advanced Database Systems. P2P Computing  Powerful personal computer Share computing resources P2P Computing  Advantages: Shared.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
NCLAB 1 Supporting complex queries in a distributed manner without using DHT NodeWiz: Peer-to-Peer Resource Discovery for Grids Sujoy Basu, Sujata Banerjee,
Malugo – a scalable peer-to-peer storage system..
Incrementally Improving Lookup Latency in Distributed Hash Table Systems Hui Zhang 1, Ashish Goel 2, Ramesh Govindan 1 1 University of Southern California.
OntoZilla: An Ontology-based, Semi-structured, and Evolutionary P2P Network for Information Systems and Services 指導教授:李官陵 學 生:陳建博 蔡英傑
Spatial Indexing I Point Access Methods.
A Scalable content-addressable network
Paraskevi Raftopoulou, Euripides G.M. Petrakis
Presentation transcript:

Building of P2P Overlay Networks via Voronoi and Gossip Ranieri Baraglia

P2P Research Activity Starts in 2004 with the EU project CoreGRID NOE on Foundations, Software Infrastructure and Applications for large scale distributed, Grid and Peer-to-Peer Technologies ( ) Continued in the project CNR RSTL Resource Discovery on Large Collaborative Networks ( ) Currently Carried on in collaboration with Laura Ricci, Dep. of Computer Science of Pisa University Patrizio Dazzi, ISTI, CNR Matteo Mordacchini, IIT, CNR Michele Albano, Instituto de Telecomunicações, Campus Universitário Santiago Aveiro, Portugal 2

What we did? – Voronoi-based overlay to support range query multi attributes – Gossip–based overlay to support user communities detection – Building of Gossip-based Delaunay overlay 3

Voronoi-based overlay to support range query multi-attributes Motivation Searching in large networks is a basic functionality offered by P2P systems Most P2P systems exploit Distributed Hash Tables load balancing guaranteed by hashing function no support for complex queries (multi-attribute, range, k neighbor…) Several applications need complex queries distributed directory service geographic information system ………. Alternatives to DHT are currently investigated distributed tree data structures locality preserving hashing functions Voronoi-based overlay 4

Voronoi-based Overlays Let O = {o 1,..., o n } be a set of n distinct objects (sites) in a k-dimensional space S. Voronoi tessellation partitions S into n regions (cells) V(o j ), j= 1,..,n, paired with each o i  O, where V(o j ) includes all the points q such that: dist(q, o j ) ≤ dist(q,o i ) for i≠j Delaunay Triangulation connects two cells sharing a border (Voronoi neighbors) Voronoi Overlay = Delaunay links Geometrical properties of Delaunay triangulation exploited to define efficient routing strategies Compass Routing Indexed objects instead of physical nodes Each dimension represents an object’s attribute Each object is publisched in the point that corresponds to the values of its attributes 5

Compass Routing Compass Routing: A 5 chooses A as next hop because  RootA 5 A <  Root A 5 A 1 and  Root A 5 A <  Root A 5 A 4 Each node reverses compass routing to detect its sons in the AoI-cast tree: A 5 is the A next hop in the AoI-tree 6

Hivory: Range Queries on Hierarchical Voronoi Overlay Main features – Supports the execution of range query multi- attribute – Scalable solution – Small execution cost to publish an object and to execute a query – Structured to support fault tolerance 7

Hivory: Range Queries on Hierarchical Voronoi Overlay Basic ideas of our solution : Clustering of peers is exploited to define a hierarchy of Voronoi diagrams Each level of the hierarchy includes a set of 2-dimensional Voronoi diagrams is associated with a different pair of the objects’ attributes 8

Hivory: Superpeers Election When the size of a cluster exceeds a predefined threshold Log(k) peer are elected Superpeers, with k the cluster dimension A new Voronoi diagram at a lower level is built All the objects belonging to the cluster are mapped to that Voronoi diagram by exploiting a new pair of the objects' attributes 9 SuperPees={P 3, P 5,P 9 } SuperPees={P 10,P 4,P 11 }

Hivory: the Join Operation |cluster|< threshold = 4 P j requests to join O 3 C={o 1,o 2 } The join request of P j is propagated by the greedy routing to one of the peers (P i ) of the cluster C. The size of the new cluster is smaller than the threshold. P i notifies the identity of the new peer P j to the other peers of C. C={o 1,o 2,o 3 } 10

Hivory: the Join Operation |cluster|= threshold = 4 {O 1,O 2, O 5 } P j requests to join O 8 {P 1,P 2 } {o8}{o8} {o 5 } {o 2 } {o 1 } A new Voronoi diagram is created Log(|cluster|) peers are elected SupePeers 11

Hivory: the Join Operation |cluster|> threshold = 4 P 8 requests to join o 8 {P 1,P 2, P 8 } {o 3 } {o 4 } {o 2, o 8 } {o 1 } {P 1,P 2 } {o 3 } {o 4 } {o 2 } {o 1 } 12

13 Hivory: Range Query Resolution Greedy Routing to reach a o i within the AoI defined by a query Q AoI-cast: propagation of the query in the AoI -construction of a tree spanning the AoI through reverse compass routing If the next hop site for AoI-cast is paired with a cluster C, forward the query to P c randomly chosen from the peers belonging to C – size(C) ≥ threshold P c switches the query at the lower level the AoI defined by the lower level attributes is exploited to restrict the query space – size(C) < threshold P c broadcast the query to an other peer belonging to C

Hivory: Complexity Analysis We considered – A uniform distribution – A unbalanced distribution: one network x at level k with Nx ≈ N M: levels within the hierarchy, N: overall number of clusters, N j : # of clusters at level l i of the hierarchy (i  1…M), s i : combined selectivity of attributes at level N i. uniformunbalanced joinlog 2 N log 2 N M log 2 N x  log 2 N range queryM* s 1 *....*s M *Ns k * N x 14

Voronoi-based overlay M. Albano, L. Ricci, M. Baldanzi, R. Baraglia, "VoRaQue: Range queries on Voronoi overlays”, IEEE Computers and Communications, M. Albano, R. Baraglia, M. Mordacchini, L. Ricci, Efficient Broadcast on Area of Interest in Voronoi Overlays, International Conference on Computational Science and Engineering, M. Mordacchini, L. Ricci, L. Ferrucci, M. Albano, R. Baraglia, "Hivory: Range Queries on Hierarchical Voronoi Overlays”, IEEE Tenth International Conference on Peer-to-Peer Computing (P2P),

Group: A gossip-based protocol for community detection Motivations Identifying communities of users (nodes) with similar interests in distributed environments is a key point to obtain an efficient and efficacy information diffusion. This problem is even more important in highly dynamic systems such as peer-to-peer. Many solutions in the literature are limited to built "private" communities restricted to a list of neighbors of each peer. 16

Group: A gossip-based protocol for community detection Main features – Each user has associated a profile defining his/her interests – The profile may be constructed by considering purchase items, visited pages, resources accessed, …. – Exploits a gossip protocol to define clusters of peers characterized by similar interests according to a proper similarity metrics. – Solution completely distributed 17

Group: A gossip-based protocol for community detection A two-layered gossip framework. The sampling layer (Cyclon) is responsible for feeding the Vicinity layer, which discovers peers characterized by similar interests. The Group layer works on the built overlay and detects the communities in three steps: Identification of the leader candidates, Identification of the potential leaders, The leader election. The profile of the peer leader characterizes the related community. Peer leader profile exploited by no-leader peers to join a community. 18

Group: A gossip-based protocol for community detection Communities are dynamic entities. After a prefixed time interval each peer independently starts a new flow of votes. The Cyclon+Vicinity mechanism leads to have an updated peers’s neighborhood. 19

Gossip–based overlay for supporting user communities detection R. Baraglia, P. Dazzi, M. Mordacchini, L. Ricci, A P2P REcommender system based on Gossip Overlays (PREGO), 10th IEEE International Conference on Computer and Information Technology (CIT 2010), R. Baraglia, P. Dazzi, M. Mordacchini, R. Perego, L. Ricci, Gossip Communities: Collaborative Filtering Through Peer-to-Peer (Extended Abstract), SEB 2010, pages R. Baraglia, P. Dazzi, M. Mordacchini, L. Ricci, L. Alessi, GROUP: A Gossip Based Building Community Protocol, Smart Spaces and Next Generation Wired/Wireless Networking, Lecture Notes in Computer Science 2011, Volume 6869/2011. R. Baraglia, P. Dazzi, M. Mordacchini, L. Ricci, L- Alessi, On Democracy in Peer –to- Peer systems, CoRR abs/ , R. Baraglia, P. Dazzi, M. Mordacchini, L. Ricci, A Peer-to-Peer Recommender System for self-emerging user communities based on Gossip Overlays, Journal of Computer and Systems Sciences, Elsevier, 2012 (accepted) 20

GoDel: A Gossip-based Algorithm to Build Delaunay Overlay 21 Each node in the overlay is characterized by the (x,y) coordinates Combined use of Cyclon and Vicinity Exploits The Cyclon and Vicinity protocols for gathering information A distributed version of the Edge flipping algorithm Flipping for building Delaunay overlays. GODEL is a novel distributed algorithm that incrementally build a Delaunay 0verlay by exploiting information gathered by P2P gossip protocols

GoDel: A Gossip-based Algorithm to Build Delaunay Overlay R. Baraglia, B. Guidi, P. Dazzi, L. Ricci, GoDel: Delaunay Overlays in P2P Networks via Gossip, P2P 2012 (Submitted paper). 22

Next Future Work To make a final version of the Hivory and MABRAVO algorithms. To enhance the GoDel protocoll by including in it the gossip model for data diffusion To investigate epidemic-based protocols for designing self-organizing and self-optimizing overlay networks made up of large sets of actors (humans and not humans). 23

24 Thank you for your attention Questions?