By: Sraddha Adhikari St107931 TC/SET Thesis Examination Committee: Dr. Teerapat Sanguankotchakorn (Chairperson) Assoc. Prof. Tapio J. Erke Dr. Poompat.

Slides:



Advertisements
Similar presentations
謝文婷 SocialTube: P2P-assisted Video Sharing in Online Social Networks Authors: Ze Li ; Haiying Shen ; Hailang Wang ; Guoxin Liu ; Jin Li.
Advertisements

Peer to Peer and Distributed Hash Tables
1Department of Electrical Engineering and Computer Science, University of Michigan, USA. 2Department of Computer Science, National University of Singapore,
1 Asian Institute of Technology May 2009 MULTI-CONSTRAINED OPTIMAL PATH QUALITY OF SERVICE (QoS) ROUTING WITH INACCURATE LINK STATE INFORMATION AIT Master.
Massively Distributed Database Systems Distributed Hash Spring 2014 Ki-Joune Li Pusan National University.
1 Turning Heterogeneity into an Advantage in Overlay Routing Gisik Kwon Dept. of Computer Science and Engineering Arizona State University Published in.
University of Cincinnati1 Towards A Content-Based Aggregation Network By Shagun Kakkar May 29, 2002.
Modeling and Analysis of Random Walk Search Algorithms in P2P Networks Nabhendra Bisnik, Alhussein Abouzeid ECSE, Rensselaer Polytechnic Institute.
Technion –Israel Institute of Technology Computer Networks Laboratory A Comparison of Peer-to-Peer systems by Gomon Dmitri and Kritsmer Ilya under Roi.
Search and Replication in Unstructured Peer-to-Peer Networks Pei Cao, Christine Lv., Edith Cohen, Kai Li and Scott Shenker ICS 2002.
Farnoush Banaei-Kashani and Cyrus Shahabi Criticality-based Analysis and Design of Unstructured P2P Networks as “ Complex Systems ” Mohammad Al-Rifai.
LightFlood: An Optimal Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
Denial-of-Service Resilience in Peer-to-Peer Systems D. Dumitriu, E. Knightly, A. Kuzmanovic, I. Stoica and W. Zwaenepoel Presenter: Yan Gao.
Gnutella 2 GNUTELLA A Summary Of The Protocol and it’s Purpose By
P2p, Spring 05 1 Topics in Database Systems: Data Management in Peer-to-Peer Systems March 29, 2005.
Evaluation of Ad hoc Routing Protocols under a Peer-to-Peer Application Authors: Leonardo Barbosa Isabela Siqueira Antonio A. Loureiro Federal University.
Rheeve: A Plug-n-Play Peer- to-Peer Computing Platform Wang-kee Poon and Jiannong Cao Department of Computing, The Hong Kong Polytechnic University ICDCSW.
Technion –Israel Institute of Technology Software Systems Laboratory A Comparison of Peer-to-Peer systems by Gomon Dmitri and Kritsmer Ilya under Roi Melamed.
Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
Exploiting Content Localities for Efficient Search in P2P Systems Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang 1 1 College of William and Mary,
Search and Replication in Unstructured Peer-to-Peer Networks Pei Cao Cisco Systems, Inc. (Joint work with Christine Lv, Edith Cohen, Kai Li and Scott Shenker)
Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek and Hari alakrishnan.
Kyushu University Graduate School of Information Science and Electrical Engineering Department of Advanced Information Technology Supervisor: Professor.
presented by Hasan SÖZER1 Scalable P2P Search Daniel A. Menascé George Mason University.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
Topics in Reliable Distributed Systems Fall Dr. Idit Keidar.
Improving Data Access in P2P Systems Karl Aberer and Magdalena Punceva Swiss Federal Institute of Technology Manfred Hauswirth and Roman Schmidt Technical.
Peer-to-peer file-sharing over mobile ad hoc networks Gang Ding and Bharat Bhargava Department of Computer Sciences Purdue University Pervasive Computing.
UNIVERSITY OF JYVÄSKYLÄ Topology Management in Unstructured P2P Networks Distributed Systems Research Seminar on Annemari Auvinen, Research Student.
1CS 6401 Peer-to-Peer Networks Outline Overview Gnutella Structured Overlays BitTorrent.
P2P File Sharing Systems
INTRODUCTION TO PEER TO PEER NETWORKS Z.M. Joseph CSE 6392 – DB Exploration Spring 2006 CSE, UT Arlington.
1 Napster & Gnutella An Overview. 2 About Napster Distributed application allowing users to search and exchange MP3 files. Written by Shawn Fanning in.
P2P Architecture Case Study: Gnutella Network
1 Speaker : 童耀民 MA1G Authors: Ze Li Dept. of Electr. & Comput. Eng., Clemson Univ., Clemson, SC, USA Haiying Shen ; Hailang Wang ; Guoxin.
An affinity-driven clustering approach for service discovery and composition for pervasive computing J. Gaber and M.Bakhouya Laboratoire SeT Université.
Peer to Peer Research survey TingYang Chang. Intro. Of P2P Computers of the system was known as peers which sharing data files with each other. Build.
The application of P2P technology. Team Member: LIU Chang, ZHANG jianing Presentation: LIU Chang.
Jonathan Walpole CSE515 - Distributed Computing Systems 1 Teaching Assistant for CSE515 Rahul Dubey.
Higashino Lab. Maximizing User Gain in Multi-flow Multicast Streaming on Overlay Networks Y.Nakamura, H.Yamaguchi and T.Higashino Graduate School of Information.
Using the Small-World Model to Improve Freenet Performance Hui Zhang Ashish Goel Ramesh Govindan USC.
A Prediction-based Fair Replication Algorithm in Structured P2P Systems Xianshu Zhu, Dafang Zhang, Wenjia Li, Kun Huang Presented by: Xianshu Zhu College.
Quantitative Evaluation of Unstructured Peer-to-Peer Architectures Fabrício Benevenuto José Ismael Jr. Jussara M. Almeida Department of Computer Science.
A Peer-to-Peer Approach to Resource Discovery in Grid Environments (in HPDC’02, by U of Chicago) Gisik Kwon Nov. 18, 2002.
Kaleidoscope – Adding Colors to Kademlia Gil Einziger, Roy Friedman, Eyal Kibbar Computer Science, Technion 1.
1 Peer-to-Peer Technologies Seminar by: Kunal Goswami (05IT6006) School of Information Technology Guided by: Prof. C.R.Mandal, School of Information Technology.
Efficient P2P Search by Exploiting Localities in Peer Community and Individual Peers A DISC’04 paper Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang.
SocialTube: P2P-assisted Video Sharing in Online Social Networks
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
P2p, Fall 06 1 Topics in Database Systems: Data Management in Peer-to-Peer Systems Search in Unstructured P2p.
SocialVoD: a Social Feature-based P2P System Wei Chang, and Jie Wu Presenter: En Wang Temple University, PA, USA IEEE ICPP, September, Beijing, China1.
Stefanos Antaris A Socio-Aware Decentralized Topology Construction Protocol Stefanos Antaris *, Despina Stasi *, Mikael Högqvist † George Pallis *, Marios.
Peer to Peer Network Design Discovery and Routing algorithms
Aug 22, 2002Sigcomm 2002 Replication Strategies in Unstructured Peer-to-Peer Networks Edith Cohen AT&T Labs-research Scott Shenker ICIR.
Algorithms and Techniques in Structured Scalable Peer-to-Peer Networks
INTERNET TECHNOLOGIES Week 10 Peer to Peer Paradigm 1.
CS 347Notes081 CS 347: Parallel and Distributed Data Management Notes 08: P2P Systems.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
A Social-Network-Aided Efficient Peer-to-Peer Live Streaming System IEEE/ACM TRANSACTIONS ON NETWORKING, JUNE 2015 Haiying Shen, Yuhua Lin Dept. of Electrical.
School of Electrical Engineering &Telecommunications UNSW Cost-effective Broadcast for Fully Decentralized Peer-to-peer Networks Marius Portmann & Aruna.
An overlay for latency gradated multicasting Anwitaman Datta SCE, NTU Singapore Ion Stoica, Mike Franklin EECS, UC Berkeley
09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.
Large Scale Sharing Marco F. Duarte COMP 520: Distributed Systems September 19, 2004.
Malugo – a scalable peer-to-peer storage system..
Distributed Caching and Adaptive Search in Multilayer P2P Networks Chen Wang, Li Xiao, Yunhao Liu, Pei Zheng The 24th International Conference on Distributed.
OBJECT LOCATION IN UNSTRUCTURED P2P NETWORKS USING RANDOM WALK
Peer-to-Peer Information Systems Week 6: Performance
Presentation transcript:

By: Sraddha Adhikari St TC/SET Thesis Examination Committee: Dr. Teerapat Sanguankotchakorn (Chairperson) Assoc. Prof. Tapio J. Erke Dr. Poompat Saengudomlert Prof. Noel Crespi (External Expert) Dr. Mehdi Mani (External Expert) Asian Institute of Technology May 17, 2010

Why P2P? Bandwidth Bottleneck has shifted from Users Side (e.g. dial up connection) to Central Server Development of popular sites like YouTube hindered by client/server architecture [4] src: [11] 2

P2P versus C/S 3

Peer-to-Peer Networks Peers or nodes are the basic building blocks Shift of load and responsibility to all entities in P2P network Peers incorporate with each other to accomplish some task/objectives Resources in the network scale with the number of peers in the system Reliable network: no single point of failure Resilient Network: avoid dependence on central resources 4

PROBLEM STATEMENT P2P networks (overlay network) have their own routing mechanisms that play major role in their performance [9]. Content Discovery is still identified as a major problem in Unstructured P2P networks [1] [2] [6] [11] [12]. Nodes in P2P networks do not have global view of the network which leads to inefficient routing of query. P2P delivery of short videos demands an efficient content location mechanism [4]. 5

Content Discovery Problem The content discovery problem is simple to state: Given a data item X stored at some dynamic set of nodes in the system, find it. A G F E D C B I want X I HAVE X

Various Search Mechanisms: Flooding Most typical query method in Decentralized and Unstructured P2P networks Query Flooding overloads the whole network with redundant messages Difficult to choose appropriate TTL to terminate the flood. Many duplicate messages introduced by flooding Gnutella, first decentralized P2P application has performance issues like generation of huge network traffic, slow response and congestion [5] [12] 7

Various Search Mechanisms: Expanding Ring Introduced to improve search in Gnutella by [7]. Value of TTL is gradually increased to find the content There is duplication of messages to the same peers Peers do not learn from past experiences to bypass previously forwarded peers This approach still floods the network with messages 8

Various Search Mechanisms: Random Walk Totally blind search where nodes forward their query to a random node at each hop If the forwarded node is overloaded with queries, it would take time to process, which adds to delay of random walk mechanism [3]. Sequential search, hence search time increases 9

Peer-to-peer & Social Networks Due to the fact that there is human being behind every peer there is similarity between social networks and peer-to-peer networks. 10

Proposal: Social P2P Network 11 We propose to implement human strategies in social networks to improve search mechanism in P2P. In short, we propose a social P2P network (socP2P). We believe and will verify that human strategies in social networks are useful in improving content discovery in P2P network.

Objectives of Proposed Search Mechanism Locate resources in the network efficiently with - high success rate - low overhead - low delay Detect nodes having similar interest and use them to make search more effective. Exploit “search mechanism” to gather interest information of nodes in network so that additional overhead is not required to obtain these information. Develop an efficient and scalable “Resource Discovery Algorithm” in P2P networks using social relationships between peers. Evaluate the proposed algorithm by simulation and comparisons. 12

Limitations We do not consider any dynamics due to node joins and leaves and content sharing and removing. We do not consider issues of selfish peers who do not contribute their resources to the network and are commonly known as free-riders. 13

Human Characteristics copied in proposed algorithm Human beings can be grouped into different interest categories. We find out resources that we are looking for by directly contacting some acquaintances that have knowledge about the resource that we are looking for. When we interact with people, we try to remember useful information (what they are involved in, save their contact number) so that we can use these information later. 14

Detection of Interest Similarity in socP2P Nodes do not declare their interest. Interest of nodes is learned during the search process. If ‘B’ replies successfully to the query of ‘A’, it is learnt that they have interest on the same file. Hence Interest Similarity between then is declared. A directed Interest Link is created from A to B. Considering the interest similarity between them, B might be useful to A in future as well. 15

Two Principals of Our Approach Principal 1 Use search queries to automatically adapt to make resource related interest relationships. Principal 2 Exploit the query request encounters by nodes to keep a record of what the requesting node is interested in? - It is overheard knowledge by node - Helps in recommending “right nodes” to the querying node. 16

Two Types of Links created Based on Interest Similarity Directed Interest Links Network Suggested Forward and thus Created Links 17

An Example of Directed Interest Link and Recommendation B D C A E Find X A wants X Find X D A B C C gives X to A

Search Restricted to ‘M’ Nodes Search is limited to two hops. Our goal is to restrict number of Queries submitted to the network for a single content. Query Node sends its query to M/2 nodes (neighbors or friends or both) in the first hop. If these M/2 Nodes do not have requested content, each of them forward the query to only one node. Thus query is forwarded to maximum (1 x (M/2) + (M/2) x 1) = M 19

Search Mechanism in socP2P 20

Recommended Nodes Based Search 21

Friend Based Search 22

SIMULATION & RESULTS MATLAB CODE Each result is simulated 20 times except for Network Size 1000 (12-15 times). Simulation Methodology - Network Generation - Content Generation & Distribution - Query Generation 23

Average Success Rate 24 In the above formula, NBS = Neighbors Based Search FBS = Friends Based Search RBS = Recommended Nodes Based Search

Average Success Rate (ASR) 25 Average Success Rate (%) Percentage of nodes a query is forwarded to

Average Success Rate (ASR) 26 Average Success Rate (%) Percentage of nodes a query is forwarded to

Average Success Rate (ASR) 27 Average Success Rate (%) Percentage of nodes a query is forwarded to

Average Success Rate (ASR) 28 Average Success Rate (%) Percentage of nodes a query is forwarded to

Average Success Rate (ASR) 29 Average Success Rate (%) Percentage of nodes a query is forwarded to

ASR in relation to Number of Queries 30 Average Success Rate (%) Percentage of nodes a query is forwarded to

Comparison between socP2P, socP2P without Node Overhearing & Random Walk 31 Average Success Rate (%) Percentage of nodes a query is forwarded to

Comparison between socP2P, socP2P without Node Overhearing & Random Walk 32 Average Success Rate (%) Percentage of nodes a query is forwarded to

Comparison between socP2P, socP2P without Node Overhearing & Random Walk 33 Average Success Rate (%) Percentage of nodes a query is forwarded to

Average Success Rate versus Popularity of Files 34 Average Success Rate (%) Popularity of resource

Average Success Rate versus Popularity of Files 35 Popularity of resource Average Success Rate (%)

Average Success Rate versus Popularity of Files 36 Popularity of resource Average Success Rate (%)

Average Success Rate versus Popularity of Files 37 Average Success Rate (%) Popularity of resource

Shortest Path to Content 38 Shortest Path to Content (Overlay hops) Percentage of nodes a query is forwarded to

Shortest Path to Content (Comparison socP2P & Random Walk) 39 Shortest Path to Content (Overlay hops) Percentage of nodes a query is forwarded to

Shortest Path to Content (Comparison with Gnutella, Gnutella with Shortcuts and socP2P) 40 Shortest Path to Content (Overlay hops)

Network Size and Network value 41 Average Success Rate (%)

Network Size and Network Value 42 Average Success Rate (%)

Code Validation ParametersValue Total Request884 Documents609 Total Number of Peers Table: Simulation Parameters Used By Reference Paper Observation Parameter: Average Success Rate

Performance similarity 44 Average Success Rate (%) Simulation Length (minutes)

Conclusion Friend lists of nodes, overheard knowledge by nodes and recommendation by nodes on the basis of overheard knowledge help to improve search in P2P network. socP2P has achieved high success rate compared to random walk and Gnutella with shortcuts. High success rate is achieved with less delay and low overhead in the network. 45

Future Work Distribution of content taking care of bandwidth efficiency, delay and load distribution in the network. Possible works directed towards enhancing socP2P: Mutual Interest Links Identifying rare files to increase their success rate Including Overhearing Part in the Forwarded Node 46

References [1] Balakrishnan, H., Kaashoek, M.F., Karger, D., Morris, R. & Stoica, I. (2003). Looking Up Data in P2P Syatems. Communications of the ACM, 46(2), [2] Bisnik, N. & Abouzeid, A. (2005). Modelling and Analysis of Random Walk Search Algorithms in P2P Networks. Hot-p2p, Second International Workshop on Hot Topics in Peer-to-Peer Systems, pp [3] Chawathe, Y., Ratnasamy, S., Breslau, L., Lanham, N. & Shenker, S. (2003). Making Gnutella-like P2P Systems Scalable. Making Gnutella-like P2P Systems Scalable. Proceedings of ACM SIGCOMM, Kasruhe, Germany, [4] Cheng, X. & Liu, J. (2009). NetTube: Exploring Social Networks for Peer-to-Peer Short Video Sharing. IEEE INFOCUM 2009 Proceedings, 2009, [5] Hui, K.Y.K., Lui, J.C.S., & Yau, D.K.Y. (2006). Small World Overlay P2P Networks. Computer Networks, vol. 50, no. 15, pp , [6] Liu, L., Antonopoulos, N., & Mackin, S. (2007). Social Peer-to-Peer for Resource Discovery. 15 th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP’07), Page(s): [7] Lv, Q., Cao, P., Cohen, E., Li, K., & Shenker, S. (2002). Search and replication in unstructured peer-to-peer networks. Proceedings of the 16th international conference on Supercomputing, New York, USA,

References [8] McGarthwaite, L. (2005). Client-Server versus Peer-to-Peer Architecture: Comparisons for Streaming Video. Proceedings of the 5 th Winona Computer Science, Undergraduate Research Seminar, April 20-21, 2005, Winona, MN, US. [9] Ripeanu, M. (2001). Peer-to-Peer Architecture Case Study: Gnutella Network. Proceedings of IEEE 1 st International Conference on Peer-to-peer Computing, Linkoping Sweden. [10] Sripanidkulchai, K., Maggs, B., & Zhang, H. (2003). Efficient Content Location Using Interest-Based Locality in Peer-to-Peer Systems. INFOCOM Twenty-Second Annual Joint Conference of the IEEE Computer and Communications. IEEE Societies, Volume: 3, Page(s): vol.3. [11] Tang, J., Zhang, W., Xiao, W., Tang, D., & Song, J. (2006). Self-Organizing Service- Oriented Peer Communities. [12] Upadrashta, Y., Vassileva, J. & Grassmann, W. (2005). Social Networks in Peer-to- Peer Systems. [13] url: 48

Thank you ! Questions and Suggestions are welcome !! 49