Presentation is loading. Please wait.

Presentation is loading. Please wait.

One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,"— Presentation transcript:

1 One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades danton@ics.forth.gr Evangelos P. Markatos markatos@ics.forth.gr ICS-FORTH Heraklion, Crete, Hellas Constantine Dovrolis dovrolis@cc.gatech.edu College of Computing Georgia Tech

2 File Sharing One of the most popular Internet user activities 60-70% of total traffic volume Recent studies show increase in Web traffic –Mainly attributed to Web-based file sharing 2 danton@ics.forth.gr IMC'09

3 What’s new? Since 2006, a large number of One-Click Hosting (OCH) services have made their appearance –Mainly used for file-sharing Large number of web sites indexing content to OCH –Indication of a large number of users danton@ics.forth.gr 3 IMC'09

4 OCH-Services Provide file hosting services at no cost Provide unique URLs to the uploader that she can share with her friends & communities Provide no indexing for the hosted files –So, legally speaking, they cannot be blamed for participating in file sharing –Users find content through web searches and dedicated blogs/forums 4danton@ics.forth.gr IMC'09

5 Upload Phase danton@ics.forth.gr 5 IMC'09

6 Download Phase danton@ics.forth.gr 6 IMC'09

7 This study Investigates how One-Click Hosting services work and how they are used Traffic load Client characteristics Infrastructure Content danton@ics.forth.gr 7 IMC'09

8 Collected Data Two monitoring points –Monitor1: NREN, ~10K total users (~750 RS) –Monitor2: University, ~1K total users (~450 RS) Identify Web Services by the 2 last domain levels of HTTP requests 8 danton@ics.forth.gr IMC'09 NameCollection periodTotal BytesTotal Flows Monitor1Jun 6 – Oct 23’0860.8TB2.2B Monitor2Aug 10 – Dec 2’08214.8TB1.4B

9 Why rapidshare.com? rapidshare.com is currently the largest and most popular such service. 12 th most visited site 2.5M unique users in December 2008 It is the largest traffic producing OCH service in both our monitoring points. Traffic volume similar to YouTube and Google- Video 9 danton@ics.forth.gr IMC'09

10 Flow Sizes 90% of the flows < 150KBytes –Probably page access flows  Download flows range from several MB to 2GB  Daily user activity varies in number of download files 10 danton@ics.forth.gr IMC'09

11 Free Vs. Paying Clients Rapidshare.com rate-limits free user downloads to 0.2Mbits/sec – 2.0Mbits/sec  Only 20% of the users experience greater download throughputs  Subscribers 11 danton@ics.forth.gr IMC'09

12 Downloaded Content  File popularity: Unique downloaders per file 12 danton@ics.forth.gr IMC'09  75% of the files downloaded only once  Only 0.05% downloaded by more than 5 users

13 Service Architecture Try to infer the architecture of the RapidShare service by answering:  What is the total number of servers used by RapidShare?  Single-Homing Vs. Multi-Homing  Where are these servers located?  Single Vs. Multiple Datacenters  Is the content located at all the servers?  Are all the servers serving download requests?  How is this architecture different from traditional content distribution networks? 13 danton@ics.forth.gr IMC'09

14 Total Number of Servers Used  5,291 distinct server IP addresses  36 /24 subnets  8 different ISPs  Large increase in number of servers during Sep’08 14 danton@ics.forth.gr IMC'09 Infrastructure Update

15 Server Location  Discover the geographical location of the server infrastructure  Single-datacenter Vs. Multiple geographically distributed datacenters Performed a number of traceroutes from different planetlab locations Used minimum RTT to infer distance from landmarks 15 danton@ics.forth.gr IMC'09

16 Server Location cont. Close min-RTT values show a single central datacenter  Datacenter closest to central-European countries 16 danton@ics.forth.gr IMC'09

17 Content Replication  What is the number of servers that store each file? Used TOR as a geographically distributed downloader –421 different exit nodes Requested 20,000 RapidShare file URLs  Each file served by exactly 12 servers (group)  Each file indexed by exactly 1 server 17 danton@ics.forth.gr IMC'09

18 Server Load Balancing  Which server group will host a newly uploaded file? danton@ics.forth.gr 18 50000 file upload requests Log upload group-id  Recently added groups have a higher likelihood of being selected as the upload group IMC'09

19 Server Load Balancing (cont)  Which download server of that group will be used upon a download request? danton@ics.forth.gr 19 1000 back-to-back file download requests Log download server  Indexing servers are less likely to be selected as download server IMC'09

20 OCH services vs. CDNs One-Click Hosting services –Data-center in a single location –Use multi-homing to: Increase reliability Decrease cost for the content provider Selectively redirect users to least loaded servers –Content replicated on multiple servers Content Distribution Networks –Multiple geographically distributed servers so as to minimize delay observed by client –Client redirected to the closest (in terms of RTT) server group –Content replicated on multiple servers 20 danton@ics.forth.gr IMC'09

21 Challenging the P2P Paradigm  P2P has been (and continues to be) the most popular File-Sharing mechanism  Can OCH services replace P2P? BitTorrent Vs. RapidShare.com –Download Throughput 21 danton@ics.forth.gr IMC'09

22 BT Vs. RS: Download Throughput Download a list of objects from both networks –Objects of different size –Objects of different kind 3 types of RS users –Subscribers –Free Users –“Free-Cheating” Users  RS subscribers outperforms open BitTorrent trackers in terms of throughput  Free users experience comparable download experience 22 danton@ics.forth.gr IMC'09

23 Content Indexing Websites Form an important component for the emergence of OCH services Crawled 4 different Indexing Websites  Identify the contributors of the traffic  Identify the size of the shared object  Identify the types of shared object 23 danton@ics.forth.gr IMC'09

24 Indexing WebSites  Less than 20% of the files are not available  Only a small number of users upload content  Users share mostly videos and applications  Different communities observed in different websites 24 danton@ics.forth.gr IMC'09 Name# Indexed Objects RS Hosted Objects # of Stale Files # of Uploaders egydown.com972787134 (17%)N/A rapidmega.info942893116 (13%)9 rslinks.org121241184164 (0.5%)21 rapidshareindex.com54327365227052 (19.3%)18

25 BT Vs. RS: Content Availability Searched for a number of different files in both network Rapidshare.com holds at least as much objects as BitTorrent 25 danton@ics.forth.gr IMC'09

26 Content Contributors  A small number of the users is responsible for most of the content uploaded 26 danton@ics.forth.gr IMC'09

27 Shared Objects  Users share mostly Videos and Applications  Different communities can be observed in different WebSites 27 danton@ics.forth.gr IMC'09

28 Copyrighted Material Manually observed 100 most recent objects uploaded in each WebSite. In all cases more than 84% of the Objects are copyrighted. 28 danton@ics.forth.gr IMC'09

29 Conclusions  Currently responsible for 10% of the daily traffic in our traces  60% of daily Web traffic  Most files are downloaded only once  All servers at multihomed single datacenter  Very different than CDN architecture  OCH services are a promising alternative to P2P for file- sharing  Free users experience similar performance with BitTorrent Open tracker users  Subscribers (~20%) experience better performance  Most users do not contribute on sharing files (only download) 29 danton@ics.forth.gr IMC'09

30 Backup slides IMC'09 danton@ics.forth.gr 30

31 How do OCH Services Work 31 danton@ics.forth.gr IMC'09

32 Derived Architecture 32 danton@ics.forth.gr IMC'09

Download ppt "One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,"

Similar presentations

The Internet.

The Internet.
The Internet and the Web

The Internet and the Web
Google Docs is a free, web-based office suite offered by Google within its Google Drive service. It was formerly a storage service as well, but has since.

Google Docs is a free, web-based office suite offered by Google within its Google Drive service. It was formerly a storage service as well, but has since.
Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.

Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.
Cloud Download : Using Cloud Utilities to Achieve High-quality Content Distribution for Unpopular Videos Yan Huang, Tencent Research, Shanghai, China Zhenhua.

Cloud Download : Using Cloud Utilities to Achieve High-quality Content Distribution for Unpopular Videos Yan Huang, Tencent Research, Shanghai, China Zhenhua.
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.

1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
Cis3.2 -- e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © 2002-2005)

Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.

An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
1 A Framework for Lazy Replication in P2P VoD Bin Cheng 1, Lex Stein 2, Hai Jin 1, Zheng Zhang 2 1 Huazhong University of Science & Technology (HUST) 2.

1 A Framework for Lazy Replication in P2P VoD Bin Cheng 1, Lex Stein 2, Hai Jin 1, Zheng Zhang 2 1 Huazhong University of Science & Technology (HUST) 2.
The Internet Useful Definitions and Concepts About the Internet.

The Internet Useful Definitions and Concepts About the Internet.
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.

CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved. 0-13-239227-5 DISTRIBUTED SYSTEMS.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Squirrel: A decentralized peer- to-peer web cache Paul Burstein 10/27/2003.

Squirrel: A decentralized peer- to-peer web cache Paul Burstein 10/27/2003.
1 Web Content Delivery Reading: Section 9.2.2 and 9.4.3 COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:

1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:
Web Caching and CDNs March 3, 2004. Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.

Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.
Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.

Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.
C HAPTER 4 W EB H OSTING. I. I NTRODUCTION To make your Web site visible to the world, it has to be hosted on a Web server. In this tutorial we will teach.

C HAPTER 4 W EB H OSTING. I. I NTRODUCTION To make your Web site visible to the world, it has to be hosted on a Web server. In this tutorial we will teach.
Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.

Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.
LEARN THE QUICK AND EASY WAY! VISUAL QUICKSTART GUIDE HTML and CSS 8th Edition Chapter 21: Publishing Your Pages on the Web.

LEARN THE QUICK AND EASY WAY! VISUAL QUICKSTART GUIDE HTML and CSS 8th Edition Chapter 21: Publishing Your Pages on the Web.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

Similar presentations

Ads by Google