Automated P2P Backup Group 1 Anderson, Bowers, Johnson, Walker.

Slides:



Advertisements
Similar presentations
Operating System Structures
Advertisements

Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
Pastry Peter Druschel, Rice University Antony Rowstron, Microsoft Research UK Some slides are borrowed from the original presentation by the authors.
Peer-to-Peer Systems Chapter 25. What is Peer-to-Peer (P2P)? Napster? Gnutella? Most people think of P2P as music sharing.
Peer-to-Peer (P2P) Distributed Storage 1Dennis Kafura – CS5204 – Operating Systems.
Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility Antony Rowstron, Peter Druschel Presented by: Cristian Borcea.
Chord: A scalable peer-to- peer lookup service for Internet applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashock, Hari Balakrishnan.
Denial-of-Service Resilience in Peer-to-Peer Systems D. Dumitriu, E. Knightly, A. Kuzmanovic, I. Stoica and W. Zwaenepoel Presenter: Yan Gao.
An Overview of Peer-to-Peer Networking CPSC 441 (with thanks to Sami Rollins, UCSB)
Outline for today Structured overlay as infrastructures Survey of design solutions Analysis of designs.
Peoplesoft Fundamentals David Lewis 10/18/02 (adapted from Psoft Training Materials)
Spring 2003CS 4611 Peer-to-Peer Networks Outline Survey Self-organizing overlay network File system on top of P2P network Contributions from Peter Druschel.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
11 3 / 12 CHAPTER Databases MIS105 Lec14 Irfan Ahmed Ilyas.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
Freenet A Distributed Anonymous Information Storage and Retrieval System I Clarke O Sandberg I Clarke O Sandberg B WileyT W Hong.
Topics in Reliable Distributed Systems Fall Dr. Idit Keidar.
1 CS 194: Distributed Systems Distributed Hash Tables Scott Shenker and Ion Stoica Computer Science Division Department of Electrical Engineering and Computer.
Data Structures Hash Table (aka Dictionary) i206 Fall 2010 John Chuang Some slides adapted from Marti Hearst, Brian Hayes, Andreas Veneris, Glenn Brookshear,
1 Peer-to-Peer Networks Outline Survey Self-organizing overlay network File system on top of P2P network Contributions from Peter Druschel.
Peer-to-Peer Networks Slides largely adopted from Ion Stoica’s lecture at UCB.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Chapter 2: Operating-System Structures Modified from the text book.
1CS 6401 Peer-to-Peer Networks Outline Overview Gnutella Structured Overlays BitTorrent.
Russ Houberg Senior Technical Architect, MCM KnowledgeLake, Inc.
Microsoft Access Ervin Ha.
Storage management and caching in PAST PRESENTED BY BASKAR RETHINASABAPATHI 1.
Freenet: A Distributed Anonymous Information Storage and Retrieval System Presentation by Theodore Mao CS294-4: Peer-to-peer Systems August 27, 2003.
Freenet. Anonymity  Napster, Gnutella, Kazaa do not provide anonymity  Users know who they are downloading from  Others know who sent a query  Freenet.
Tapestry GTK Devaroy (07CS1012) Kintali Bala Kishan (07CS1024) G Rahul (07CS3009)
DEMIGUISE STORAGE An Anonymous File Storage System VIJAY KUMAR RAVI PRAGATHI SEGIREDDY COMP 512.
Application Layer – Peer-to-peer UIUC CS438: Communication Networks Summer 2014 Fred Douglas Slides: Fred, Kurose&Ross (sometimes edited)
Networked File System CS Introduction to Operating Systems.
1 JTE HPC/FS Pastis: a peer-to-peer file system for persistant large-scale storage Jean-Michel Busca Fabio Picconi Pierre Sens LIP6, Université Paris 6.
Content Overlays (Nick Feamster). 2 Content Overlays Distributed content storage and retrieval Two primary approaches: –Structured overlay –Unstructured.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Freenet: A Distributed Anonymous Information Storage and Retrieval System Presenter: Chris Grier ECE 598nb Spring 2006.
Using the Small-World Model to Improve Freenet Performance Hui Zhang Ashish Goel Ramesh Govindan USC.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 3: Operating-System Structures System Components Operating System Services.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications.
P2p file storage and distribution Team: Brian Smith, Daniel Suskin, Dylan Nunley, Forrest Vines Mentor: Brendan Burns.
1 Peer-to-Peer Technologies Seminar by: Kunal Goswami (05IT6006) School of Information Technology Guided by: Prof. C.R.Mandal, School of Information Technology.
P2PComputing/Scalab 1 Gnutella and Freenet Ramaswamy N.Vadivelu Scalab.
1 JTE HPC/FS Pastis: a peer-to-peer file system for persistant large-scale storage Jean-Michel Busca Fabio Picconi Pierre Sens LIP6, Université Paris 6.
Chapter 5 Files and Exceptions I. "The Practice of Computing Using Python", Punch & Enbody, Copyright © 2013 Pearson Education, Inc. What is a file? A.
Computer Networking P2P. Why P2P? Scaling: system scales with number of clients, by definition Eliminate centralization: Eliminate single point.
1. Efficient Peer-to-Peer Lookup Based on a Distributed Trie 2. Complex Queries in DHT-based Peer-to-Peer Networks Lintao Liu 5/21/2002.
Distributed File Systems 11.2Process SaiRaj Bharath Yalamanchili.
Freenet: Anonymous Storage and Retrieval of Information
INTERNET TECHNOLOGIES Week 10 Peer to Peer Paradigm 1.
Large Scale Sharing Marco F. Duarte COMP 520: Distributed Systems September 19, 2004.
Peck: Transparent Distributed Backup Using Chirp Graduate Operating Systems, Fall 2005 Matthew Van Antwerp December 15, 2005.
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
1 JTE HPC/FS Pastis: a peer-to-peer file system for persistant large-scale storage Jean-Michel Busca Fabio Picconi Pierre Sens LIP6, Université Paris 6.
Nick McKeown CS244 Lecture 17 Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications [Stoica et al 2001]
P2P Networking: Freenet Adriane Lau November 9, 2004 MIE456F.
ANONYMOUS STORAGE AND RETRIEVAL OF INFORMATION Olufemi Odegbile.
Peer-to-Peer Information Systems Week 12: Naming
CASCADE: AN ATTACK-RESISTANT DHT WITH MINIMAL HARD STATE
CS 268: Lecture 22 (Peer-to-Peer Networks)
Server Concepts Dr. Charles W. Kann.
EE 122: Peer-to-Peer (P2P) Networks
Presentation by Theodore Mao CS294-4: Peer-to-peer Systems
Building Peer-to-Peer Systems with Chord, a Distributed Lookup Service
Reading Report 11 Yin Chen 1 Apr 2004
Chapter 2: Operating-System Structures
Introduction to Operating Systems
InfoShare A Distributed P2P Information Storage & Retrieval System
Chapter 2: Operating-System Structures
Peer-to-Peer Information Systems Week 12: Naming
Presentation transcript:

Automated P2P Backup Group 1 Anderson, Bowers, Johnson, Walker

Motivation Hard drive space is cheap Network connectivity is cheap Losing data is expensive We’d like to pool our resources and easily collectively maintain backups

Background – Distributed Hashes Most academic P2P systems are built on “distributed hash tables” –Ask “the system” for a key, and get the content back How the Distributed Hash and the hash lookup is implemented characterizes the P2P system

Related Work – P2P Pastry –Each node has an ID, messages routed to node nearest the hash key –N-order graph used to route OceanStore –Write-once, has versioning –Emphasizes local storage

Related Work – P2P (cont.) CHORD –Routes similarly to Pastry –Circular routing space Freenet –Write-once –Many security and anonymity features All resource encrypted by their hash key

Related Work – Distributed Backup Distributed Internet Backup System –Not P2P – uses direct connections –Encrypts user data on other drives Pastiche –Built on Pastry PAST –Also built on Pastry pStore –Uses own P2P architecture

Design

P2P Adapter Abstracts interfacing with a P2P system’s distributed hash Writing another adapter could make this work with another system We used Freenet because it is the only working P2P system publicly available When backing up a file, returns a key that the adapter can later use to retrieve the file –P2P system specific –Freenet example: Done in Python

Engine Implements backup and retrieval logic Drives the P2P adapter to insert and retrieve files Stores keys from P2P adapter for retrieval Done in Java

UI Allows the user to select files or directories for backup % mark_dir > backup > done Allows user to initiate backup or retrieval based on selection Stores selections in “backup.txt” as a comma- delimited file storing the filename, date of last backup, and retrieval key (if any) Done in Java

Example Run ls –l total 8 drwx bowersj2 student 4096 Apr 16 13:58 dir -rw bowersj2 student 27 Apr 16 13:58 example java Backup_UI % mark_dir > dir > done % mark_file > example > done % backup Backing up dir/one... retrieval key Backing up dir/two... retrieval key Backing up example... retrieval key % exit

Results One limit of the Freenet library used was that files must be no larger then 64KB Not fundamental to Freenet A Freenet file takes approximately 4-5 seconds to insert into the system Retrieval was very fast since it was always from the local drive cache

Design Benefits Careful design allows each component to be implemented in any language UI and Engine communicate through backup.txt Engine and P2P adapter communicate through command lines Problems getting other P2P systems running Most not publicly available yet PASTRY could not be compiled Shipped source had Java exception handling errors

Conclusion Modern P2P systems will provide a good substrate for this sort of application When they are released and working! Writing a basic version of this kind of application is fairly easy Effectiveness depends on the underlying P2P system Freenet doesn’t chunk files, some P2P systems do Freenet has no retention guarantees, some P2P systems do Freenet natively prevents snooping by other users, some P2P systems don’t