WheelFS Jeremy Stribling, Frans Kaashoek, Jinyang Li, Robert Morris MIT CSAIL and New York University.

Slides:



Advertisements
Similar presentations
Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol Li Fan, Pei Cao and Jussara Almeida University of Wisconsin-Madison Andrei Broder Compaq/DEC.
Advertisements

Searching over Many Sites in Jeremy Stribling Joint work with: Jinyang Li, M. Frans Kaashoek, Robert Morris MIT Computer Science and Artificial Intelligence.
Building Distributed, Wide-Area Applications with WheelFS Jeremy Stribling, Emil Sit, Frans Kaashoek, Jinyang Li, and Robert Morris MIT CSAIL and NYU.
Recovery Techniques in Mobile Databases Prepared by Ammar Hamamra.
Don’t Give Up on Distributed File Systems Jeremy Stribling, Emil Sit, Frans Kaashoek, Jinyang Li, and Robert Morris MIT CSAIL and NYU.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
CHAPTER 15 WEBPAGE OPTIMIZATION. LEARNING OBJECTIVES How to test your web-page performance How browser and server interactions impact performance What.
Relaxed Consistency Models. Outline Lazy Release Consistency TreadMarks DSM system.
Simplifying Wide-Area Application Development with WheelFS Jeremy Stribling In collaboration with Jinyang Li, Frans Kaashoek, Robert Morris MIT CSAIL &
Research Notes Tool Chuck Connell, Tufts Univ.. Tufts University Computer Science22 Two Research Problems References… Many types – books, articles, web.
CHORD – peer to peer lookup protocol Shankar Karthik Vaithianathan & Aravind Sivaraman University of Central Florida.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
11-May-15CSE 542: Operating Systems1 File system trace papers The Zebra striped network file system. Hartman, J. H. and Ousterhout, J. K. SOSP '93. (ACM.
Flexible, Wide-Area Storage for Distributed Systems Using Semantic Cues Jeremy Stribling Thesis Defense, August 6, 2009 Including material previously published.
OverCite: A Distributed, Cooperative CiteSeer Jeremy Stribling, Jinyang Li, Isaac G. Councill, M. Frans Kaashoek, Robert Morris MIT Computer Science and.
Overlay Networks + Internet routing has exhibited scalability - Internet routing is inefficient -Difficult to add intelligence to Internet Solution: Overlay.
Consistency in NFS and AFS. Network File System (NFS) Uses client caching to reduce network load Built on top of RPC Server cache: X Client A cache: XClient.
1 Principles of Reliable Distributed Systems Tutorial 12: Frangipani Spring 2009 Alex Shraer.
Cooperative Computing for Data Intensive Science Douglas Thain University of Notre Dame NSF Bridges to Engineering 2020 Conference 12 March 2008.
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
CS 672 Paper Presentation Presented By Saif Iqbal “CarNet: A Scalable Ad Hoc Wireless Network System” Robert Morris, John Jannotti, Frans Kaashoek, Jinyang.
Locality Optimizations in Tapestry Jeremy Stribling Joint work with: Kris Hildrum Ben Y. Zhao Anthony D. Joseph John D. Kubiatowicz Sahara/OceanStore Winter.
Wide-area cooperative storage with CFS
SM3121 Software Technology Mark Green School of Creative Media.
Operating Systems: Principles and Practice
(ITI310) By Eng. BASSEM ALSAID SESSIONS 8: Network Load Balancing (NLB)
File Systems (2). Readings r Silbershatz et al: 11.8.
Distributed File Systems Sarah Diesburg Operating Systems CS 3430.
Wide-Area Cooperative Storage with CFS Robert Morris Frank Dabek, M. Frans Kaashoek, David Karger, Ion Stoica MIT and Berkeley.
CSC 456 Operating Systems Seminar Presentation (11/13/2012) Leon Weingard, Liang Xin The Google File System.
Thesis Proposal Data Consistency in DHTs. Background Peer-to-peer systems have become increasingly popular Lots of P2P applications around us –File sharing,
Cloud Distributed Computing Environment Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
Wide-area cooperative storage with CFS Frank Dabek, M. Frans Kaashoek, David Karger, Robert Morris, Ion Stoica.
Distributed systems [Fall 2014] G Lec 1: Course Introduction.
Chapter 9 How Do Users Share Computer Files?. What is a File Server A (central) computer which stores files which can be accessed by network users.
Distributed File Systems Overview  A file system is an abstract data type – an abstraction of a storage device.  A distributed file system is available.
Jalisa Eady Definitions Mr. Gabbard Pd
Serverless Network File Systems Overview by Joseph Thompson.
INFO1408 Database Design Concepts Week 15: Introduction to Database Management Systems.
Reconsidering Internet Mobility Alex C. Snoeren, Hari Balakrishnan, M. Frans Kaashoek MIT Laboratory for Computer Science.
UI Team Code Review Reviewed by Grid Team. Priorities *****Major Problem ****Important Suggestion ***Normal **Less important idea *Minor idea/Code aesthetics.
CHAPTER 9 HARDENING SERVERS. C REATING A BASELINE POLICY Security parameters used to create a baseline installation can be configured using a Group Policy.
Offline Web Apps - an offline web application is a list of URLs for HTML, CSS, JavaScript, images, or any other kind of resource. Most browsers have offline.
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
Effective Replica Maintenance for Distributed Storage Systems USENIX NSDI’ 06 Byung-Gon Chun, Frank Dabek, Andreas Haeberlen, Emil Sit, Hakim Weatherspoon,
Caching Consistency and Concurrency Control Contact: Dingshan He
Graduate school experience in a systems group Jinyang Li assistant professor New York University.
OLE Slide No. 1 Object Linking and Embedding H OLE H definition H add other information to documents H copy.
Distributed systems [Fall 2015] G Lec 1: Course Introduction.
Module 4: Managing Access to Resources. Overview Overview of Managing Access to Resources Managing Access to Shared Folders Managing Access to Files and.
WheelFS. Agenda Introduction Background Feature System Architecture Design and Details Conclusion.
CS 347Notes081 CS 347: Parallel and Distributed Data Management Notes 08: P2P Systems.
Bristol Bay Weekly Report + Mixed Salmon Update. If you do not work with Bristol Bay data, feel free to take a break now.
© Oxford University Press 2011 DISTRIBUTED COMPUTING Sunita Mahajan Sunita Mahajan, Principal, Institute of Computer Science, MET League of Colleges, Mumbai.
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
CS 425 / ECE 428 Distributed Systems Fall 2015 Indranil Gupta (Indy) Peer-to-peer Systems All slides © IG.
DISTRIBUTED FILE SYSTEM- ENHANCEMENT AND FURTHER DEVELOPMENT BY:- PALLAWI(10BIT0033)
Introduction to Operating Systems
Data Management with Google File System Pramod Bhatotia wp. mpi-sws
Distributed File Systems
Module 4: Managing Access to Resources
Introduction to Operating Systems
Jinyang Li’s Research Distributed Systems Wireless Networks
Distributed P2P File System
ColdFusion Performance Troubleshooting and Tuning
CSE 486/586 Distributed Systems Consistency --- 1
WheelFS Jeremy Stribling, Frans Kaashoek, Jinyang Li, Robert Morris
Consistent Hashing and Distributed Hash Table
Caching 50.5* + Apache Kafka
Thursday AM, Lecture 2 Brian Lin OSG
Presentation transcript:

WheelFS Jeremy Stribling, Frans Kaashoek, Jinyang Li, Robert Morris MIT CSAIL and New York University

I Want to Publish an SOSP Paper But I don’t want to do a lot of work Idea: New cooperative Web cache!

Exploit a Network File System Network File Server (/mnt/awesome-cdn/cache) Apache Caching Proxy Apache Caching Proxy Apache Caching Proxy Apache Caching Proxy foo.html

It Is Too Good to Be True Tries to mask failures with long timeouts Strict consistency prevents use of cached data under failures My naïve SOSP strategy might not work

So What Are My Options? Give up dream and just not graduate Submit random paper [Rooter, WMSCI ’05] Build an FS that would work for real apps –Apache can use old copies of data –And can always fall back to the origin –Why not tell the FS?

WheelFS: Storage for Wide-area Apps File system API Semantic cues give apps control of behavior under failures  Make Apache distributed with 1 line change

WheelFS Cooperative Web Cache on WheelFS Apache Caching Proxy Apache Caching Proxy Apache Caching Proxy Apache Caching Proxy /wfs/cache//.bestversion.maxtime=500/.lax/$URL Use newest version you can find quickly Time out operations after T milliseconds Allow multiple versions of a directory to be updated

I’m Running Out of Time, So: A compact but powerful set of cues Useful to other applications, including: –PlanetLab measurement studies –Parallel Grid computations –Distribute make See you at the next big conference!