Vivek Pai, Larry Peterson, & the CoDeeN group Princeton University

Slides:



Advertisements
Similar presentations
Current methods for negotiating firewalls for the Condor ® system Bruce Beckles (University of Cambridge Computing Service) Se-Chang Son (University of.
Advertisements

Barracuda Link Balancer Link Reliability and Bandwidth Optimization.
1 Planetary Network Testbed Larry Peterson Princeton University.
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
On the Effectiveness of Measurement Reuse for Performance-Based Detouring David Choffnes Fabian Bustamante Fabian Bustamante Northwestern University INFOCOM.
1 © Fluke networks 2004 Everett WAMonday, May 18, 2015 Application Performance & Network Analysis Improving the end user experience.
MCDST : Supporting Users and Troubleshooting a Microsoft Windows XP Operating System Chapter 13: Troubleshoot TCP/IP.
Distributed Object System. Project Goals Develop a distributed system for performing time-consuming calculations. Load Balancing support. Fault Tolerance.
Self Healing Wide Area Network Services Bhavjit S Walha Ganesh Venkatesh.
Evaluating a Defragmented DHT Filesystem Jeff Pang Phil Gibbons, Michael Kaminksy, Haifeng Yu, Sinivasan Seshan Intel Research Pittsburgh, CMU.
Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.
The Medusa Proxy A Tool For Exploring User- Perceived Web Performance Mimika Koletsou and Geoffrey M. Voelker University of California, San Diego Proceeding.
Distributed File Systems Sarah Diesburg Operating Systems CS 3430.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
Engineering A Public Affairs Project Donna Liu, Executive Director UChannel, Princeton University Vivek Pai, Associate Professor CS Department, Princeton.
PRESENTED BY KEVIN LARSON & WILL DIETZ 1 P2P Apps.
Healing the Web: An Overview of CoDeeN & Related Projects Vivek Pai, Larry Peterson + many others Princeton University.
The Dark Side of the Web: An Open Proxy’s View Vivek S. Pai, Limin Wang, KyoungSoo Park, Ruoming Pang, Larry Peterson Princeton University.
PlanetLab Applications and Federation Kiyohide NAKAUCHI NICT 23 rd ITRC Symposium 2008/05/16 Aki NAKAO Utokyo / NICT
NetCache Architecture and Deployment Peter Danzig Network Appliance, Santa Clara, CA 元智大學 系統實驗室 陳桂慧
Web caches are being rapidly deployed in the Internet. Hierarchical Web caching provides an infrastructure for asynchronous reliable multicast. There isn’t.
Information-Centric Networks Section # 3.2: DNS Issues Instructor: George Xylomenos Department: Informatics.
The CoDeeN Content Distribution Network Vivek S. Pai, Limin Wang, KyoungSoo Park, Ruoming Pang, Larry Peterson Princeton University August 12, 2003.
Hiearchial Caching in Traffic Server. Hiearchial Caching  A set of techniques and mechanisms to increase the size and performance of network caches.
Latest Improvements in the PROOF system Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers, Gerri Ganis, Jan Iwaszkiewicz CERN.
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
CoDeeN,Large Files, & CoDeploy KyoungSoo Park, Vivek Pai, Larry Peterson Princeton University.
SmartGRID Decentralized, dynamic grid scheduling framework on swarm agent-based intelligence GCC'08, shenzhen, China. Oct. 26, 2008 Ye HUANG, Amos BROCCO.
Doc.: IEEE /145r1 Submission March 2001 Mathilde Benveniste, AT&T Labs - ResearchSlide 1 E-DCF with Backoff Adaptation to Traffic Mathilde Benveniste.
The Dark Side of the Web: An Open Proxy’s View Vivek Pai, Limin Wang, KyoungSoo Park, Ruoming Pang, and Larry Peterson Princeton University.
PlanetSeer: Internet Path Failure Monitoring and Characterization in Wide-Area Services Ming Zhang, Chi Zhang Vivek Pai, Larry Peterson, Randy Wang Princeton.
EDNS Client Subnet (ECS) in CDN solution
Barracuda Link Balancer
C Loomis (CNRS/LAL) and V. Floros (GRNET)
Content Distribution Networks
David Wetherall Spring 2000
Distributed File Systems
Operating a Secure Network
Scale and Performance in the CoBlitz Large-File Distribution Service
Administrative Things
Planning and Troubleshooting Routing and Switching
Informatica PowerCenter Performance Tuning Tips
Chapter 15: Networking Services Design Optimization
CHAPTER 3 Architectures for Distributed Systems
Introduction to Networks
Zhilin Huang Disk Hot Swap Zhilin Huang
Lame DNS Server Sweeping
Internet Networking recitation #12
Co* Projects : CoDNS, CoDeploy, CoMon
Net 323 D: Networks Protocols
Client-Server Interaction
Detection of Routing Loops and Analysis of Its Causes
Chapter 16: Distributed System Structures
NFS and AFS Adapted from slides by Ed Lazowska, Hank Levy, Andrea and Remzi Arpaci-Dussea, Michael Swift.
COS 518: Advanced Computer Systems Lecture 9 Michael Freedman
An Introduction to Computer Networking
On the Use and Performance of Content Distribution Networks
Outline Midterm results summary Distributed file systems – continued
Fault Tolerance Distributed Web-based Systems
COS 561: Advanced Computer Networks
Content Distribution Networks
AWS Cloud Computing Masaki.
Specialized Cloud Architectures
Content Delivery and Remote DNS services
Agenda Need of Cloud Computing What is Cloud Computing
EE 122: Lecture 22 (Overlay Networks)
IPv6 Reliability Measurements
AKAMAI Content Delivery Services
Upgrading Distributed Systems is not rsync
Presentation transcript:

Vivek Pai, Larry Peterson, & the CoDeeN group Princeton University CoDeeN + DNS = CoDNS Vivek Pai, Larry Peterson, & the CoDeeN group Princeton University

Origins of CoDNS CoDeeN = Open CDN on PlanetLab 40 nodes, 4+ months, 24/7 operation Approaching 2 million reqs/day Extensive node monitoring Reliability by avoiding bad nodes Reliability at lower layers = delays Delays = annoyed users Better to avoid slow peers Oct 19, 2003 RPI PlanetLab Meeting

Oct 19, 2003 RPI PlanetLab Meeting

Types of Unreliability Dead nodes High application-level packet losses Resource exhaustion (FDs, disk) DNS DNS? Yes, DNS Lookup of origin server on cache misses Oct 19, 2003 RPI PlanetLab Meeting

DNS Problems Sometimes a major cause of slowdowns May not be node-local failure Other resources salvageable Fix may help other non-CDN services DNS as a “utility” Oct 19, 2003 RPI PlanetLab Meeting

DNS-Related Avoidance Oct 19, 2003 RPI PlanetLab Meeting

Insight Use content distribution infrastructure to mask DNS resolver failures If local DNS lookups failing Send to a nearby, working node Use locality, load balancing to avoid Oct 19, 2003 RPI PlanetLab Meeting

Prototype In place on all CoDeeN nodes Tries to be intelligent Currently using custom infrastructure Will soon share CoDeeN infrastructure Tries to be intelligent Immediate remote lookup on persistent local failure Backoff-based delay otherwise Oct 19, 2003 RPI PlanetLab Meeting

Cornell – Regular Problems Time & “Failures”, regular DNS Oct 19, 2003 RPI PlanetLab Meeting

Cornell – Regular Problems Lookup times – DNS & CoDNS Oct 19, 2003 RPI PlanetLab Meeting

CMU – Cron Jobs? Time & Failures, regular DNS Oct 19, 2003 RPI PlanetLab Meeting

CMU – Cron Jobs? Lookup times – DNS & CoDNS Oct 19, 2003 RPI PlanetLab Meeting

GaTech “Disappearance” Time & Failures, regular DNS Oct 19, 2003 RPI PlanetLab Meeting

GaTech “Disappearance” Time & Failures, regular CoDNS Oct 19, 2003 RPI PlanetLab Meeting

UCLA – Failure Burst Lookup times – DNS & CoDNS Oct 19, 2003 RPI PlanetLab Meeting

Summary DNS failures fairly widespread CoDNS prototype very promising Additional overhead very tolerable Working on standalone deployment Will listen on port 53, do the right thing Goal: general PlanetLab service Oct 19, 2003 RPI PlanetLab Meeting