Utility Computing Amin Vahdat Internet Systems and Storage Group

Slides:



Advertisements
Similar presentations
Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,
Advertisements

All rights reserved © 2006, Alcatel Grid Standardization & ETSI (May 2006) B. Berde, Alcatel R & I.
Interconnection Networks: Flow Control and Microarchitecture.
Perspective on Overlay Networks Panel: Challenges of Computing on a Massive Scale Ben Y. Zhao FuDiCo 2002.
SDN Controller Challenges
Software-defined networking: Change is hard Ratul Mahajan with Chi-Yao Hong, Rohan Gandhi, Xin Jin, Harry Liu, Vijay Gill, Srikanth Kandula, Mohan Nanduri,
Introduction 2 1: Introduction.
The Development of Mellanox - NVIDIA GPUDirect over InfiniBand A New Model for GPU to GPU Communications Gilad Shainer.
Southampton Open Wireless Network The Topology Talk.
11 Modelnet Emulation environment for wide-area systems
On Selfish Routing In Internet-like Environments Lili Qiu (Microsoft Research) Yang Richard Yang (Yale University) Yin Zhang (AT&T Labs – Research) Scott.
Topology Generation Suat Mercan. 2 Outline Motivation Topology Characterization Levels of Topology Modeling Techniques Types of Topology Generators.
Computer Science 1 ShapeShifter: Scalable, Adaptive End-System Multicast John Byers, Jeffrey Considine, Nicholas Eskelinen, Stanislav Rost, Dmitriy Zavin.
Overlay Networks + Internet routing has exhibited scalability - Internet routing is inefficient -Difficult to add intelligence to Internet Solution: Overlay.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
An Algebraic Approach to Practical and Scalable Overlay Network Monitoring Yan Chen, David Bindel, Hanhee Song, Randy H. Katz Presented by Mahesh Balakrishnan.
 We developed a fast and tunable crawler, Cruiser.  Cruiser uses a master-slave architecture, parallel crawling, and leverages the two-tier topology.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
1IMIC, 8/30/99 Constraint-Based Unicast and Multicast: Practical Issues Bala Rajagopalan NEC C&C Research Labs Princeton, NJ
Scalability and Accuracy in a Large- Scale Network Emulator Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase, and David Becker.
Introduction to Research on Networks Nelson Fonseca State University of Campinas.
Internet In A Slice Andy Bavier CS461 Lecture.
1 A Large-Scale Network Testbed Jay Lepreau Chris Alfeld David Andersen Kevin Van Maren University of Utah September.
ONOS Use Cases Tom Tofigh AT&T.
1 Chapter 10 Introduction to Metropolitan Area Networks and Wide Area Networks Data Communications and Computer Networks: A Business User’s Approach.
Lecture 1 Internet Overview: roadmap 1.1 What is the Internet? 1.2 Network edge  end systems, access networks, links 1.3 Network core  network structure,
A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.
Developing Analytical Framework to Measure Robustness of Peer-to-Peer Networks Niloy Ganguly.
Predicting performance of applications and infrastructures Tania Lorido 27th May 2011.
Overcast: Reliable Multicasting with an Overlay Network CS294 Paul Burstein 9/15/2003.
MIT Lincoln Laboratory VXFabric-1 Kontron 9/22/2011 VXFabric: PCI-Express Switch Fabric for HPEC Poster B.7, Technologies and Systems Robert Negre, Business.
1 High-Level Carrier Requirements for Cross Layer Optimization Dave McDysan Verizon.
Chord: A Scalable Peer-to-peer Lookup Protocol for Internet Applications Xiaozhou Li COS 461: Computer Networks (precept 04/06/12) Princeton University.
Internet Service Migration and Placement Part 1 Instructor: Xiaodong Zhang Xiaoning Ding 11/08/2004.
CS 4700 / CS 5700 Network Fundamentals Lecture 17: Network Modeling (Not Everyone has a Datacenter)
A Routing Underlay for Overlay Networks Akihiro Nakao Larry Peterson Andy Bavier SIGCOMM’03 Reviewer: Jing lu.
Paper Group: 20 Overlay Networks 2 nd March, 2004 Above papers are original works of respective authors, referenced here for academic purposes only Chetan.
Network Basics. Network Classifications Scope Scope Local area network (LAN) Local area network (LAN) Metropolitan area (MAN) Metropolitan area (MAN)
Peer Centrality in Socially-Informed P2P Topologies Nicolas Kourtellis, Adriana Iamnitchi Department of Computer Science & Engineering University of South.
Network Topologies & Routers By Scott Miller. Network Topology: is the study of the physical and logical connections between input & output devices Physical.
6 December On Selfish Routing in Internet-like Environments paper by Lili Qiu, Yang Richard Yang, Yin Zhang, Scott Shenker presentation by Ed Spitznagel.
1 Wide Area Network Emulation on the Millennium Bhaskaran Raman Yan Chen Weidong Cui Randy Katz {bhaskar, yanchen, wdc, Millennium.
1 | © 2015 Infinera Open SDN in Metro P-OTS Networks Sten Nordell CTO Metro Business Group
COS 420 Day 15. Agenda Finish Individualized Project Presentations on Thrusday Have Grading sheets to me by Friday Group Project Discussion Goals & Timelines.
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Masking Failures Using Anti Entropy and Redundant Independent Paths Rebecca Braynard and Amin Vahdat Internet Systems and Storage Group Duke University.
2005/02/231/27 Scalability and Accuracy in a Large- Scale Network Emulator Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase,
Shanghai Jiao Tong University Institute of Wireless Comm. Tech. (IWCT) 无线技术沙龙 Wireless Club 创 新 无 线 精 彩 无 限 Enabling Splendid Wireless A Theoretical Framework.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Scaling Network Emulation Using Topology Replication Second Year Project Advisor : Amin Vahdat Committee: Jeff Chase, Jun Yang.
HOW TO BUILD A BETTER TESTBED Fabien Hermenier Robert Ricci LESSONS FROM A DECADE OF NETWORK EXPERIMENTS ON EMULAB TridentCom ’
1 Scalability and Accuracy in a Large-Scale Network Emulator Nov. 12, 2003 Byung-Gon Chun.
1 Towards Scalable Pub/Sub Systems Shuping Ji 1, Chunyang Ye 2, Jun Wei 1 and Arno Jacobsen 3 1 Chinese Academy of Sciences 2 Hainan University 3 Middleware.
B4: Experience with a Globally-Deployed Software WAN
Data Center Architectures
CIS 700-5: The Design and Implementation of Cloud Networks
Mobile fog: A programming model for large-scale applications on the internet of things Kirak Hong, David lillethun, umakishore Ramachandran, beate ottenwalder,
Graciela Perera Introduction Graciela Perera
Data Center Network Architectures
Hydra: Leveraging Functional Slicing for Efficient Distributed SDN Controllers Yiyang Chang, Ashkan Rezaei, Balajee Vamanan, Jahangir Hasan, Sanjay Rao.
Managing Data Transfer in Computer Clusters with Orchestra
Network Layer Goals: Overview:
An Equal-Opportunity-Loss MPLS-Based Network Design Model
Parallel Programming in C with MPI and OpenMP
Development & Evaluation of Network Test-beds
ModelNet: A Large-Scale Network Emulator for Wireless Networks Priya Mahadevan, Ken Yocum, and Amin Vahdat Duke University, Goal:
COMPUTER NETWORKS CS610 Lecture-42 Hammad Khalid Khan.
Jellyfish: Networking Data Centers Randomly
Data Center Architectures
Presentation transcript:

Utility Computing Amin Vahdat Internet Systems and Storage Group

OPUS: An Overlay Utility Service l Dynamically allocate resources to competing services Based on changing application and network characteristics, SLAs l Create topology based app requirements Bandiwdth, latency, loss rate, cost ($) sensitivity App demand Overlay node Peering

Current Questions l What are the proper SLA’s for specifying utility for competing applications l Allocate resources among competing applications based on changing network/application conditions l Overlays that dynamically trade “performance” for “cost” Two-metric network optimization (NP-complete with centralized information) Scale to 10,000 nodes l Service overlays versus application overlays

ModelNet l Step 1: specify target wide- area topology Graph with edges augmented to include BW, latency, loss rates, etc. l Step 2: map topology to router core Graph partitioning Accuracy? Congestion? l Step 3: run real code on edge nodes Subjected to specified network char’s Gb Switch 100Mb Switch Edge Nodes Router Core

Open Questions and Status l How to introduce noise into emulation environment? l Scalability versus accuracy How far can system scale? Target: 10 node core (gigabit interconnect), 100 edge nodes l Current status Reproduced CFS results from SOSP 2001 paper Using RON network connectivity information Figures 6, 7, node gnutella network