Emulation in Data Grid eXplorer. Emulation problematic Distributed applicationTarget environment Simulation Emulation App. Model Env. model Formal analysis.

Slides:

Advertisements

Similar presentations

Sponsors and Acknowledgments This work is supported in part by the National Science Foundation under Grants No. OCI , IIP and CNS

Advertisements

J. Kaiser University of Ulm Dept. Of Comp. Structures Jörg Kaiser Dept. Of Computer Structures University of Ulm And gets.

Windows® Deployment Services

Jennifer Rexford Princeton University MW 11:00am-12:20pm Network Virtualization COS 597E: Software Defined Networking.

Supercharging PlanetLab : a high performance, Multi-Application, Overlay Network Platform Written by Jon Turner and 11 fellows. Presented by Benjamin Chervet.

Packet Switching COM1337/3501 Textbook: Computer Networks: A Systems Approach, L. Peterson, B. Davie, Morgan Kaufmann Chapter 3.

SALSA HPC Group School of Informatics and Computing Indiana University.

This work was supported by the TRUST Center (NSF award number CCF ) 1. Setting up experiment on DETER testbed a)Created twelve pc backbone nodes.

Testbeds and the evolving research paradigm Shivendra Panwar Based on discussions with Fraida Fund, Pei Liu and Thanasis Korakis Polytechnic Institute.

11 Modelnet Emulation environment for wide-area systems

A Nation Wide Experimental Grid The Grid’5000 project: architecture and objectives Building a nation wide experimental platform for Grid researchers –

Grid’5000 Introduction to Grid' Grid’5000 A Nation Wide Experimental Grid.

Emulab.net: An Emulation Testbed for Networks and Distributed Systems Jay Lepreau and many others University of Utah Intel IXA University Workshop June.

1 In VINI Veritas: Realistic and Controlled Network Experimentation Jennifer Rexford with Andy Bavier, Nick Feamster, Mark Huang, and Larry Peterson

1 Switching and Forwarding Bridges and Extended LANs.

1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University

Scalability and Accuracy in a Large- Scale Network Emulator Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase, and David Becker.

Anthony Trinh and Rich Zieminski Department of Computer Science, Columbia University { akt2105, rez2107

An Integrated Experimental Environment for Distributed Systems and Networks B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler,

The DOCTOR Project DeplOyment and seCurisaTion of new functiOnalities in virtualized networking enviRonnements François-Xavier Aguessy – Thales Bertrand.

June 2007CRI workshop (Boston, MA) Testbeds Henning Schulzrinne Columbia University.

Overview of grid / cloud research in France Michel DAYDÉ Scientific Delegate at INS2/CNRS in charge of HPC / Grid / cloud Université de Toulouse - IRIT.

1 MASTERING (VIRTUAL) NETWORKS A Case Study of Virtualizing Internet Lab Avin Chen Borokhovich Michael Goldfeld Arik.

ENHANCING AND EVALUATION OF AD-HOC ROUTING PROTOCOLS IN VANET.

CRON: Cyber-infrastructure for Reconfigurable Optical Networks PI: Seung-Jong Park, co-PI: Rajgopal Kannan GRA: Cheng Cui, Lin Xue, Praveenkumar Kondikoppa,

Morteza Yousefi University of Science & Technology of Mazandaran Network Virtualization 1 of 22 Network Virtualization.

FIND experimental requirements David D. Clark. FIND Future Internet Design (FIND) is an NSF program (now folded in to NetSE) to envision the Internet.

PIC: Practical Internet Coordinates for Distance Estimation Manuel Costa joint work with Miguel Castro, Ant Rowstron, Peter Key Microsoft Research Cambridge.

PrimoGENI Tutorial Miguel Erazo, Neil Goldman, Nathanael Van Vorst, and Jason Liu Florida International University Other project participants: Julio Ibarra.

JuxMem: An Adaptive Supportive Platform for Data Sharing on the Grid Gabriel Antoniu, Luc Bougé, Mathieu Jan IRISA / INRIA & ENS Cachan, France Workshop.

Trace Generation to Simulate Large Scale Distributed Application Olivier Dalle, Emiio P. ManciniMar. 8th, 2012.

Test-Bed for testing scenarios of new DTN architecture AsiaFI 2008 August, 2008 Multimedia and Mobile Communication Lab.

IMDGs An essential part of your architecture. About me

Large-scale Deployment in P2P Experiments Using the JXTA Distributed Framework Gabriel Antoniu, Luc Bougé, Mathieu Jan & Sébastien Monnet PARIS Research.

Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes – Bretagne Atlantique Rennes, France

Peer-to-Peer Distributed Shared Memory? Gabriel Antoniu, Luc Bougé, Mathieu Jan IRISA / INRIA & ENS Cachan/Bretagne France Dagstuhl seminar, October 2003.

Floodless in SEATTLE : A Scalable Ethernet ArchiTecTure for Large Enterprises. Changhoon Kim, Matthew Caesar and Jenifer Rexford. Princeton University.

A Federation Architecture for DETER Ted Faber, John Wroclawski, Kevin Lahey, John Hickey University of Southern California Information Sciences Institute.

F. Cappello, O. Richard, P. Sens ---oo Draft oo--- Contact us for experiment proposal Grid eXplorer (GdX) An Instrument for eXploring the GRID F. Cappello,

Introduction of CRON Lin Xue Feb What is CRON “cron.cct.lsu.edu” testbed project is based on the Emulab system in the University of Utah. Emulab:

Heavy and lightweight dynamic network services: challenges and experiments for designing intelligent solutions in evolvable next generation networks Laurent.

Evaluation Strategies Nick Feamster CS 7260 February 26, 2007.

Impact of Topology on Overlay Multicast Suat Mercan.

Experiments in computer science Emmanuel Jeannot INRIA – LORIA Aleae Kick-off meeting April 1st 2009.

Emulab and its lessons and value for A Distributed Testbed Jay Lepreau University of Utah March 18, 2002.

Utility Computing Amin Vahdat Internet Systems and Storage Group

Hwajung Lee. Maximilien Brice, © CERN  Fact: Processor population is exploding. Technology has dramatically reduced the price of processors.  Geographic.

11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.

Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Based upon slides from Jay Lepreau, Utah Emulab Introduction Shiv Kalyanaraman

Going Large-Scale in P2P Experiments Using the JXTA Distributed Framework Mathieu Jan & Sébastien Monnet Projet PARIS Paris, 13 February 2004.

Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.

(MRC) 2 These slides are not approved for public release Resilient high-dimensional datacenter 1 Control Plane: Controllers and Switches.

Monitoring and Securing New Functions Deployed in a Virtualized Networking Environment Bertrand Mathieu, Guillaume Doyen, Wissam Mallouli, Thomas Silverston,

1 Opportunities and Challenges of Modern Communication Architectures: Case Study with QsNet CAC Workshop Santa Fe, NM, 2004 Sameer Kumar* and Laxmikant.

2005/02/231/27 Scalability and Accuracy in a Large- Scale Network Emulator Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase,

Querying the Internet with PIER CS294-4 Paul Burstein 11/10/2003.

HOW TO BUILD A BETTER TESTBED Fabien Hermenier Robert Ricci LESSONS FROM A DECADE OF NETWORK EXPERIMENTS ON EMULAB TridentCom ’

PrimoGENI – Developing GENI Aggregate for Real-Time Large- Scale Network Simulation Jason Liu, Julio Ibarra, Heidi Alvarez Florida International University.

1 Scalability and Accuracy in a Large-Scale Network Emulator Nov. 12, 2003 Byung-Gon Chun.

Grid Institute Scientific Council, September 10, 2008

Abstract Machine Layer Research in VGrADS

Dimitri Papadimitriou (ALB)

Sky Computing on FutureGrid and Grid’5000

CLUSTER COMPUTING.

Development & Evaluation of Network Test-beds

ModelNet: A Large-Scale Network Emulator for Wireless Networks Priya Mahadevan, Ken Yocum, and Amin Vahdat Duke University, Goal:

ORBIT Radio Grid Testbed – Project Highlights Nov 3, 2010

Sky Computing on FutureGrid and Grid’5000

Hwajung Lee ITEC452 Distributed Computing Lecture 1 Introduction to Distributed Systems.

Presentation transcript:

Emulation in Data Grid eXplorer

Emulation problematic Distributed applicationTarget environment Simulation Emulation App. Model Env. model Formal analysis Model checking Proof Simulation tools Env. « hardware » model Real « controlled » execution

Emulation loop Phase 1 : Configuration Phase 2 : Experimentation Measurements / Trace collect Phase 3 : Comparison with real trace Phase 4 : Extrapolation Tuning

2 types of emulation distance (latency, bandwidth, failure rate …)  dummynet based solution  Difficulty : high number of configurations (High speed network, VTHD, Internet) Number of nodes  Partitioning resources of a node  Difficulty: side effect

Related works Modelnet Network emulation / node virtualization Emulab Network emulation / nodes simulation PlanetLab Large scale distributed architecture (1000 nodes) Real condition Reproductability ?

Modelnet Router / Dummynet Virtualisation N noeuds => M noeuds N>>M

Netbed (Emulab) Similar to « Modelnet » Topology description => NS script Use of Dummynet Tools for mapping logical route => physical configuration NS simulateur to emulate several host in a node 3 Sites

(Intel Research) An open testbed for developing, deploying, and accessing planetary-scale services.

Experiences related to emulation in Data GDX System VGRID (LRI / INRIA) Simulation / Emulation (IMAG-ID) Heterogenity (Loria) Schedulling (LIFL / LRI) Data storage and data sharing (IRISA/ENS-Lyon/LIP6) Fault tolerance (LIP6 / INRIA / LRI) Security (LRI / Supélec) Cellular distributed system (LORIA/Supelec) Communication in P2P (LIFL) Network Internet emulation (LAAS - LIP6) Ingeneery (LRI) Multicast (LIP) Internet new generation

Program of the emulation sessions Grid Data Service - Gabriel Antoniu (IRISA) Scheduling Strategy for Large Scale Distributed Systems: Serge Petiton (LILF, Inria Grand-Large) A simulation tool for large scale nearest neighbor scheduling: Thomas Herault (LRI, Inria Grand-Large) Experience with Dummynet, A. Jebali (Inria Regal)