Basic Tutorial Part II 31/12/2018.

Slides:



Advertisements
Similar presentations
Supporting federation with the jFed framework Wim Vandenberghe, Brecht Vermeulen - iMinds Pre-FIA Workshop – Testbed Interoperability Athens, March 17th.
Advertisements

Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Compute Aggregate 1 must advertise this link. We omit the physical port on the switch to which the node is directly connected. Network Aggregate Links.
Sponsored by the National Science Foundation Lab Zero: A First Experiment.
Internet2 and AL2S Eric Boyd Senior Director of Strategic Projects
Sponsored by the National Science Foundation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen FGRE, July 7 th, 2015.
1 FGRE July 7 th – July 11 th Wifi: WelcomeATiMindS
Sponsored by the National Science Foundation Omni: a command line GENI resource reservation tool Niky Riga, Sarah Edwards GENI Project Office 13 March,
Sponsored by the National Science Foundation Tutorial: Advanced Topics in Networking Experiments using GENI Niky Riga, Sarah Edwards GENI Project Office.
Sarah Edwards, GENI Project Office
Andy Bavier, PlanetWorks Scott Baker, SB-Software July 27, 2011.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen Thijs Walcarius GEC 22, March 24 th, 2015.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Visual Experiment Management Matt Strum, University of Utah.
Sponsored by the National Science Foundation 1 September 15, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation GENI Terminology.
Sponsored by the National Science Foundation GENI Terminology: How All the Pieces Fit Together Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation 1 GREESC15– May 25, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 Last updated April 1, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the.
Sponsored by the National Science Foundation Tutorial: Introduction to Omni Niky Riga GENI Project Office GREESC13 $ omni.py createsliver aliceslice myRSpec.xml.
Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Named Data Networking.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation 1 GEC16, March 21, 2013 Are you ready for the tutorial? 1.Did you do the pre-work? A.Are you able to login.
Sponsored by the National Science Foundation 1 GREE SC: June 24, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation Tutorial: Experimenter Workflow and Topologies using GENI Niky Riga, Sarah Edwards GENI Project Office 13.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment.
Experimenter Feedback Ezra Kissel GEC12 – Kansas City, MO Nov 4 th 2011.
Sponsored by the National Science Foundation 1 Lab Zero – October 20, 2014 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sponsored by the National Science Foundation.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Named Data Networking Sarah Edwards.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Content Centric Networking.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
CS 283Computer Networks Spring 2013 Instructor: Yuan Xue.
Sponsored by the National Science Foundation GENI Terminology Sarah Edwards, GENI Project Office Violet Syrotiuk, Arizona State University.
Sponsored by the National Science Foundation 1 GEC16: March 19, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the pre-work?
6. The Open Network Lab Overview and getting started
Using the jFed tool to experiment from zero to hero
Run a Complete Experiment
Lab Zero: A First Experiment using GENI
GENI Exploring Networks of the Future
Understanding the AM API through a simple experiment
GENI Terminology Sponsored by the National Science Foundation.
Scaling Experiments.
Lab 7 - Topics Establishing SSH Connection Install SSH Configure SSH
Advanced Computing Facility Introduction
iMinds iLab.t Tutorial workshop Introduction
Basic Tutorial Part II: Virtual Wall
Basic Tutorial Part II: w-iLab.t
Lecture 16B: Instructions on how to use Hadoop on Amazon Web Services
Tutorial emulation/cloud on Virtual Wall
GENI Exploring Networks of the Future
Getting Started: Accessing Our Amazon AWS Server
Presentation transcript:

Basic Tutorial Part II 31/12/2018

What you did in part I of the tutorial Set up ssh keys and accounts Use jFed tool to login on a node With and without proxy 31/12/2018

What we will do in this tutorial What happens behind the scenes New concepts: Rspec Aggregate Manager API (AM API) Stitching Parts of this tutorial are based on GENI tutorials (US) 31/12/2018

Resource Specifications (RSpec) RSpecs are XML documents that describe resources Machines, VMs, links, etc. RSpec for a physical machine with one interface: <?xml version="1.0" encoding="UTF-8"?> <rspec type="request” xsi:schemaLocation="http://www.geni.net/resources/rspec/3 … xmlns="http://www.geni.net/resources/rspec/3"> <node client_id="node0" component_manager_id="urn:publicid:IDN+wall1.ilabt.iminds.be+authority+cm" exclusive="true"> <sliver_type name="raw-pc"/> </node> </rspec> 31/12/2018

In jFed, click: Raw RSpec 31/12/2018

RSpecs RSpec documents are exchanged by experimenter tools (e.g. jFed) and testbeds Testbeds use RSpecs to describe what they have – Advertisement RSpecs Experimenters use RSpecs to describe the resources they want – Request RSpecs Testbeds use RSpecs to describe the resources allocated to an experimenter – Manifest RSpecs 31/12/2018

The AM API Experimenter tools and testbeds talk to each other using the Aggregate Manager API (AM API) What do you have? I have … ListResources(…) I would like … Advertisement RSpec You have … CreateSliver(Request RSpec, …) Aggregate Manager Experimenter Tool What do I have? Manifest RSpec You have … ListResources(SliceName, …) Manifest RSpec 31/12/2018

jFed does these calls, check ‘call view’ Click right bottom: Green calls: okay, red calls: something wrong 31/12/2018

jFed flow Draw your experiment Raw RSpec = request RSpec Run your experiment: creates all needed resources (createSliver) Status calls: nodes turn green = manifest Rspec, see next slide Terminate experiment: free resources 31/12/2018

Manifest Rspec: go to Raw RSpec 31/12/2018

TCP ports and firewalls 12369, 12346, 11443, 8081, … Add IPv6 for node access in Europe = problems First step: Detection (connectivity tester) Second step: work around -> SSH proxy

Connectivity test (also in bug report)

SSH proxy (optional !) For API calls For SSH login Automatic SSH agent for extra comfort

Virtual Wall Authority SSH proxy: only TCP 22 Virtual Wall Authority IPv4 API calls TCP 22 IPv4 SSH TCP 22 Public SSH keys of PEM cert SSH gateway server AMs, nodes, … IPv4/IPv6 API calls SSH login Even private vpns connected to SSH gateway

Summary RSpecs: raw XML format of experiments New features of testbeds are accessible directly You can create tools/scripts to generate large RSpecs You can save and load these Rspecs: In jFed Rspec editor, you can edit/search/replace 31/12/2018

Next We will walk through a Virtual Wall or w-iLab.t specific example to show this in action Note: there are also other tools which use the same RSpecs, and do the same API calls Most are command line E.g. Omni: http://trac.gpolab.bbn.com/gcf/wiki/Omni 31/12/2018

Layer 2 stitching

Stitching

Working today iMinds Belnet 250 vlans Geant 10 vlans

Actually working well ! http://monitor.ilabt.iminds.be

Support setup http://doc.fed4fire.eu Google group: fed4fire-experimenters Extensive testing and monitoring of testbeds: http://monitor.ilabt.iminds.be/

Using those other testbeds Edit Rspec and change wall1 in wall2 and vice versa Right click node and put it in Utah Put node in wall1 and in wall2 = stitching Put node in wall2 and in Utah -> only 10 vlans available, takes about 10 minutes Demo with GENI account 31/12/2018