Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.

Slides:



Advertisements
Similar presentations
Sponsored by the National Science Foundation GENI Instrumentation and Measurement WG: 2 nd I&M Workshop and Priority Architecture Topics GENI Engineering.
Advertisements

OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student)
Current Status (Tutorial tomorrow)
GEMINI Portal Charles Carpenter. GEMINI Portal Allows for a visual overview of slice.
FIBRE-BR Meeting GENI I&M Marcelo Pinheiro. Agenda GENI Overview GENI User groups GENI I&M Use Cases GENI I&M Services.
Project Overview Goal: Instrumentation and Measurement capabilities for GENI experimenters and operations Outcomes: Software to perform centralized and.
University of Kentucky Joint Techs 2011 Monitoring GENI Networks Jim Griffioen and Zongming Fei Laboratory for Advanced Networking University of Kentucky.
University of Kentucky GENI User Tools and the Control Plane Zongming Fei, Jim Griffioen University of Kentucky.
Sponsored by the National Science Foundation LAMP Spiral 2 Year-end Project Review University of Delaware PI: Martin Swany Staff: Eric Boyd, Jason Zurawski,
Sponsored by the National Science Foundation GENI Instrumentation and Measurement WG: 2 nd I&M Workshop and Priority Architecture Topics GENI Engineering.
SWIM WEB PORTAL by Dipti Aswath SWIM Meeting ORNL Oct 15-17, 2007.
Connect. Communicate. Collaborate WI5 – tools implementation Stephan Kraft October 2007, Sevilla.
Sponsored by the National Science Foundation netKarma Spiral 2 Year-end Project Review Indiana University Beth Plale (PI) School of Informatics and Computing.
CORDRA Philip V.W. Dodds March The “Problem Space” The SCORM framework specifies how to develop and deploy content objects that can be shared and.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Module 10: Designing an AD RMS Infrastructure in Windows Server 2008.
Deploying Experiments with Raven Scott Baker SB-Software John H. Hartman University of Arizona.
Sponsored by the National Science Foundation Omni: a command line GENI resource reservation tool Niky Riga, Sarah Edwards GENI Project Office 13 March,
OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student) GEC10 Selected.
Sarah Edwards, GENI Project Office
Instrumentation and Measurement Background. GENI I&M Motivation To conduct useful and repeatable experiments, GENI experimenters require extensive and.
Andy Bavier, PlanetWorks Scott Baker, SB-Software July 27, 2011.
GEMINI Indiana University, University of Kentucky.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
Digital Object Architecture
Sponsored by the National Science Foundation GEC16 Service Developers Roundtable: Strawman Unified I&M Tools and Services Marshall Brinn, GPO March 19,
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
Sponsored by the National Science Foundation GENI I&M Workshop GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure Mike Zink November.
Sponsored by the National Science Foundation GENI Meta-Operations Center Spiral 2 Year-end Project Review GlobalNOC at Indiana University PI: Jon-Paul.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Gathering, Transferring and Sharing MD Goals Architecture Overview –Process.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: MD Objects and Descriptors Goals Architecture Overview –Process –Functional.
GEC 101 The GENI ShadowNet Project Jim Griffioen (Kentucky) Zongming Fei (Kentucky) Kobus Van der Merwe (AT&T) Eric Boyd (Internet 2)
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Sponsored by the National Science Foundation GEC16 Plenary Session: GENI Solicitation 4 Tool Context Marshall Brinn, GPO March 20, 2013.
Sponsored by the National Science Foundation GENI I&M Update: Architecture Overview and Current Status GENI Engineering Conference 10 San Juan, PR GPO.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
OnTimeMeasure-GENI: Centralized and Distributed Measurement Orchestration Software Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Weiping Mandrawa (Network.
Sponsored by the National Science Foundation GENI I&M and Monitoring GENI Engineering Conference 14 Boston, MA Sarah Edwards Chaos Golubitsky Jeanne Ohren.
Sponsored by the National Science Foundation Monitoring Demonstration Kevin Bohan, GMOC
Sponsored by the National Science Foundation Tutorial: Introduction to Omni Niky Riga GENI Project Office GREESC13 $ omni.py createsliver aliceslice myRSpec.xml.
Sponsored by the National Science Foundation Tutorial: OpenFlow in GENI with Instrumentation and Monitoring Divya Bhat Shufeng Huang Niky Riga GENI Project.
GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1.
Sponsored by the National Science Foundation Cluster D Working Meetings GENI Engineering Conference 5 Seattle, WA July ,
Sponsored by the National Science Foundation GENI Experimenter Portal Service Developers Roundtable GENI Engineering Conference 16 Salt Lake City, Utah.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 13, Los Angeles, March 13 th 1.
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives
GeniDesktop : The GEMINI Portal (and more) Hussam Nasir University of Kentucky.
LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.
LAMP and his best friend, UNIS How to measure experiments with them 101/06/2012 Raphael Dourado Fibre-BR I&M Team Meeting.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation 1 Nov 4, 2010 Inst & Meas WG Meeting at GEC9 Thur, Nov 4, 9am – 10:30am Introductions (9am) Topic 2: Meas.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
Experiences with Measurement Data Collection on R&E Networks Christopher Small Indiana University.
Use-cases for GENI Instrumentation and Measurement Architecture Design Team members: Paul Barford - University of Wisconsin – Madison Jim Griffioen - Univ.
Sponsored by the National Science Foundation 1 Nov 4, 2010 Cluster-D Mtg at GEC9 Tue, Nov 2, 12noon – 4:30pm Meeting Chair: Ilia Baldine (RENCI) –System.
LAMP and INSTOOLS A configuration overview 118/05/2012 Raphael Dourado.
Sponsored by the National Science Foundation Measurement System Spiral 2 Year-end Project Review University of Wisconsin, Colgate University, Boston University.
Sponsored by the National Science Foundation Raven Provisioning Service Spiral 2 Year-end Project Review Department of Computer Science University of Arizona.
GIMI Tutorial GIMI Team GEC 16, Salt Lake City, March 19 th 1.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Named Data Networking Sarah Edwards.
Use-cases for GENI Instrumentation and Measurement Architecture Design Prasad Calyam, Ph.D. (PI – OnTimeMeasure, Project #1764) March 31.
Current GEMINI use of instrumentize script to initialize & configure services Hussam Nasir University of Kentucky.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
CONFIDENTIAL Overview NTP Software Object Store and Cloud Connector™ (OSCC™) has a carefully structured architecture that includes a number of collaborative.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Sharing MD Objects with Researchers, MDA Service Goals Architecture Overview.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 14, Boston, July 9 th 1.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Run a Complete Experiment
Presentation transcript:

Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview –Process –Functional Services –Measurement Data Flows/Transfers –Measurement Traffic Flows –Principal Use Cases –Types of Services –Control Framework Implications –Measurement Data Objects and Descriptors –Controlling Access to Measurement Data Objects –Current Status Current I&M Design and Prototyping Efforts I&M Service Deployments References: –I&M work in progress: –I&M capabilities catalog: –I&M architecture document: –Available I&M tools:

Sponsored by the National Science Foundation 2 March 15, 2011 GENI I&M Architecture Overview: Functional Services GENI I&M services have been defined by function: Measurement Point (MP) service Measurement Collection (MC) service Measurement Analysis and Presentation (MAP) service Measurement Orchestration (MO) service Measurement Information (MI) service User Workspace (UW) service Digital Object Archive (MDA) service

Sponsored by the National Science Foundation 3 March 15, 2011 GENI I&M Architecture Overview: Principal Use Cases Use Case 1: Experimenter gathering measurement data (MD) from their slice Use Case 2: Operator (or Service Provider) gathering measurement data (MD) from GENI infrastructure Use Case 3: Experimenter gathering measurement data (MD) from their slice and from GENI infrastructure Use Case 4: Experimenter (or Operator) moving measurement data (MD) to an archive, with an option to share with other Researchers

Sponsored by the National Science Foundation 4 March 15, 2011 Use Case 1: Experimenter gathering MD from their slice Each I&M service is setup as part of the Experimenter’s slice GENI I&M project examples: –Instrumentation Tools (for use with protoGENI) –OMF/OML –LAMP (uses perfSONAR technology, for use with protoGENI) –OnTimeMeasure (for use with protoGENI or PlanetLab) Includes: –Type 1 service: dedicated to a slice –Type 4 service: with portal to share MD

Sponsored by the National Science Foundation 5 March 15, 2011 Type 1 I&M Service: Dedicated to a slice Each Type 1 I&M service: –Dedicated to a slice –Assembled by Slice Owner (e.g., Experimenter) using Control Framework mechanisms –Configured by Slice Owner (e.g., Experimenter) –Managed by Slice Owner (e.g., Experimenter) –I&M service management interface and API required on service

Sponsored by the National Science Foundation 6 March 15, 2011 Type 4 I&M Service: With portal to share MD Each Type 4 I&M service: Has web portal to observe and share MD Web portal authorization mechanism required to admit only specified users; should reuse accepted certificate/credential arrangements Example: Presentation service that is part of Instrumentation Tools Example: Digital Object Archive (DOA) service prototype from CNRI DOA service required to follow sharing policy within Descriptor associated with a Digital Object

Sponsored by the National Science Foundation 7 March 15, 2011 Use Case 2: Operator (or Service Provider) Gathering MD from GENI infrastructure An Operator (or Service Provider) can gather MD from GENI infrastructure into their slice –For their own use –To share with other operators, e.g., share with GMOC Includes: –Type 2 service: common service with multiple slivers –Type 3 service: common service with MD to multiple slices

Sponsored by the National Science Foundation 8 March 15, 2011 Type 2 I&M Service: Common service with multiple slivers Each Type 2 I&M service: –Common service, assembled, configured and managed by a Service Provider (or Operator) in their sliver using Control Framework (CF) mechanisms –Service Provider runs an AggMgr interface and offers slivers (e.g., MP service slivers, or UW service slivers, as shown above) to other Operators (or Experimenters) via CF mechanisms –Each sliver is a resource with an rspec –Example: Measurement System for packet capture from Univ Wisconsin –Example: User Workspace (UW) service prototype from CNRI

Sponsored by the National Science Foundation 9 March 15, 2011 Type 3 I&M Service: Common service with MD to multiple slices Each Type 3 I&M service: Common service assembled, configured and managed by a Service Provider (or Operator) in their sliver using Control Framework (CF) mechanisms Service Provider (or Operator) registers Descriptors of available MD Objects (e.g., MD flows, as shown above) with Measurement Information (MI) service Example: perfSONAR MP and MI services Operator (or Experimenter) finds and requests a flow from the I&M service Authorization mechanism required to make flow available to selected operators/experimenters.

Sponsored by the National Science Foundation 10 March 15, 2011 Use Case 3: Experimenter gathering MD from their slice and from GENI infrastructure An Experimenter can gather MD from their slice and from GENI infrastructure –Combines Use Case 1 with Use Case 2 Includes Type 2 service: common service with multiple slivers –Policy required to make sliver available to selected experimenters Includes Type 3 service: common service with MD to multiple slices –Access mechanism required to make flow available to selected experimenters Includes Type 1 service: dedicated to a slice –Configured to stitch flow into experimenter’s I&M service

Sponsored by the National Science Foundation 11 March 15, 2011 Use Case 4: Experimenter (or Operator) moving MD to an archive, with an option to share with other Researchers An Experimenter (or Operator) can move MD Objects (directories or files) to (and from) a Type 2 User Workspace (UW) service Always includes associated MD Object Descriptor (“metadata”) Identifiers and annotation in Descriptors allow Experimenter (or Operator) to manage thousands of files gathered during an experiment, or when monitoring infrastructure The Experimenter (or Operator) can move selected MD Objects (directories or files) from UWservice to the Type 4 Digital Object Archive (DOA) service, to become persistent Digital Objects Digital Object receives a persistent global identifier Digital Object includes an associated Descriptor Descriptor includes sharing policy, that DOA service is obligated to follow

Sponsored by the National Science Foundation 12 March 15, 2011 GENI I&M Architecture Overview: Control Framework (CF) Implications I&M services are built by Experimenters/Operators/Service Providers using CF functions –I&M service is a resource An I&M service (type 2) can offer slivers as resources via CF –I&M service must support an AggMgr interface –I&M sliver as a resource requires an rspec –Requires policy for selected experimenters and/or operators I&M service has a standardized management interface/API linked to Measurement Orchestration (MO) service via CF mechanisms –For example, keys are installed that are used to sign messages I&M service requires proxies (or other methods) to permit measurement traffic flows (data and management) to reach servers in private address space