LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.

Slides:



Advertisements
Similar presentations
OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student)
Advertisements

Current Status (Tutorial tomorrow)
GEMINI Portal Charles Carpenter. GEMINI Portal Allows for a visual overview of slice.
An Instrumentation and Measurement Architecture Supporting Multiple Control Monitoring Frameworks XXX Brazilian Symposium on Computer Networks and Distributed.
FIBRE-BR Meeting GENI I&M Marcelo Pinheiro. Agenda GENI Overview GENI User groups GENI I&M Use Cases GENI I&M Services.
Project Overview Goal: Instrumentation and Measurement capabilities for GENI experimenters and operations Outcomes: Software to perform centralized and.
University of Kentucky GENI User Tools and the Control Plane Zongming Fei, Jim Griffioen University of Kentucky.
Sponsored by the National Science Foundation LAMP Spiral 2 Year-end Project Review University of Delaware PI: Martin Swany Staff: Eric Boyd, Jason Zurawski,
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
NetKarma Portal Chris Small. Portal Goals Make it much easier for experimenters to capture provenance data with experiment Integrate with: – Measurement.
OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student) GEC10 Selected.
Instrumentation and Measurement Background. GENI I&M Motivation To conduct useful and repeatable experiments, GENI experimenters require extensive and.
GEMINI Indiana University, University of Kentucky.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
Digital Object Architecture
Sponsored by the National Science Foundation GEC16 Service Developers Roundtable: Strawman Unified I&M Tools and Services Marshall Brinn, GPO March 19,
Sponsored by the National Science Foundation GENI I&M Workshop GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure Mike Zink November.
Sponsored by the National Science Foundation GENI Meta-Operations Center Spiral 2 Year-end Project Review GlobalNOC at Indiana University PI: Jon-Paul.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Gathering, Transferring and Sharing MD Goals Architecture Overview –Process.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
Resource Representations in GENI: A path forward Ilia Baldine, Yufeng Xin Renaissance Computing Institute,
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: MD Objects and Descriptors Goals Architecture Overview –Process –Functional.
Sponsored by the National Science Foundation GEC16 Plenary Session: GENI Solicitation 4 Tool Context Marshall Brinn, GPO March 20, 2013.
Sponsored by the National Science Foundation GENI I&M Update: Architecture Overview and Current Status GENI Engineering Conference 10 San Juan, PR GPO.
Sponsored by the National Science Foundation GENI I&M and Monitoring GENI Engineering Conference 14 Boston, MA Sarah Edwards Chaos Golubitsky Jeanne Ohren.
1 Week #10Business Continuity Backing Up Data Configuring Shadow Copies Providing Server and Service Availability.
Troubleshooting GridFTP flows with XSP and Periscope Dan Gunter, presenter Ahmed El-Hassany, Ezra Kissel, Guilherme Fernandes, Martin Swany.
ASCR/ESnet Network Requirements an Internet2 Perspective 2009 ASCR/ESnet Network Requirements Workshop April 15/16, 2009 Richard Carlson -- Internet2.
Ph No: Mob: , plot No-27, NGGO's Colony, Pattabhi reddy gardens, Visakhapatnam-07 Oracle.
GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
MonIPÊ & SE-CIPÓ April/2012 Advances on End-to-End Network Monitoring and Provisioning Services on Global Scale Spring 2012 Internet2 Member Meeting Arlington,
Connect. Communicate. Collaborate The authN and authR infrastructure of perfSONAR MDM Ann Arbor, MI, September 2008.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives
LAMP and his best friend, UNIS How to measure experiments with them 101/06/2012 Raphael Dourado Fibre-BR I&M Team Meeting.
Network Schemata Martin Swany. Perspective UNIS – Uniform Network Information Schema –Unification of perfSONAR Lookup Service (LS) and Topology Service.
GEMINI + An MDIP Proposal 120/07/2012 Raphael Dourado Fibre-BR I&M Team Meeting.
Experiences with Measurement Data Collection on R&E Networks Christopher Small Indiana University.
LAMP: Leveraging and Abstracting Measurements with perfSONAR Guilherme Fernandes
Internet2’s Dynamic Circuit Infrastructure Ciena CoreDirectors OSCARS + DRAGON for dynamic circuit allocation ION.
GENI Instrumentation and Measurement System - Schema Martin Swany.
LAMP and INSTOOLS A configuration overview 118/05/2012 Raphael Dourado.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
LAMP: Leveraging and Abstracting Measurements with perfSONAR Guilherme Fernandes Status Report.
Sponsored by the National Science Foundation Raven Provisioning Service Spiral 2 Year-end Project Review Department of Computer Science University of Arizona.
DICE: Authorizing Dynamic Networks for VOs Jeff W. Boote Senior Network Software Engineer, Internet2 Cándido Rodríguez Montes RedIRIS TNC2009 Malaga, Spain.
GIMI Tutorial GIMI Team GEC 16, Salt Lake City, March 19 th 1.
GEMINI: Active Network Measurements Martin Swany, Indiana University.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
Use-cases for GENI Instrumentation and Measurement Architecture Design Prasad Calyam, Ph.D. (PI – OnTimeMeasure, Project #1764) March 31.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
Current GEMINI use of instrumentize script to initialize & configure services Hussam Nasir University of Kentucky.
Designing a Federated Testbed as a Distributed System Robert Ricci, Jonathon Duerig, Gary Wong, Leigh Stoller, Srikanth Chikkulapelly, Woojin Seok 1.
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Sharing MD Objects with Researchers, MDA Service Goals Architecture Overview.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 14, Boston, July 9 th 1.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Federating Data in the ALICE Experiment
Using the jFed tool to experiment from zero to hero
Landsat Remote Sensing Workflow
Internet2 Performance Update
Oracle Solaris Zones Study Purpose Only
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
EPIC INFOTECH CONSULTING GROUP
Presentation transcript:

LAMP: Bringing perfSONAR to ProtoGENI Martin Swany

perfSONAR Overview The perfSONAR framework provides key components necessary in a large-scale, federated, interoperable measurement infrastructure –Information service (topology and service discovery) –Measurement points and archives Developed and deployed by research and education networks –Internet2, ESnet, GEANT, and RNP –Other international networks

perfSONAR Open and extensible formats Separation of data and metadata Extensible topology and service schema called UNIS –Also used by Internet2 ION, ESnet OSCARs

LAMP LAMP integrates perfSONAR to provide extensible, unified network and host metrics in a common interface for GENI experiments –A measurement metadata format and storage infrastructure that can be extended to uniformly store all instrumentation within the GENI system Provides a measurement portal with control and visualization interfaces to the user Interoperates with existing security model within ProtoGENI

LAMP Workflow 1.User provides a resource specification annotated with an initial LAMP configuration –Specifies a dedicated “portal” node, the custom LAMP disk image, and bootstrap behavior 2.User creates a slice and allocates requested sliver resources 3.Resulting manifest and slice credential are sent to UNIS with provided scripts –UNIS now contains a representation of the experimental topology with I&M properties 4.Once the user’s slivers become active, the portal is reachable only with proper slice credentials from the SA 5.The user may then activate a number of measurement services from the portal, including: –Host monitoring (CPU, memory, disk, network) –Scheduled throughput and delay testing –Experiment-wide NTP services –The Periscope topology and measurement visualization tool 6.Current LAMP I&M configuration is saved and pushed to a UNIS store 7.Configured systems within the experiment pull and apply the configuration, collecting and reporting measurements within instantiated MAs

Periscope