TeraGrid’s GLUE 2 Implementation

Slides:

Advertisements

Similar presentations

TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

Advertisements

Introduction to TransXChange

Peoplesoft: Building and Consuming Web Services

Software Architecture April-10Confidential Proprietary Master Data Management mainly inspired from Enterprise Master Data Management – An SOA approach.

Introduction to BIM BIM Curriculum 01.

TeraGrid’s Integrated Information Service “IIS” Grid Computing Environments 2009 Lee Liming, JP Navarro, Eric Blau, Jason Brechin, Charlie Catlett, Maytal.

GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.

TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.

GIG Software Integration Project Plan, PY4-PY5 Lee Liming Mary McIlvain John-Paul Navarro.

TeraGrid Information Services John-Paul “JP” Navarro TeraGrid Grid Infrastructure Group “GIG” Area Co-Director for Software Integration and Information.

© 2007 Open Grid Forum OGF Modeling Activities DMTF Alliance Partner Symposium Portland, 2007 July 18 Ellen Stokes

TeraGrid Information Services JP Navarro, Lee Liming University of Chicago TeraGrid Architecture Meeting September 20, 2007.

D-MON TeamCGW 08 Adopting GLUE 2.0 for Interoperation of Grid Monitoring Systems Timo Baur, Rebecca Breu, Tobias Lindinger, Anne Milbert, Gevorg Pogoshyan,

Managing Computational Activities on the Grid - from Specifications to Implementation: The GLUE 2 information model OGF25, 2nd March 2009, Catania Balázs.

INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Felix Ehm CERN IT-GD EGEE 2008 GLUE 2.0.

INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Migration to the GLUE 2.0 information schema in the LCG/EGEE/EGI.

TeraGrid Advanced Scheduling Tools Warren Smith Texas Advanced Computing Center wsmith at tacc.utexas.edu.

© 2008 Open Grid Forum OGF Activities wrt DMTF DMTF Alliance Partner Technical Symposium San Jose, 2008 March 27 Ellen Stokes

Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.

GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou

Solutions using Microsoft Content Management Server 2002 Connector for SharePoint Technologies Sue Corke Mark Harrison Microsoft UK.

Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.

Parameter Sweep and Resources Scaling Automation in Scalarm Data Farming Platform J. Liput, M. Paciorek, M. Wrona, M. Orzechowski, R. Slota, and J. Kitowski.

The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.

TeraGrid Capability Discovery John-Paul “JP” Navarro TeraGrid Area Co-Director for Software Integration University of Chicago/Argonne National Laboratory.

Integrated Information Services “IIS” JP Navarro, U. of Chicago/ANL OGF 30 October 28, 2010.

XSEDE GLUE2 Update 1. Current XSEDE Usage Using legacy TeraGrid information services Publishing compute information about clusters – Subset of XSEDE clusters.

Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.

Batch Queue Prediction Warren Smith. 12/1/2009 TeraGrid Quarterly - Batch Queue Prediction2 Recommendation Scheduling Working Group recommends that TeraGrid.

Grid Account Management: A Case Study GGF 9 PGM-RG Chicago, IL October 5-8, 2003 Doru Marcusiu Assistant Director Grid and Security.

TeraGrid Software Integration: Area Overview (detailed in 2007 Annual Report Section 3) Lee Liming, JP Navarro TeraGrid Annual Project Review April, 2008.

Glue2 support in gLite CREAM-CE and WMS Massimo Sgaravatto – INFN Padova Salvatore Monforte – INFN Catania.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios Grid Monitor E. Imamagic, SRCE OAT.

Working Group Sessions. i. XML rendering (~15 minutes, Shiraz/JP) Public comment resolution Official specification next steps ii. LDAP rendering (~1 hour,

EMI is partially funded by the European Commission under Grant Agreement RI EMI Status And Plans Laurence Field, CERN Towards an Integrated Information.

SmartCode Brad Argue INLS /19/2001.

Building Enterprise Applications Using Visual Studio®

NSF TeraGrid Review January 10, 2006

TeraGrid Information Services

GPIR GridPort Information Repository

Dynamics 365; What’s new and what’s not

Discovering Computers 2010: Living in a Digital World Chapter 14

NSF TeraGrid Review January 10, 2006

TeraGrid Information Services: Building on Globus MDS4

TeraGrid Information Services Developer Introduction

The ARC Information System

Information Services Discussion TeraGrid ‘08

Overview of MDM Site Hub

Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy

ARC GLUE2 Server-Side Status and Plans

Resource monitoring and discovery in OGSA

gLite Information System

FCT Follow-up Meeting 31 March, 2017 Fernando Meireles

gLite Information System

OGCE Portal Applications for Grid Computing

Monitoring and Information Services

Metadata Framework as the basis for Metadata-driven Architecture

Grid Coordination by Using the Grid Coordination Protocol

Health & Consumers DG SANCO Unit A.4 Information systems

Sergio Andreozzi (speaker) Laurence Field Balazs Konya

Release Updates 4.1 Recap 4.2 and 5.0 Plans.

Information System (BDII)

Health & Consumers DG SANCO Unit A.4 Information systems

Information Services Claudio Cherubino INFN Catania Bologna

L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher

Presentation transcript:

TeraGrid’s GLUE 2 Implementation NSF TeraGrid Review January 10, 2006 TeraGrid’s GLUE 2 Implementation JP Navarro, U. of Chicago/ANL TeraGrid Grid Infrastructure Group OGF 30 October 28, 2010 Charlie Catlett (cec@uchicago.edu)

Overview Initial Goals Current Status Approach Provide information for meta-scheduling resource selection Provide information to the queue prediction services Provide information to the User Portal Current Status Production on 11 of 16 TeraGrid HPC compute resources Approach Implemented only the subset of GLUE2 TeraGrid needs Automatically gathered local resource manager information Integrate into TeraGrid’s Integrated Information Services “IIS” October 28, 2010 OGF 30 - GLUE 2 Update

Solution Architecture NSF TeraGrid Review Solution Architecture January 10, 2006 TeraGrid Local Information Services TeraGrid Wide Information Services Information Consumers TeraGrid Meta-Scheduler (Condor MatchMaker) TeraGrid Batch Queue Predictor (Karnak) TeraGrid User Portal This is both a high-availability and high-throughput design Dynamic DNS provides a 15 minute ttl in failover situations Automated difference detection, manual synchronization Local Resource Manager/ Scheduler … October 28, 2010 OGF 30 - GLUE 2 Update Charlie Catlett (cec@uchicago.edu)

Schema TeraGrid has its own XML Schema based on GLUE 2.0 http://software.teragrid.org/pacman/ctss4/glue2/teragrid_glue_2.0_r01.xsd This schema is flat Base element is Entities, parent to all other entities Entities are associated using IDs Why a flat schema? Easier to compose and generate information Segregated public and private publishing (other segregation) Allow partial implementation/publishing w/o empty upper hierarchy <AdminDomain>… … …<ComputingActivity> Enables complex relationships / avoid arbitrary hierarchy <ComputingService><StorageService> <ExecutionEnvironment> -> <ComputingShare> or <Resource> Avoids content duplication October 28, 2010 OGF 30 - GLUE 2 Update

XML Rendering Private Entities Public Entities <ComputingActivity> References <ComputingShare> Public Entities <ComputingService> References <ComputingEndpoint>, <ComputingShare>, <ComputingManager> <ComputingEndpoint> References <ComputingService> <ComputingShare> <ComputingManager> References <ComputingService>, <ExecutionEnvironment> <ExecutionEnvironment> References <ComputingManager> Complete repository view: http://info.teragrid.org/web-apps/xml/reg-cat-v1/name/GLUE2Info/ October 28, 2010 OGF 30 - GLUE 2 Update

<ComputingActivity> October 28, 2010 OGF 30 - GLUE 2 Update

<ComputingService> October 28, 2010 OGF 30 - GLUE 2 Update

<ComputingEndpoint> October 28, 2010 OGF 30 - GLUE 2 Update

<ExecutionEnvironment> October 28, 2010 OGF 30 - GLUE 2 Update

More Information TeraGrid GLUE 2 Design and Coordination Warren Smith wsmith@tacc.utexas.edu TeraGrid Information Services Coordination JP Navarro navarro@mcs.anl.gov Public GLUE 2 Implementation http://software.teragrid.org/pacman/ctss4/glue2 TeraGrid Information Service http://info.teragrid.org/ October 28, 2010 OGF 30 - GLUE 2 Update