SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.

Slides:

Advertisements

Similar presentations

TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

Advertisements

SAN DIEGO SUPERCOMPUTER CENTER Inca 2.0 Shava Smallen Grid Development Group San Diego Supercomputer Center June 26, 2006.

CPSCG: Constructive Platform for Specialized Computing Grid Institute of High Performance Computing Department of Computer Science Tsinghua University.

Test harness and reporting framework Shava Smallen San Diego Supercomputer Center Grid Performance Workshop 6/22/05.

26/05/2004HEPIX, Edinburgh, May Lemon Web Monitoring Miroslav Šiket CERN IT/FIO

The Premier Software Usage Analysis and Reporting Toolset CELUG Presentation – May 12, 2010 LT-Live : License Tracker’s License Server Monitor.

Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)

1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.

DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance

Workload Management Workpackage Massimo Sgaravatto INFN Padova.

6th Biennial Ptolemy Miniconference Berkeley, CA May 12, 2005 Distributed Computing in Kepler Ilkay Altintas Lead, Scientific Workflow Automation Technologies.

Distributed Application Management Using PLuSH Jeannie Albrecht, Christopher Tuttle, Alex C. Snoeren, and Amin Vahdat UC San Diego CSE {jalbrecht, ctuttle,

Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.

Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.

© 2012 IBM Corporation Tivoli Workload Automation Informatica Power Center.

CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:

TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.

Ashok Agarwal 1 BaBar MC Production on the Canadian Grid using a Web Services Approach Ashok Agarwal, Ron Desmarais, Ian Gable, Sergey Popov, Sydney Schaffer,

TeraGrid Information Services JP Navarro, Lee Liming University of Chicago TeraGrid Architecture Meeting September 20, 2007.

TeraGrid Science Gateways: Scaling TeraGrid Access Aaron Shelmire¹, Jim Basney², Jim Marsteller¹, Von Welch²,

SAN DIEGO SUPERCOMPUTER CENTER Working with Inca Reporters Jim Hayes Inca Workshop September 4-5, 2008.

CTSS 4 Strategy and Status. General Character of CTSSv4 To meet project milestones, CTSS changes must accelerate in the coming years. Process –Process.

Daniel Vanderster University of Victoria National Research Council and the University of Victoria 1 GridX1 Services Project A. Agarwal, A. Berman, A. Charbonneau,

CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.

1 Overview of the Application Hosting Environment Stefan Zasada University College London.

Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.

CSF4 Meta-Scheduler Name: Zhaohui Ding, Xiaohui Wei

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

SAN DIEGO SUPERCOMPUTER CENTER Inca Data Display (data consumers) Shava Smallen Inca Workshop September 5, 2008.

1 / 22 AliRoot and AliEn Build Integration and Testing System.

Kurt Mueller San Diego Supercomputer Center NPACI HotPage Updates.

TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.

SciDAC SSS Quarterly Report Sandia Labs August 27, 2004 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.

Lemon Monitoring Miroslav Siket, German Cancio, David Front, Maciej Stepniewski CERN-IT/FIO-FS LCG Operations Workshop Bologna, May 2005.

1 Oracle Enterprise Manager Slides from Dominic Gélinas CIS

GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.

SAN DIEGO SUPERCOMPUTER CENTER Inside the Inca Depot Jim Hayes Inca Workshop September 4-5, 2008.

Information Services Andrew Brown Jon Ludwig Elvis Montero grid:seminar1:lectures:seminar-grid-1-information-services.ppt.

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.

SAN DIEGO SUPERCOMPUTER CENTER Inca Control Infrastructure Shava Smallen Inca Workshop September 4, 2008.

Grid Monitoring and Information Services: Globus Toolkit MDS4 & TeraGrid Inca Jennifer M. Schopf Argonne National Lab UK National eScience Center (NeSC)

Portal Update Plan Ashok Adiga (512)

SAN DIEGO SUPERCOMPUTER CENTER Administering Inca with incat Jim Hayes Inca Workshop September 4-5, 2008.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.

INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.

Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing

Grid Interoperability Update on GridFTP tests Gregor von Laszewski

Global ADC Job Monitoring Laura Sargsyan (YerPhI).

SAN DIEGO SUPERCOMPUTER CENTER Welcome to the 2nd Inca Workshop Sponsored by the NSF September 4 & 5, 2008 Presenters: Shava Smallen

Daniele Spiga PerugiaCMS Italia 14 Feb ’07 Napoli1 CRAB status and next evolution Daniele Spiga University & INFN Perugia On behalf of CRAB Team.

Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group

CEDPS Services Area Update CEDPS Face-to-Face Meeting ANL October 2007.

Quality Assurance (QA) Working Group Update July 1, 2010 Kate Ericson (SDSC) Shava Smallen (SDSC)

CTSS Rollout update Mike Showerman JP Navarro April

The Storage Resource Broker and.

03/09/2007http://pcalimonitor.cern.ch/1 Monitoring in ALICE Costin Grigoras 03/09/2007 WLCG Meeting, CHEP.

CTSSv3 Cutover Checklist Draft 3 JP Navarro, Lee Liming May 25, 2006.

Monitoring Guy Warner NeSC Training.

Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.

© 2014 VMware Inc. All rights reserved. Cloud Archive for vCloud ® Air™ High-level Overview August, 2015 Date.

Breaking the frontiers of the Grid R. Graciani EGI TF 2012.

ConTZole Tomáš Kubeš, 2010 atlas-tz-monitoring.cern.ch An Interactive ATLAS Tier-0 Monitoring.

SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,

A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.

Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Status of SRB/SRM interface development Fu-Ming Tsai Academia Sinica Grid Computing.

OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.

SciDAC SSS Quarterly Report Sandia Labs January 25, 2005 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.

Overview – SOE PatchTT December 2013.

Presentation transcript:

SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006

SAN DIEGO SUPERCOMPUTER CENTER Outline Inca 2 overview CTSSv3 Inca deployment Current views of data Future work

SAN DIEGO SUPERCOMPUTER CENTER Inca Inca is a framework for the automated testing, benchmarking and monitoring of Grid resources Inca: schedules execution of information gathering scripts (reporters) collects, archives, publishes data

SAN DIEGO SUPERCOMPUTER CENTER Motivation for Inca 2 Inca 1 was a prototype Experiences using Inca: Testing is an iterative refinement process Testing is a trade-off between freshness of data and impact on resource Needed more scalable and flexible data storage

SAN DIEGO SUPERCOMPUTER CENTER Inca 2 Feature: Improved installation and configuration control GUI tool for centralized administration Reporter sharing via repositories Proxy management via MyProxy Incat screenshot

Inca 2 feature: Full Report Archiving Inca report - completed Inca report - error Inca 1 archiving Inca 2 archiving … download bandwidth kb/sec 1 … 0 wget command failed: --15:29: => `/dev/null' Resolving failed: Host not found. …

SAN DIEGO SUPERCOMPUTER CENTER Inca 2: Additional features Flexible querying interface - relational db backend (postgres for TG) Profile reporter system usage Inca components communicate using SSL

Resource 2 Resource 1Resource N … reporter manager reporter manager reporter manager reporter repository agent 1. The user creates a suite using incat and submits it to the agent suite depot 2. The agent - fetches reporters from the reporter repository - creates a reporter manager on each resource - sends the suite and reporters to each reporter manager. R R R R 3. Each reporter manager executes reporters according to its schedule and sends results (reports) to the depot 4. Data consumers display collected data (reports) by querying the depot data consumers incat suite R R Inca 2 Architecture

SAN DIEGO SUPERCOMPUTER CENTER Outline Inca 2 overview CTSSv3 Inca deployment Current views of data Future work

SAN DIEGO SUPERCOMPUTER CENTER Inca 2 TeraGrid Deployment: CTSSv3 32 packages: Globus, SRB, Condor-G, MPICH, Softenv, etc. 123 possible Inca tests: 45 unit or functionality tests Services: BLAS, uberftp, etc. 29 compatible version tests Version: HDF, Condor-g, etc. 49 cross-site functionality tests Cross-site: Globus GRAM, GridFTP, gsissh

SAN DIEGO SUPERCOMPUTER CENTER List of Running Tests

SAN DIEGO SUPERCOMPUTER CENTER List of Running Tests (cont)

SAN DIEGO SUPERCOMPUTER CENTER Outline Inca 2 overview CTSSv3 Inca deployment Current views of data Future work

Current Pages Linked from Repo

SW packages Resources Software Stack Detail View

Software Stack Summary View

Single Result View

Single Result View (cont.)

Cross-site Tests

SAN DIEGO SUPERCOMPUTER CENTER Security Status Page

Grid Jobs Status Page (Users)

Grid Jobs Status Page (CA)

SAN DIEGO SUPERCOMPUTER CENTER Outline Inca 2 overview CTSSv3 Inca deployment Current views of data Future work

SAN DIEGO SUPERCOMPUTER CENTER Softenv keys Resources

SAN DIEGO SUPERCOMPUTER CENTER Default Environment Environ variables Resources

SAN DIEGO SUPERCOMPUTER CENTER Historical Graphs

SAN DIEGO SUPERCOMPUTER CENTER Historical Graphs

SAN DIEGO SUPERCOMPUTER CENTER Error tracking over time

SAN DIEGO SUPERCOMPUTER CENTER More information Inca Web Page: TeraGrid Inca Status Pages