Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

Slides:



Advertisements
Similar presentations
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Advertisements

GUMS status Gabriele Carcassi PPDG Common Project 12/9/2004.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
Technology on the NGS Pete Oliver NGS Operations Manager.
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
Open Science Grid Frank Würthwein UCSD. 2/13/2006 GGF 2 “Airplane view” of the OSG  High Throughput Computing — Opportunistic scavenging on cheap hardware.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.
MyOSG: A user-centric information resource for OSG infrastructure data sources Arvind Gopu, Soichi Hayashi, Rob Quick Open Science Grid Operations Center.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.
Connect.usatlas.org ci.uchicago.edu ATLAS Connect Technicals & Usability David Champion Computation Institute & Enrico Fermi Institute University of Chicago.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
Publication and Protection of Site Sensitive Information in Grids Shreyas Cholia NERSC Division, Lawrence Berkeley Lab Open Source Grid.
VOX Project Status T. Levshina. Talk Overview VOX Status –Registration –Globus callouts/Plug-ins –LRAS –SAZ Collaboration with VOMS EDG team Preparation.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Overview of Monitoring and Information Systems in OSG MWGS08 - September 18, Chicago Marco Mambelli - University of Chicago
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES GGUS Overview ROC_LA CERN
OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
…building the next IT revolution From Web to Grid…
Michael Fenn CPSC 620, Fall 09.  Grid computing is the process of allowing loosely-coupled virtual organizations to share resources over a wide area.
Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
Jan 2010 OSG Update Grid Deployment Board, Feb 10 th 2010 Now having daily attendance at the WLCG daily operations meeting. Helping in ensuring tickets.
2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support
Julia Andreeva on behalf of the MND section MND review.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) The Egyptian Grid Infrastructure Maha Metawei
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
Area Coordinator Report for Operations Rob Quick 4/10/2008.
Open Science Grid OSG Resource and Service Validation and WLCG SAM Interoperability Rob Quick With Content from Arvind Gopu, James Casey, Ian Neilson,
1 Open Science Grid.. An introduction Ruth Pordes Fermilab.
Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –
User Support of WLCG Storage Issues Rob Quick OSG Operations Coordinator WLCG Collaboration Meeting Imperial College, London July 7,
Opensciencegrid.org Operations Interfaces and Interactions Rob Quick, Indiana University July 21, 2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
DIRAC for Grid and Cloud Dr. Víctor Méndez Muñoz (for DIRAC Project) LHCb Tier 1 Liaison at PIC EGI User Community Board, October 31st, 2013.
OSG STORAGE OVERVIEW Tanya Levshina. Talk Outline  OSG Storage architecture  OSG Storage software  VDT cache  BeStMan  dCache  DFS:  SRM Clients.
March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
OSG Operations – Lessons Learned CHEP 2010, 18 October 15:10 (Asia/Taipei) – Room 2, BHSS OSG Operations – Lessons Learned CHEP 2010, 18 October 15:10.
James Casey, CERN IT-GD WLCG Workshop 1st September, 2007
Regional Operations Centres Core infrastructure Centres
Open Science Grid Progress and Status
Stephen Pickles Technical Director, GOSC
Leigh Grundhoefer Indiana University
Presentation transcript:

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009

Welcome! I am happy to be joining Jose for another week of learning and working with Grids This week will be a bit different:  Aimed towards the site administrator  Fewer presentations (very few)  More hands-on 2

My background I’m a high energy physicist but have been working on various grid projects for nearly a decade (!)  Computer science projects: PPDG, GriPhyN & iVDGL  Grid infrastructure: Grid3, OSG and WLCG  My science community has been the CERN ATLAS Collaboration, and its Software and Computing projects For the last few years:  OSG Integration and Sites coordinator  Facility Integration Program manager for USATLAS  Manager of an ATLAS Tier 2 (+2kCores, 0.5 PB,10G)  You’d think I’d have some good answers by now  3

Launching a Grid Colombia Phase I:  preparations in advance of the in-person workshop Phase II:  workshop on scientific computing on Grids and Grid prototype building (that’s this workshop!)  Development of a program of work Phase III:  deployment of production facilities across multiple sites in Colombia 4

Second Week’s Goal Build a prototype Grid Colombia 5 GOC GCO GOC GCO gc2 gc1 gc3 gc4 gc5

Site Architecture Each site will be the equivalent to this Condor Globus: gram, gridftp User interface (local & grid) Ganglia monitor 6

The OSG: a simple site 7 VDT middleware Includes gLite components

The OSG: a typical Tier 2 site 8 dCache system; others: XROOTD, Lustre, GPFS, HDFS (Hadoop) STORAGE.. the hardest part

GOC services (I) GOCs are facilities usually provided at the national level as part of a NGI (National Grid Infrastructure) They can host services for more than one “Grid Facility”  Services as part of EU-based EGI, etc (EELA)  Services as part of an OSG-like Grid  (as yet, OSG only has one GOC but peers with GOCs in EGEE as part of WLCG) 9

GOC Services (II) There are many services provided by the GOC  Organizational (registration db, web portals)  Security (RA) and Operations (tickets, calls)  Technical services (hosted grid central services) Here we will focus on technical services  Information service based on ReSS  CEMon Aggregator + BDII  Gratia (Accounting)  RSV (Resource validation monitoring) 10

Sites, Central Services & Users 11 Sites GOC … Users & VOs

Virtual Organizations (VO) Virtual Organizations are communities of researchers with shared interests and resources We will use the OSGEDU VO We will learn how to:  Request certificates (for real)  Retrieve & install them (host + browser)  User, hosts, service  Gain entry into the OSGEDU VO  Use the OSGEDU VOMS on GridCo site 12

Teams Will divide into teams:  Site builders  Build a small cluster with Condor, an OSG compute element, storage element (GridFTP), worker nodes, a grid user management system  GOC team  Install, configure, validate central “goc”-like services such as an information system 13

Organization We’ll start each day with team reports from previous day Will have a lecture each morning focusing more in depth on a component Teams must “validate as you go”  To make certain services & configuration are correct Teams must “document as you go”  So you’ll have a record of what you did here to reproduce in your own lab 14

Virtualized Reference Site 15 gs1-nfs.mwt2.org gs1-ce.mwt2.org gs1-se.mwt2.org gs1-gums.mwt2.org gs1-cli.mwt2.org gs1-c001.mwt2.org gs1-c002.mwt2.org gs1-c003.mwt2.org This will be available for your login inspection

Workshop List Workshop mailing list   with subscribe gridco-ws09 Firstname Lastname in the message body (no subject  Make sure to send from your preferred account  Or just send an to me Firstname Lastname 16

Workshop Web Resources Main agenda  Has Adobe Connect URL and links for help Organizational wiki Technical references (this week) olombiaWorkshop

18