OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.

Slides:



Advertisements
Similar presentations
Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab
Advertisements

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.
Collaborative Campus Grid - Practices and experiences in Leiden University Campus Grid (LUCGrid) Hui Li Feb 4, 2005.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
HEPiX Catania 19 th April 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 19 th April 2002 HEPiX 2002, Catania.
MyOSG: A user-centric information resource for OSG infrastructure data sources Arvind Gopu, Soichi Hayashi, Rob Quick Open Science Grid Operations Center.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
©Kwan Sai Kit, All Rights Reserved Windows Small Business Server 2003 Features.
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
BaBar Grid Computing Eleonora Luppi INFN and University of Ferrara - Italy.
Publication and Protection of Site Sensitive Information in Grids Shreyas Cholia NERSC Division, Lawrence Berkeley Lab Open Source Grid.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
How to Install and Use the DQ2 User Tools US ATLAS Tier2 workshop at IU June 20, Bloomington, IN Marco Mambelli University of Chicago.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Overview of Monitoring and Information Systems in OSG MWGS08 - September 18, Chicago Marco Mambelli - University of Chicago
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
OSG Software and Operations Plans Rob Quick OSG Operations Coordinator Alain Roy OSG Software Coordinator.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.
Support in setting up a non-grid Atlas Tier 3 Doug Benjamin Duke University.
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
Tools for collaboration How to share your duck tales…
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Grid Operations Lessons Learned Rob Quick Open Science Grid Operations Center - Indiana University.
HEPiX FNAL ‘02 25 th Oct 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 25 th October 2002 HEPiX 2002, FNAL.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.
OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.
T3g software services Outline of the T3g Components R. Yoshida (ANL)
Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
Discussion on data transfer options for Tier 3 Tier 3(g,w) meeting at ANL ASC – May 19, 2009 Marco Mambelli – University of Chicago
Integration TestBed (iTB) and Operations Provisioning Leigh Grundhoefer.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
OSG STORAGE OVERVIEW Tanya Levshina. Talk Outline  OSG Storage architecture  OSG Storage software  VDT cache  BeStMan  dCache  DFS:  SRM Clients.
April 18, 2006FermiGrid Project1 FermiGrid Project Status April 18, 2006 Keith Chadwick.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
What is OSG? (What does it have to do with Atlas T3s?) What is OSG? (What does it have to do with Atlas T3s?) Dan Fraser OSG Production Coordinator OSG.
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Simulation use cases for T2 in ALICE
Leigh Grundhoefer Indiana University
Module 01 ETICS Overview ETICS Online Tutorials
INFNGRID Workshop – Bari, Italy, October 2004
Presentation transcript:

OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG storage Mine Altunay, Jim Barlow – OSG security ATLAS Tier 3 meeting – ANL 8-9 June 2010

Open Science Grid Main software integrator for the middleware used in US- ATLAS Packaging (in collaboration with VDT) Configuration Documentation Testing Integration Operation (security, grid, …) Community development Support 6/8/10OSG Tier 3 support 2

Software release cycle Feature request Development and packaging (VDT) Initial testing (mainly automated, regression testing, …) Validation on VTB (Validation TestBed) Feature verification, evaluation “on the field” Integration test on ITB (Integration TestBed) Tested with all the middleware and VO software Documentation (in parallel) Release 6/8/10OSG Tier 3 support 3

Documentation New document validation owner, tester, reviewer Formal review process E.g. Reference documentation Complete documentation for end-users, administrators, developers Tier 3 documentation Support for ATLAS Tier 3 documentation 6/8/10OSG Tier 3 support 4

Tier 3 documentation Documents useful for a small OSG Site or cluster (Tier 3) Description and planning Description, installation and configuration of modules () Examples: full installation of a Tier 3 First attempt for OSG to provide a full documentation almost from the hardware to a working site Limited vertical solution Part of the OSG wiki (TWiki), main OSG documentation: 6/8/10OSG Tier 3 support 5

Tier 3 Test cluster. Virtual Tier 3 cluster Testing functionality, no performance evaluation Flexible Set of nodes allocated to test different functionalities A firewall, a set of SL 5 VMs, single and dual homed 6/8/10OSG Tier 3 support 6

Xrootd example Distributed file system used mainly by ATLAS. Packaged by VDT. New requirement raised by ATLAS Non root installation and operation Integration in ATLASLocalRootBase (manage multiple version) Simple configuration: automatic, single configuration file, multiple disks, ACLs Firewall compliance Support multi homed hosts (clusters with both private and public networks) Xrootd developers with OSG liaison produced a new version Rounds of testing, verification and changes Initial release in ATLAS managed framework Several people involved: software developer, OSG (storage, integration, Tier 3 support), ATLAS (Tier 3, Xrootd TF, development) 6/8/10OSG Tier 3 support 7

Other software packages WLCG-Client Grid client tested and compatible with ATLAS software (ROOT, Athena) Integrated in ATLASLocalRootBase (versioning, immutable VDT caches) Grid middleware Compute Element – remote job submission Storage Element – efficient data movement GridFTP BeStMan 6/8/10OSG Tier 3 support 8

Operation Security advisories (see Mine’s talk) Information system LDAP, ClassAd using BDII, CEMon, ReSS Accounting OSG Information Management System MyOSG – information portal OSG Maintenance Scheduling Tool mary_attrs_showrsvstatus=on&summary_attrs_showfqdn=on&gip_status_attrs_showtestresults=on&down time_attrs_showpast=&account_type=cumulative_hours&ce_account_type=gip_vo&se_account_type=vo_ transfer_volume&start_type=7daysago&start_date=12%2F25%2F2009&end_type=now&end_date=12%2F 25%2F2009&all_resources=on&gridtype=on&gridtype_1=on&service_central_value=0&service_hidden_va lue=0&active_value=1&disable_value=1 6/8/10OSG Tier 3 support 9

The OSG community HEP experiments, astrophysics, chemistry, biology and others Distributed production Tier 1 and Tier 2 in ATLAS Production meetings Site administrators workshops Grid schools (end users) Mailing lists 6/8/10OSG Tier 3 support 10

Support First line of support locally and from ATLAS Mailing lists osg-sites, osg-int Grid Operation Center Phone Ticket Campfire (Tue, Wed, Fri, 11:30am-3pm central) Links 6/8/10OSG Tier 3 support 11

Summary Follow ATLAS and local recommendations Follow security guidelines (local, ATLAS, 4 suggestions in Mine’s talk) Subscribe to osg-sites Use Campfire and other support resources (tickes, osg- int) Use OSG documentation as additional source of information (reference, education) 6/8/10OSG Tier 3 support 12