US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Advertisements

Dec 14, 20061/10 VO Services Project – Status Report Gabriele Garzoglio VO Services Project WBS Dec 14, 2006 OSG Executive Board Meeting Gabriele Garzoglio.
Role Based VO Authorization Services Ian Fisk Gabriele Carcassi July 20, 2005.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
CMS Applications Towards Requirements for Data Processing and Analysis on the Open Science Grid Greg Graham FNAL CD/CMS for OSG Deployment 16-Dec-2004.
Implementing Finer Grained Authorization in the Open Science Grid Gabriele Carcassi, Ian Fisk, Gabriele, Garzoglio, Markus Lorch, Timur Perelmutov, Abhishek.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
A Model for Grid User Management Rich Baker Dantong Yu Tomasz Wlodek Brookhaven National Lab.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
Mark L. Green, Ph.D. Grid Computational Scientist Monitoring and Information Services Architecture and Deployment University at Buffalo The State University.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Mine Altunay OSG Security Officer Open Science Grid: Security Gateway Security Summit January 28-30, 2008 San Diego Supercomputer Center.
SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.
Mar 28, 20071/9 VO Services Project Gabriele Garzoglio The VO Services Project Don Petravick for Gabriele Garzoglio Computing Division, Fermilab ISGC 2007.
VOMRS/VOMS-Admin Convergence and VO Services Project Status Tanya Levshina Computing Division, Fermilab.
Grid User Management System Gabriele Carcassi HEPIX October 2004.
Open Science Grid Monitoring and Information Services Interoperability Breakout Session Shaowen Wang August 29, 2005 OSG Blueprint Meeting.
Global Grid Forum GridWorld GGF15 Boston USA October Abhishek Singh Rana and Frank Wuerthwein UC San Diegowww.opensciencegrid.org The Open Science.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Mine Altunay July 30, 2007 Security and Privacy in OSG.
Open Science Grid An Update and Its Principles Ruth Pordes Fermilab.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Open Science Grid Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab September 1, 2005.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Overview of Privilege Project at Fermilab (compilation of multiple talks and documents written by various authors) Tanya Levshina.
Role Based VO Authorization Services Ian Fisk Gabriele Carcassi July 20, 2005.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.
OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
VO Privilege Activity. The VO Privilege Project develops and implements fine-grained authorization to grid- enabled resources and services Started Spring.
OSG AuthZ components Dane Skow Gabriele Carcassi.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
AstroGrid-D Meeting MPE Garching, M. Braun VO Management.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
OSG Site Admin Workshop - Mar 2008Using gLExec to improve security1 OSG Site Administrators Workshop Using gLExec to improve security of Grid jobs by Alain.
Sep 25, 20071/5 Grid Services Activities on Security Gabriele Garzoglio Grid Services Activities on Security Gabriele Garzoglio Computing Division, Fermilab.
Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab October 25, 2005.
OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.
VOX Project Tanya Levshina. 05/17/2004 VOX Project2 Presentation overview Introduction VOX Project VOMRS Concepts Roles Registration flow EDG VOMS Open.
Открытая решетка науки строя открытое Cyber- инфраструктура для науки GRID’2006 Dubna, Россия Июнь 26, 2006 Robertovich Gardner Университет Chicago.
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
EGEE-III INFSO-RI Enabling Grids for E-sciencE VO Authorization in EGEE Erwin Laure EGEE Technical Director Joint EGEE and OSG Workshop.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Defining the Technical Roadmap for the NWICG – OSG Ruth Pordes Fermilab.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Why you should care about glexec OSG Site Administrator’s Meeting Written by Igor Sfiligoi Presented by Alain Roy Hint: It’s about security.
Job Priorities and Resource sharing in CMS A. Sciabà ECGI meeting on job priorities 15 May 2006.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Open Science Grid Interoperability
Open Science Grid Progress and Status
Monitoring and Information Services Technical Group Report
Leigh Grundhoefer Indiana University
gLite The EGEE Middleware Distribution
Presentation transcript:

US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements

Context The purpose of this meeting is to discuss the Baseline Services for US ATLAS and US CMS use of the Open Science Grid. The output of this meeting will be given to the OSG Technical Groups and Activities to inform and help lead the OSG wide roadmap. Welcome to members of the LCG Baseline Services Working Group.

Agenda US CMS and US ATLAS Goals and Status: –Roadmap for US LHC Software and Computing. US LHC Baseline Services on OSG –With emphasis on common requirements across US ATLAS and US CMS. –How are Core Services defined, agreed to, promulgated for OSG?Sufficient, Required, Recommended, Encouraged –Grid-wide, VO-wide.. Baseline Services and Plans for LCG.

Output from Parallel Sessions Learn and inform from OSG experience to date: –Ways in which the Deployment Plan lack detail or hinder implementation –Examples of where the Blueprint informs or confuses and needed edits. –Teachings from integration and deployment of signficant new service, Privilege Short term work list for US LHC use of deployed OSG infrastructure over next 4-6 months –Including interoperability with LCG –Including understanding impact and role of emerging EGEE and gLITE services? Medium to longer term program of work needed for US LHC over next months.

Parallel Sessions - are they the right ones? Workload Management –Job installation and configuration –Job tracking and bookkeeping –Job execution environment, including data access –Policy application –Resource usage accounting and auditing Data Services –Data access - local and remote, grid wide, site side, farm wide, local to job execution. –Data movement - –Role of Reliable File Transfer services ? –Data management and Namespaces

Parallel Sessions - are they the right ones? Policy, Security and VO Services –Policy requirements and ideas for OSG short term and medium term –List issues with VOMS –List issues with proxy generation Information, Monitoring and Accounting Services –How do the basket of options play together? –Is there “a” set or “the” set –Important metrics for OSG use.

Core Services in Open Science Grid Informed by the principles in the Blueprint. Availability defined through Deployment Plan and Releases. Not all Core Services are required to be provided by a Resource Provider nor used by a VO. US ATLAS and US CMS have a required set of Core Services today. Baseline Services include that set and any extensions needed to support the US ATLAS and US CMS software and computing milestones.

Core Services in OSG 0.2 Deployment Compute Elements (CE) Gatekeeper with GT2.4 GRAM compatible interface Storage Elements (SE) A SRM v1.1 compatible interface Resource and Service Discovery –Using Clarens (and GridCAT) Virtual Organization Membership Management –VOMS server for each VO. OSG Operations –Interfaces and Workflow for Ticketing System and distributed Support Center s

Access to Batch System based Processing Service Gatekeeper with GT2.4 GRAM compatible interface Monitoring interface(s) ? Authorization via Gridmapfiles or Authorization Services. Sites may use GUMS for dynamic mapping of user PKI certificates to local accounts, invoked from the site gatekeeper. Sites may adapt SAZ to impose site authorization and access policies. VOs are expected to implement policies to prevent overload of the headnodes. Resource allocation policy will be enforced through batch queue priorities as for Grid3.

Access to Data Storage Services through SRM V1.1 Compatible interface GridFTP

Monitoring Services Monitoring through the use of Ganglia, MonaLisa and MDS. The GridCat service will be used to publish the status of and information of all the sites on the Grid.

Processing and Storage Authorization Services site application of authorization and prioritization for processing and storage facilities will be supported for roles and groups within a Virtual Organization (VO). Simple identity and VO role based authorization and prioritization will be provided for processing and storage facilities. For processing this is through use of the Globus Gatekeeper callout. For storage is will be through the SRM callout. VOMS will continue to be used as the repository to map users to VOs.

Integration Workshop, 2/05

Questions Are there core Monitoring Services required to be provided by a Resource Provider? What is the Execution Environment available to Jobs on Worker Nodes? What Information needs to be published by a Resource - CE or SE?

Policy Do VOs need access to Policies describing the accessible resources or is it “try and find out”. VOs say to make effective use of a heterogeneous infrastructure they need to be able to determine policy. –Ie they won’t use OSG if this is not there. CMS Policy Web page UofC Policy Web page cer.txthttp://griodine.uchicago.edu/~cldumitr/data/up.status.latest.up.ni cer.txt ( Will market place ensure policies are provided? Role of OSG contributors to recommend, encourage, guide –Just because services are not required does not lesson the effort and coordination needed to provide them.