Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and.

Slides:



Advertisements
Similar presentations
Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.
Advertisements

30-31 Jan 2003J G Jensen, RAL/WP5 Storage Elephant Grid Access to Mass Storage.
Security middleware Andrew McNab University of Manchester.
Single Sign-On with GRID Certificates Ernest Artiaga (CERN – IT) GridPP 7 th Collaboration Meeting July 2003 July 2003.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Grid-based access control – n° 1 Grid-based access control for Unix environments,
Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.
5-Dec-02D.P.Kelsey, GridPP Security1 GridPP Security UK Security Workshop 5-6 Dec 2002, NeSC David Kelsey CLRC/RAL, UK
Andrew McNabTestbed / HTTPS, GridPP6, 30 Jan 2003Slide 1 UK Testbed Status Andrew McNab High Energy Physics University of Manchester.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.
29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
The National Grid Service and OGSA-DAI Mike Mineter
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
22-Apr-02D.P.Kelsey, Security, UKHEP Sysman1 Grid Security 22 Apr 2002 UK HEP Sysman Meeting David Kelsey CLRC/RAL, UK
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Middleware technology and software quality issues Andrew McNab Grid Security Research Fellow University of Manchester.
Andrew McNab - Manchester HEP - 29/30 March 2001 gridmapdir patch Overview of the problem Constraints from local systems Outline of how it works How to.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
DGC Paris Community Authorization Service (CAS) and EDG Presentation by the Globus CAS team & Peter Kunszt, WP2.
20 March 2007 VOMS etc Andrew McNabwww.gridsite.org VOMS etc Andrew McNab University of Manchester.
Andrew McNab - Manchester HEP - 6 November Old version of website was maintained from Unix command line => needed (gsi)ssh access.
Security Mechanisms The European DataGrid Project Team
Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
WebFTS as a first WLCG/HEP FIM pilot
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
10 May 2007 HTTP - - User data via HTTP(S) Andrew McNab University of Manchester.
Andrew McNab - EDG Access Control - 17 Jan 2003 EDG Site Access Control (ie Local Authorisation and Accounts) Andrew McNab, University of Manchester
Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”
Security Middleware and VOMS service status Andrew McNab Grid Security Research Fellow University of Manchester.
Andrew McNab - GridPP Security - 24 Feb 2003 GridPP Security Middleware Andrew McNab, University of Manchester
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.
Andrew McNab - SlashGrid, HTTPS, fileGridSite SlashGrid, HTTPS and fileGridSite 30 October 2002 Andrew McNab, University of Manchester
Grid Security work in 2006 Andrew McNab Grid Security Research Fellow University of Manchester.
The GridSite Security System Andrew McNab and Shiv Kaushal University of Manchester.
Andrew McNab - Access Control - 28 May 2002 Access Control and User Management (ie Local Authorisation and Accounts) Andrew McNab, University of Manchester.
EU DataGrid (EDG) & GridPP Authorization and Access Control User VOMS C CA 2. certificate dn, ca, key 1. request 3. certificate 4. VOMS cred: VO, groups,
Andrew McNabETF Firewall Meeting, NeSC, 5 Nov 2002Slide 1 Firewall issues for Globus 2 and EDG Andrew McNab High Energy Physics University of Manchester.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
Grid Security in a production environment: 4 years of running Andrew McNab University of Manchester.
Andrew McNab - Grid HTTP/HTTPS extensions Grid HTTP/HTTPS extensions 18 November 2002 Andrew McNab, University of Manchester
GridSite Web Servers for bulk file transfers & storage Andrew McNab Grid Security Research Fellow University of Manchester, UK.
Andrew McNab - Manchester HEP - 11 May 2001 Packaging / installation Ready to take globus from prerelease to release. Alex has prepared GSI openssh.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Andrew McNabSecurity Middleware, GridPP8, 23 Sept 2003Slide 1 Security Middleware Andrew McNab High Energy Physics University of Manchester.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
Andrew McNabGrid in 2002, Manchester HEP, 7 Jan 2003Slide 1 Grid Work in 2002 Andrew McNab High Energy Physics University of Manchester.
Grid Security work in 2004 Andrew McNab Grid Security Research Fellow University of Manchester.
1 AHM, 2–4 Sept 2003 e-Science Centre GRID Authorization Framework for CCLRC Data Portal Ananta Manandhar.
Andrew McNab - Security issues - 17 May 2002 WP6 Security Issues (some personal observations from a WP6 and sysadmin perspective) Andrew McNab, University.
Andrew McNab - Security issues - 4 Mar 2002 Security issues for TB1+ (some personal observations from a WP6 and sysadmin perspective) Andrew McNab, University.
GRID Security & DIRAC A. Casajus R. Graciani A. Tsaregorodtsev.
Andrew McNab - Globus Distribution for Testbed 1 Globus Distribution for Testbed 1 Andrew McNab, University of Manchester
Security Middleware Andrew McNab University of Manchester.
WLCG Authentication & Authorisation LHCOPN/LHCONE Rome, 29 April 2014 David Kelsey STFC/RAL.
Andrew McNab - Dynamic Accounts - 2 July 2002 Dynamic Accounts in TB1.3 What we could do with what we’ve got now... Andrew McNab, University of Manchester.
LHCb Grid MeetingLiverpool, UK GRID Activities Glenn Patrick Not particularly knowledgeable-just based on attending 3 meetings.  UK-HEP.
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
Dave Newbold, University of Bristol14/8/2001 Testbed 1 What is it? First deployment of DataGrid middleware tools The place where we find out if it all.
Storage Element Security Jens G Jensen, WP5 Barcelona, May 2003.
Third Party Transfers & Attribute URI ideas
StoRM: a SRM solution for disk based storage systems
CRC exercises Not happy with the way the document for testbed architecture is progressing More a collection of contributions from the mware groups rather.
Patrick Dreher Research Scientist & Associate Director
Presentation transcript:

Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and Resource Broker What about non-Testbed machines / experiments?

Andrew McNab - Manchester HEP - 31 January 2002 Integration Team ~20 people drawn from EDG middleware WP’s and WP6. Intensive integration period at CERN during October –had to have another one in December! Testbed farm of ~20 machines at CERN Presentations at CERN on 29th October for sysadmins / local experts –see these talks for technical details: Everything taking longer than planned –rollout ongoing (currently CERN, CNAF, Manchester, RAL, Lyon, NIKHEF,...) but TB1 still a moving target Don’t expect your local sysadmin to be able to do an “off the shelf” installation yet.

Andrew McNab - Manchester HEP - 31 January 2002 UK Deployment Start with UK WP6 people (+ other experts) Use mailing list has: –mailing list information –recipe for installing ~1.0 release (ie last week’s) of Computing Element, Storage Element, User Interface machine and Worker Node. –in principle, 1.1 released today Once have some WP6 sites up, then encourage more sites to test installation procedure, docs etc.

Andrew McNab - Manchester HEP - 31 January 2002

Authorisation a.k.a “how do I maintain the grid-mapfile list of certificate names and local user names?” WP6 provides a standard way of publishing lists of certificate names via an LDAP server, and selecting subsets based on group or “Virtual Organisation” (eg experiment) affiliation. gridmapdir patch to Globus provides dynamic user account allocation from a pool. Each experiment needs to maintain a “VO Server” and populate it with the DNs of their members –For LHC experiments, the VO’s are at NIKHEF.

Andrew McNab - Manchester HEP - 31 January 2002 GIIS and Resource Broker a.k.a “how do I get on the list of sites and receive jobs?” GRIS - local LDAP server on, say, a Computing Element (= site gateway) GIIS - indexing LDAP server, which receives information from GRIS’s Currently use Resource Broker at CERN - it uses local GIIS to get list of TB1 sites For sites to receive jobs, they need to be registered with the GIIS used by the users’ RB. Experiments (or even sites?) might want their own RB since easily overloaded in current architecture.

Andrew McNab - Manchester HEP - 31 January 2002 Non-Testbed1 machines / expts “Being part of Testbed 1” involves committing to using the right version of RedHat (6.2), the grid software and some extra packages. But, all of this work has been done in a modular way –some dependencies between modules, but interfaces are spelt out. Should be possible to install some or all of TB1 software on existing farms without matching participation requirements exactly. Would also be possible to use strictly compliant front end machines along with differently configured back end nodes.

Andrew McNab - Manchester HEP - 31 January 2002 Summary TB1 being rolled-out Basic job submission, brokerage etc working Ready to deploy 1.0 (and imminent 1.1) in UK Experiments need to set up VO structures Non-LHC experiments should be able to use TB1 components

Andrew McNab - Manchester HEP - 31 January 2002 Grid/Web integration Common use of SSL Importing certificates into browsers GridSite as an example application Limits to delegation Possible solutions Merging Grid / Web / Filesystems

Andrew McNab - Manchester HEP - 31 January 2002 Common use of SSL (“TLS”) https URLs based on X509 certificates and SSL protocol –eg Globus’s security infrastructure (GSI) based on X509 too –eg the user and host certificates from the UK HEP CA Host certificates (hostkey.pem / hostcert.pem) can be used directly as Apache mod_ssl credentials. Using openssl, you can easily change a PEM key / cert pair into the pkcs#12 file format used by web browsers. This works in all https-aware versions of Netscape and IE.

Andrew McNab - Manchester HEP - 31 January 2002 What does SSL buy you? Server has host certificate, so the browser can verify the server is genuine, and not someone impersonating it or doing a man in the-middle-attack. If browser has a user certificate, the user can prove who they are. –So the server can implement access control, logging etc. –Since the certificate DNs are also used in Grid applications, can share information, authorisation etc between the two. All transfers are encrypted. (Downside is that transfers are slower and impose more computational burden on the web server.)

Andrew McNab - Manchester HEP - 31 January 2002 What you need to do? Get a host certificate for the web server from a CA your users will trust (eg a TB1 CA: UK HEP CA, CERN, ….) Make sure your users have certificates from a CA you trust. Maintain a users database, including their DNs, to specify authorisation levels. –group users and specify access according to those groups? Providing simple administration tools will make things much less painful for you as number of users ramps up. (If you already have a VO authorisation server, might be able to automate a lot of this…)

Andrew McNab - Manchester HEP - 31 January 2002 Example: GridSite Written for http(s):// –also used for WP6/TB1 site: http(s)://marianne.in2p3.fr/ Maintains a database of users and groups –can be administered using a normal web browser Read and write access to directories controlled by ACLs –use same format as SlashGrid filesystem framework Since web browsers’ https and Globus GSI are both based on X509 certificates, can reuse the UK HEP CA user certificates in WWW context. Since have strong user authentification, can allow write access through a web browser.

Andrew McNab - Manchester HEP - 31 January 2002 GridSite: more information GridSite homepage at Mailing lists gridsite-announce and gridsite-discuss at jiscmail Software covered by GPL Open Source License –so you are welcome to use it, modify it, distribute modified copies –but we all share the benefit of anything you distribute Intending to go from monolithic source to LGPL library + minimal main() This will make it easier to reuse GridSite in other Grid / Web applications, portals etc.

Andrew McNab - Manchester HEP - 31 January 2002 Delegation One commonly cited web/grid integration is Job Submission Portal. But (lack of) delegation complicates this. X509 relies on having a private key and public certificate –Web browser has access to both However, this only proves to the web server that we are genuine. The web server does not have a way to then prove this to another server (eg a gatekeeper) on our behalf. Globus gets round this by forwarding temporary proxies signed by private key, but web browsers do not do this.

Andrew McNab - Manchester HEP - 31 January 2002 Delegation: possible solutions Need to have a private key trusted by destination servers, which we can use if we authenticate with the web server. This could be a personal key we have deposited with web server. Or the server may make requests using its own key on our behalf. New solution from Globus: Community Authorisation Server. This intended for non-Web contexts, but may provide a convenient solution here too. –Combine web server and CAS: requests authorised on the basis of authorisation objects/symbols granted by CAS.

Andrew McNab - Manchester HEP - 31 January 2002 Merging Grid/Web/Filesystems Globus GASS library provides read and write access to remote files using https –so already possible to use https web servers like GridSite as file servers within Grid applications –can access them via normal web browser as described above Work now starting to provide distributed filesystems using Grid protocols –SlashGrid framework ( ) –map files on remote servers to local filenames, with caching: => /grid/https/

Andrew McNab - Manchester HEP - 31 January 2002 Summary X509 security protocols common to Web and Grid Possible to use existing Grid certificates in a Web context GridSite is an Open Source demonstration of this –will provide a toolbox for people building Grid/Web applications Delegation of credentials to allow access to “third party” sites an issue –but solutions are possible More Web / Grid / Filesystem integration in the pipeline