AustrianGrid, LCG & more Reinhard Bischof HPC-Seminar April 8 th 2005

AustrianGrid Resources

AustrianGrid Monitor

LCG Large Hadron Collider Computing Grid >100 sites, > users, > CPUs Atlas (LCG experiment) last week : > jobs on one day

Atlas production Data Management Don Quijote Supervisor Windmill Executor LCG Lexor Executor Nordugrid Dulcinea Executor Grid2003 Capone

Grid at the moment ~4200 CPUs uses Globus-Toolkit, Condor-G

43 sites 3570 CPUs GlobusToolkit + NorduGrid Middleware (Advance Resource Connector)

Grid computing secure: each user must have a certificate (electronic passport) which contains a globally unique name e.g. /C=AT/O=AustrianGrid/O=UIBK/OU=ZID/CN=Reinhard Bischof contains the user's public key is signed by an accepted Certification Authority Grid computing is... flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions and resources (virtual organizations). ( The Anatomy of the Grid, Ian Foster, Carl Kesselman,Steven Tuecke) flexible, coordinated grids are dynamic (resources are added/removed) : there is a need for a system colllecting information on the status of the single sites (Information System), jobs must be distributed to suitable resources (compare to local resource management)

Grid: From local to global resource management Information System (Top) Certificate /C=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=Nemo Replica Location Service Which resources are available ? Many, many other clusters Storage Where are the files I need ? Mapfile C=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=Nemo.atlas job is executed e.g. as local user atlas003 PC Local resource management SGE Cluster 1 Master PC Local resource management condor Cluster 2 Master Gatekeeper Information system GridFTP Certificate /C=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=host/grid.uib k.ac.at Gatekeeper Information system GridFTP

AustrianGrid Information Index

AustrianGrid Certification Authority accepted by EU-GridPMA (European Policy Management Authority for Grid Authentication in e-Science) currently 37 CAs are accepted how to get certificates: – your group sends a registration form (available on the AustrianGrid CA webpage) nominating 2 contact persons (who must apply for certificates) to the local Registration Authority the RA sends a copy to the CA, the group is added on a pull down menu on the certificate request page – group members can request a certificate using the CA webpage: a script is generated which must be run on your computer, the request file is sent to the RA, a contact person of the group sends a consent via and you must personally contact the RA (identity card required, will be scanned)

“ global “ user management 2nd step: Authorisation LCG: – apply for membership in a virtual organization (LHC-experiment) – the VO's administrator adds the new user to the VOs ldap-server – on each site a list of members of the supported VOs is generated (mapping name of certificate -> VO) – each VO has an account pool (e.g. 50 accounts), if a user sends a job to a site for the first time a free account of the VO is assigned – accounts which aren't used for some time are recycled AustrianGrid: at the moment no automatic grid user management (users are manually added at each site) – define VOs ? (e.g. agrid, develop,..) – static / dynamic mapping to accounts ?

Using the AustrianGrid Get the software – globus toolkit rpms e.g. from nordugrid – use software on local netapp-server on /usr/site/grid, nothing to install locally, source /usr/site/grid/etc/profile.d/globus.sh to set the environment Create a proxy certificate (new private/public key, short lifetime): grid-proxy-init Your identity: /C=AT/O=AustrianGrid/O=UIBK/OU=ZID/CN=Reinhard Bischof Enter GRID pass phrase for this identity: Creating proxy Done Your proxy is valid until: for an interactive usage log in using glogin: glogin agrid1 -bash-2.05b$ exit logout Connection closed by foreign host. own resources can be added to the AustrianGrid (as the local load allows it) using the installed software on /usr/site/grid, a certificate for the host is needed

Conclusions The time of testbeds is gone, we have production grids, but.. – there remains the need for several improvements (especially data management) AustrianGrid – grid middleware (Globus Toolkit) on several resources – currently establishing core services (Information Index..) – to be decided : automatic user management – advanced middleware will be added (resource broker (DPS-group)) – for middleware development : more sites available during normal working hours would be an advantage (HPC-Cluster ?) – 96 Itanium CPUs on 6 Altix350 machines are waiting for scientific workload