EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks gLite configuration (plans) Robert Harakaly.

Slides:



Advertisements
Similar presentations
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
Advertisements

INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interoperability Shibboleth - gLite Christoph.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interoperability Shibboleth - gLite Christoph.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GRNET SA3 Progress Report Ioannis Liabotis.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks R-GMA Now With Added Authorization Steve.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Deployment and Support in EGEE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMSMonitor: a tool to monitor gLite WMS/LB.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Angela Poschlad (PPS-FZK), Antonio Retico.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/02/08 VOMS deployment Extent of VOMS usage in LCG-2 –Node types gLite 3.0 Issues Conclusions.
INFSO-RI Enabling Grids for E-sciencE WMS + LB Installation Emidio Giorgio Giuseppe La Rocca INFN EGEE Tutorial, Rome November.2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios for Grid Services E. Imamagic, SRCE.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
INFSO-RI Enabling Grids for E-sciencE Strategy for gLite multi-platform support Author:Eamonn Kenny Meeting:SA3 All Hands Meeting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Build Programme and Multi-Platform.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CERN status report SA3 All Hands Meeting.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Stephen Childs Trinity College Dublin &
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IPv6 test methodology Mathieu Goutelle (CNRS.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
SEE-GRID-SCI Overview of YAIM and SEE-GRID-SCI YAIM templates Dusan Vudragovic Institute of Physics Belgrade Serbia The.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The future of the gLite release process Oliver.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
EMI INFSO-RI Argus Policies in Action Valery Tschopp (SWITCH) on behalf of the Argus PT.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
VO Box Issues Summary of concerns expressed following publication of Jeff’s slides Ian Bird GDB, Bologna, 12 Oct 2005 (not necessarily the opinion of)
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Data management in LCG and EGEE David Smith.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update Authorization Service Christoph Witzig,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Progress report from University of Cyprus.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 partner collaboration tasks & process.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
YAIM gLite configuration tool Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Developing YAIM modules for Sun Grid Engine.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
TP: Grid site installation BEINGRID site installation.
INFSO-RI Enabling Grids for E-sciencE Installing & configuring Joachim Flammer Integration Team, CERN EMBRACE Tutorial, Clermont-Ferrand.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite – UNICORE interoperability Daniel Mallmann.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interoperability Shibboleth - gLite Christoph.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operations WS: Introduction & Objectives.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Imperial College SA3 Status David Colling.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementing product teams Oliver Keeble.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Configuration Data or “What should be.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Study on Authorization Christoph Witzig,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Study on Authorization Christoph Witzig,
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarksEGEE-III INFSO-RI MPI on the grid:
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Simone Campana (CERN) Job Priorities: status.
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite configuration (plans) Robert Harakaly SA3 CERN

Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction Short history Current status Overview on glite-yaim versions Plans for future Discussion

Enabling Grids for E-sciencE EGEE-II INFSO-RI History gLite 3.0: Inhomogeneous configuration of the middleware due to different configuration approaches of LCG and gLite Generally agreed need of improvement of existing YAIM Need to simplify the configuration management New configuration requirements

Enabling Grids for E-sciencE EGEE-II INFSO-RI The goals Unify the configuration process for gLite and LCG services Support new configuration requirements –DNS like VO naming –... Add flexibility to the configuration Simplify configuration development/maintenance Keep all (most of) already existing YAIM functionality Minimize impact on the users Evolutionary approach

Enabling Grids for E-sciencE EGEE-II INFSO-RI Current status/YAIM overview Three YAIM versions: –glite-yaim-3.0.0: in production (only critical bugfixes) –glite-yaim-3.0.1: DNS VO naming (current development branch) –glite-yaim-3.1: split yaim glite-yaim : full support for DNS VO naming. Currently sent to extended testing to sites willing test the new features. It has only partial support for hierarchical configuration storage. glite-yaim-3.1: Currently the prototype is written and is tested. It will replace glite-yaim-3.0.x as the sites will upgrade to new gLite release. This should contain a full support of hierarchical configuration storage and separated management of the service configuration.

Enabling Grids for E-sciencE EGEE-II INFSO-RI glite-yaim overview Already discussed during the EGEEII conference. DNS like VO naming, partial support of hierarchical configuration storage Modified special account (sgm, prd) management Improved queue management Potentially short living branch (?) Preview release sent to the sites for external testing.

Enabling Grids for E-sciencE EGEE-II INFSO-RI # YAIM example site configuration file - adapt it to your site! MY_DOMAIN=my.domain # Node names # Note: - SE_HOST --> Removed, # - REG_HOST --> There is only 1 central CE_HOST=my-ce.$MY_DOMAIN RB_HOST=my-rb.$MY_DOMAIN WMS_HOST=my-wms.$MY_DOMAIN PX_HOST=my-px.$MY_DOMAIN BDII_HOST=my-bdii.$MY_DOMAIN MON_HOST=my-mon.$MY_DOMAIN FTS_HOST=my-fts.$MY_DOMAIN REG_HOST=lcgic01.gridpp.rl.ac.uk # VO-BOX - Set this if you are building a VO-BOX VOBOX_HOST=my-vobox.$MY_DOMAIN.... # lxb1431.cern.ch specific parameters VOS=”atlas alice” # lxb1430.cern.ch specific parameters VOS=dteam SW_DIR=$VO_SW_DIR/dteam DEFAULT_SE=$CLASSIC_HOST STORAGE_DIR= $CLASSIC_STORAGE_DIR/dteam QUEUES="dteam" SGM=... USERS=ldap://lcg-vo.cern.ch/... VOMS_SERVERS=" 'vomss://lcg-voms:8443/voms/dteam...'" VOMSES=" 'dteam lcg-voms.cern.ch '" #gLite CE specific parameters.... # gLite-CE node-info.d entry gliteCE_FUNCTIONS=" config_sysconfig_edg config_host_certs config_edgusers config_users config_mkgridmap config_lcgenv config_bdii config_crl config_java config_glite_ce config_add_glite_env config_gip_vo_tag config_torque_submitter_ssh config_gip_software_plugin config_gip_service" YAIM hierarchical storage

Enabling Grids for E-sciencE EGEE-II INFSO-RI Other changes Changes in the groups.conf file The groups.conf file allows to define an optional 5 th field. It allows to define for a user a VO name which will overwrite the information from the FQAN. Special accounts management The sgm and prd users are mapped to pool users. Queue management Added _GROUP_ENABLE variables contains a space separated list of VO names and VOMS FQANs. It defines which groups are allowed to access the queue. OPSQUEUE_GROUP_ENABLE="ops /VO=atlas/GROUP=/atlas/ROLE=lcgadmin”

Enabling Grids for E-sciencE EGEE-II INFSO-RI glite-yaim-3.1 Supposed to be a standard YAIM distribution for gLite 3.1 Modular packaging : –service should provide everything needed for its configuration  glite-yaim-core (CLI and general/core functionality)  glite-yaim- (glite-yaim-CE, glite-yaim-WMS) provide: oNode-info entry (yaim/siteinfo/node-info.d) oService specific configuration functions (yaim/functions) oService specific configuration parameters (yaim/siteinfo/services) oService documentation is distributed with corresponding service can be managed independently from the other services can be managed externally

Enabling Grids for E-sciencE EGEE-II INFSO-RI Plans for glite-yaim-3.1 Full support of hierarchical storage Separated service configuration management Removed lcg-CE and lcg-RB services (supported only in 3.0.x) YAIM functions ‘re-engineering’. –Separation of all service related code from the core library.  None (or necessary minimum) of “if service == ‘XYZ’” in the library code. Most evident cases: config_gip, config_mkgridmap. The service related code (ex. config_gip_ce) should move to the service related package. –Optimization of python configuration code New features (currently in the discussion) –Will be discussed soon (many different requests)

Enabling Grids for E-sciencE EGEE-II INFSO-RI Changes for users in 3.1 Changes in YAIM are mostly “internal” therefore change for user should be zero. Except: –Non supported services: lcg-CE and lcg-RB targets will be removed. Target CE will be an alias for glite-CE. RB not clear if it should be removed or be an alias to WMSLB –Advanced configurations like local scripts (overwriting of default yaim scripts). The function naming and the functionality inside of each function will change during the re-engineering process.  To be discussed: The best way of informing about the changes

Enabling Grids for E-sciencE EGEE-II INFSO-RI YAIM testing Xen based virtual configuration testbed Deployed and tested all yaim releases before going to certification Needed also to verify 3 rd party configuration Possibility to have configuration verification by the developer before certification