1. EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Batch Systems and the Info (Dynamic) Provider scripts Jan Just Keijser Nikhef Amsterdam

2. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 2 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Outline Generic Info provider (GIP) scripts Current situation Future situation Impact on batch system integration Upgrade path Questions

3. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 3 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 GIP scripts (1)‏ What are they? –Provide LDIF information about a grid service in accordance to the data model adopted (Glue schema)‏ –It can be used to produce any kind of information for use with LDAP based grid information systems –Dynamic information (es. Running jobs, Free CPUs) is updated by means of GIP plug-ins (from: G. Misurelli, CNAF INFN, I Corso di formazione INFN per amministratori di siti Grid)‏

4. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 4 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 GIP scripts (2)‏ Static information is inserted into GIP using a static LDIF file Which scripts currently exist for dynamic information? –lcg-info-dynamic-{pbs,lsf,condor,sge}  These scripts query the underlying batch system directly –lcg-info-dynamic-scheduler  Uses a plugin architecture  The plugins query the underlying batch system  Two types of plugins: lrmsinfo and vomaxjobs lrmsinfo scripts: lrmsinfo-{pbs,lsf,condor,sge} vomaxjobs scripts: vomaxjobs-{maui,lsf}

5. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 5 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Current Situation

6. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 6 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Future Situation

7. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 7 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 So how does this affect batch system integration? Impact on BSI (1)‏

8. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 8 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Impact on BSI (2)‏ Initially nothing changes for BSI –If no new lrmsinfo and vomaxjobs scripts are written then the behaviour is as before In the new setup there are actually less scripts to write and maintain There will not be a big-bang upgrade but a very phased upgrade path with full backward compatibility The BSI cookbook will contain information on the new setup only More details: https://twiki.cern.ch/twiki/bin/view/EGEE/BatchSystems

9. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 9 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Upgrade Path (1)‏ This transition will not be a big-bang upgrade but will be phased, e.g, for the batch system 'pbs': 1.a new version of the 'lcg-info-dynamic-scheduler' will be rolled out, with a flag 'use_old_style_output' set. If no new 'lrmsinfo-pbs' and 'vomaxjobs-maui' scripts are installed then the behaviour is as before 2.new versions of the 'lrmsinfo-pbs' and 'vomaxjobs-maui' scripts will be rolled out, but they will still produce old-style output (using a configuration setting)‏ 3.the 'lrmsinfo-pbs' and 'vomaxjobs-maui' scripts will be configured to produce 'new style' output (Protocol_V2)‏ 4.as the 'lcg-info-dynamic-scheduler' script still has it's configuration setting 'use_old_style_output' set, the GIP will not see anything different

10. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 10 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Upgrade Path (2)‏ Now for the new features: 1.the 'lcg-info-dynamic-pbs' script is stopped 2.the 'use_old_style_output' flag is set to 'false' in the 'lcg-info-dynamic- scheduler' script The GIP now receives all information from only the 'lcg-info-dynamic- scheduler' script. Thus a phased upgrade can be done for each batch system.

11. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 11 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667

12. Batch System Integration Update – SA3 AllHands@Cyprus - May 7 th / 8 th 2009AllHands@Cyprus 12 Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 Questions