1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania

Overview Job Workflow in gLite gLite Porting on Windows Grid2Win crossplatform GUI Computing Farms on Windows MS-CCS video running gLite jobs Next Steps Job Workflow in gLite gLite Porting on Windows Grid2Win crossplatform GUI Computing Farms on Windows MS-CCS video running gLite jobs Next Steps

Job Workflow in gLite Computing power Grid Terminal

More on Computing Elements (CE) Computing Element Service oriented Local Resource Manager (LRMS) It is NOT a Grid component Local administration Dispatches job across Worker Nodes Accessed by local users Faces computing power to the grid Gatekeeper Access point of the CE Manages one or more job queues Wraps the LRMS Worker Nodes More than one (cluster) Execute both local and grid jobs Computing Element Service oriented Local Resource Manager (LRMS) It is NOT a Grid component Local administration Dispatches job across Worker Nodes Accessed by local users Faces computing power to the grid Gatekeeper Access point of the CE Manages one or more job queues Wraps the LRMS Worker Nodes More than one (cluster) Execute both local and grid jobs To execute grid jobs, a specific environment must be set

Goals gLite on Linux Grid users use the gLite middleware from Linux-based User Interfaces via CLI (almost) All gLite resources are Linux-based This implies Grid users need to be trained Only Linux-based applications can be deployed onto the Grid Porting of gLite to Windows User Interface Computing Element (farm) gLite on Linux Grid users use the gLite middleware from Linux-based User Interfaces via CLI (almost) All gLite resources are Linux-based This implies Grid users need to be trained Only Linux-based applications can be deployed onto the Grid Porting of gLite to Windows User Interface Computing Element (farm) new users come in to the grid ! windows applications can run on the grid !

gLite porting on Windows User Interface Client tools Grid Security Infrastructue (GSI) Workload Management Service (WMS) Logging and Bookkeeping (L&B) Data Management Service (DMS) Information System (BDII) Grid2Win Graphical User Interface Computing Element Monitoring Grid Resource Information Index (GRIS) server Torque/MAUI (PBS) Linux head node Windows XP Worker Nodes Microsoft Compute Cluster Server (CCS) Linux auxiliary node Windows XP CCS farm User Interface Client tools Grid Security Infrastructue (GSI) Workload Management Service (WMS) Logging and Bookkeeping (L&B) Data Management Service (DMS) Information System (BDII) Grid2Win Graphical User Interface Computing Element Monitoring Grid Resource Information Index (GRIS) server Torque/MAUI (PBS) Linux head node Windows XP Worker Nodes Microsoft Compute Cluster Server (CCS) Linux auxiliary node Windows XP CCS farm Done !!! Prototyped !!! Done !!!

Grid2Win GUI Prototype Grid2Win GUI wxWindows Cross platform Open source Indipendent of underlying CLI Installer 11Mbytes (including the cygwin DLL) gLite Command Line Interface Recompiled via Cygwin tools under Windows XP Cygwin Emulates POSIX environment on Windows Only the Cygwin DLL must be installed Grid2Win GUI wxWindows Cross platform Open source Indipendent of underlying CLI Installer 11Mbytes (including the cygwin DLL) gLite Command Line Interface Recompiled via Cygwin tools under Windows XP Cygwin Emulates POSIX environment on Windows Only the Cygwin DLL must be installed Platform independent

Status of the porting of the UI Grid Security Infrastructure Credentials management with VOMS extensions voms-proxy-* commands Workload Management Job submissions and output retrieving glite-wms-job-* commands File Transfer Secure transfer with credential management GSIFTP (globus-url-copy) RFIO commands (rf*) Grid Security Infrastructure Credentials management with VOMS extensions voms-proxy-* commands Workload Management Job submissions and output retrieving glite-wms-job-* commands File Transfer Secure transfer with credential management GSIFTP (globus-url-copy) RFIO commands (rf*) Data Management File Catalogue Browsing lfc-* command Data Movement and Replication lcg-* commands Information System lcg-info lcg-infosites LDAP Explorer integrated within Grid2Win GUI

Grid2Win GUI snapshots (1/5) GSI credentials Auto detection of the validity of the stored proxy Generation of a new proxy via the insertion of the passphrase Virtual Organization Membership Service (VOMS) extensions support GSI credentials Auto detection of the validity of the stored proxy Generation of a new proxy via the insertion of the passphrase Virtual Organization Membership Service (VOMS) extensions support

Grid2Win GUI snapshots (2/5) File Catalogue browsing !!! Local file system explorer Grid File Catalogue explorer (LFC) You can navigate the remote Grid File Catalogue as it was local !!!

Grid2Win GUI snapshots (3/5) You can copy and paste a file from the local explorer to the catalogue browser and viceversa. Drag & drop is under development. Upload/download of files to/from grid

Grid2Win GUI snapshots (4/5) Job Management A job is submitted just by double-clicking You can check job status and download job’s output just by double- clicking on the Job Identifier !!!

Grid2Win GUI snapshots (5/5) Information Index (BDII) Navigation You can navigate the remote Information Index (BDII) as you navigate any other local information trees !!!

Porting PBS based CE to Windows XP Computing Element (CE) Scientific Linux PBS server Worker Nodes (WNs) MS Windows XP PBS mom gLite clients auto-installer provided! Computing Element (CE) Scientific Linux PBS server Worker Nodes (WNs) MS Windows XP PBS mom gLite clients auto-installer provided!

Integrating CCS into gLite CE CCS Microsoft CCS farm with a head node an more worker nodes Auxiliary Nodes Globus Gatekeeper (Linux) Service interface to the grid CCSJob Client Server To put in communication the Gatekeeper (Linux) with the CCS head node (Windows) To call CCS primitives SSL channel CCS Microsoft CCS farm with a head node an more worker nodes Auxiliary Nodes Globus Gatekeeper (Linux) Service interface to the grid CCSJob Client Server To put in communication the Gatekeeper (Linux) with the CCS head node (Windows) To call CCS primitives SSL channel

MS-CCS running jobs Clip

gLite site publishing windows

Next steps Grid2Win Refactoring of some pieces of the code Adding many features Integrating a JDL editor currently under development Integrating CCS GUI for direct submissions CCS based CE Merging LCG CE (linux) and CCS HeadNode (windows) by porting the Gatekeeper to Windows XP Using Windows POSIX subsystem instead of Cygwin Running MPI-2 jobs on CCS Grid2Win Refactoring of some pieces of the code Adding many features Integrating a JDL editor currently under development Integrating CCS GUI for direct submissions CCS based CE Merging LCG CE (linux) and CCS HeadNode (windows) by porting the Gatekeeper to Windows XP Using Windows POSIX subsystem instead of Cygwin Running MPI-2 jobs on CCS

References The Grid2Win project Homepage The Grid Group of INFN-Catania Homepage CCS HeadNode Demo Download a live demo of a CCS headnode executing a gLite job (Camtasia player) or (TSCC Codec)Camtasia playerTSCC Codec The Cygwin Homepage The gLite middleware Homepage

© 2007 Microsoft France Votre potentiel, notre passion TM