1. LCG / ARC Interoperability Status Michael Grønager, PhD (UNI-C / NBI) January 19, 2006, Uppsala

2. NGN5 Workshop, Uppsala, January 20062 Overview  Interoperability background  Workpackage status –LCG->ARC –ARC->LCG –Standards  Summery and Actions

3. NGN5 Workshop, Uppsala, January 20063 Interoperability background  Many sites have deployed ARC (~50sites ~5000CPUs)  Sites wish to provide CPU power via ARC  Experiment support are keyed towards LCG  Previous Meetings: –Rome, February 2005 –CERN, August 2005 –CERN, October 2005 –Uppsala, January 2006 - Yesterday

4. NGN5 Workshop, Uppsala, January 20064 Interoperability background  Proposed goals from the first CERN meeting: –Short term: Multiple Middlewares at large sites –Medium term: Gateways between grids –Long term: Common Interfaces

5. NGN5 Workshop, Uppsala, January 20065 Multi middleware clusters  Simplest form of interoperability is co- existence  Clusters with ARC/LCG co-existing –Germany: FZK, LRZ (1200CPUs) –Sweden: Ingrid, Ingvar, Bluesmoke (300CPUs) –Denmark: Morpheus(20CPUs), Steno(scheduled) (400CPUs)  Not nice for site administrators though - need to install/maintain two middlewares…

6. NGN5 Workshop, Uppsala, January 20066 Common Interfaces... VO management Job submission Job description Information Data management Data transfer Basis Service/component GridFTPCondor-G to GRAM VOMS RSLJDL (based on classAds) LDAP, ARC schema, MDS -GIIS LDAP, GLUE1.1, MDS+BDII, R-GMA RC, RLS, FiremanEDG RLS, Fireman & Co, LFC GridFTP, SRM v1.1 clientGridFTP, SRM GT2 own patch, GT4GT2 from VDT ARCLCG-2, gLite  Diverges mainly on:  Job submission and description  Information system

7. NGN5 Workshop, Uppsala, January 20067 Gateways  Work plan proposed at the CERN meeting: –WP1: Document LCG CE (David Smith) –WP2: LCG to ARC job submission (Laurence Fields) –WP3: ARC to LCG job submission (Balazs Konya) –WP4: Service discovery (Laurence Fields) –WP5: GLUE2 (long term…)

8. NGN5 Workshop, Uppsala, January 20068 Gateways  Work plan proposed at the CERN meeting: –WP1: Document LCG CE (David Smith) –WP2: LCG to ARC job submission (Laurence Fields) –WP3: ARC to LCG job submission (Balazs Konya) –WP4: Service discovery (Laurence Fields) –WP5: GLUE2 (long term…)

9. NGN5 Workshop, Uppsala, January 20069 WP2: LCG to ARC job submission  LCG submits to resources using Condor-G  Condor-G can submit to: –Condor –GT2, GT3, GT4 –ARC(v4.5) needs Condor v6.7.13 or newer  Plan is to change the gLite RB to enable ARC submission through Condor-G  (Alternative is to mask ARC as one LCG CE with several Condor queues)

10. NGN5 Workshop, Uppsala, January 200610 WP2: Condor-G status  Condor-G can submit jobs to ARC –Tested with small hello-world kind of jobs –> condor_submit job.jdl Where the jdl file has gridtype=”nordugrid” And e.g. grid_scheduler=”morpheus.dcgc.dk”

11. NGN5 Workshop, Uppsala, January 200611 WP2: Condor-G status  Condor-G can submit jobs to ARC –Tested with small hello-world kind of jobs –> condor_submit job.jdl Where the jdl file has grid_type=”nordugrid” And e.g. grid_scheduler=”morpheus.dcgc.dk”  Condor-G can do brokering between ARC resources –Script: ldapsearch -> condor_advertise  Condor-G can even do brokering between ARC and LCG resources...

12. NGN5 Workshop, Uppsala, January 200612 WP2: gLite RB...  The gLite RB uses Condor-G to submit jobs to: –Condor CEs –LCG CEs –gLite CEs  Well prepared for adding new CE types  Discussions with gLite developers to add this once tested  Planned action before next meeting

13. NGN5 Workshop, Uppsala, January 200613 WP3: ARC to LCG submission  ARC client does the brokering  Direct submission from arc-client to LCG/gLite Ces  Options: –GRAM2 (scaling problems...) –CondorG (still needs FQHN on client and adds extra dependencies) –gLite to support web-service based submission –... submit via resource broker

14. NGN5 Workshop, Uppsala, January 200614 WP4: Resource Discovery  Translation between arc and glue schema  Script that creates a glue mapping of arc resources.  Online at: arc-bdii.cern.ch –Exercise: Ldapsearch -x -H ldap://arc-bdii.cern.ch:2170 -b o=gridldap://arc-bdii.cern.ch  Meant as input for the modified gLite RB

15. NGN5 Workshop, Uppsala, January 200615 WP5: GLUE2  Proposal on the way for splitting into: –Transport-level-schema for info system –Abstract-level-schema for clients

16. NGN5 Workshop, Uppsala, January 200616 Summery: New actions  Glite RB modification  Administrative / organizational integration of interoperable ARC sites  Retrieving accounting-info from the ARC sites