1. SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab

2. Overview  example: SAMGrid used by 2 stakeholders  interfaces to our campus grid Fermigrid CMSCDFDZero general purpose storage Fermigrid uses

3. Characteristics of the our GRID  Data collected by each running experiment 1 PetaByte/p.a.  experiments with homogeneous user community Consequences for our GRID: data driven GRID interoperability possible data people CPU

4. Basic SAMGrid Requirements ► Transfer enormous amounts of data needed for different activities (scalable) ► … sometimes over large distances and with non-fault tolerant hardware (robust) ► Maintain knowledge of what we are doing and what we did (monitoring and bookkeeping) ► Use our limited resources effectively both at home and away (efficient) ► Don’t want to know the details [where files sit, where jobs run] (helpful) Solution… ► A data handling and job management system ► SAM + JIM = SAMGrid

5. The Data Handling: SAM Data Handling DH Resource Management Data Delivery and Caching SAM Principal Component Service Implementation Or Library Information Information and Monitoring Job Management

6. World wide distribution of SAM stations FNAL most important CDF SAM stations DZero SAM stations DZero and CDF: 10’/20’ Files declared/day 15’ Files consumed/day 8 GByte of Files cons./day  main consumption of data still central still central  remote use on the rise

7. The Job Management Job Management Request Broker Compute Element Resource Site Gatekeeper Job Scheduler JH Client Batch System Condor-G Condor MMS GRAM Grid sensors (All) Job Status Updates Principal Component Service Implementation Or Library Information Information and Monitoring Data Handling

8. Overview  example of SAMGrid for 2 stakeholders  interfaces to our campus grid Fermigrid CMSCDFDZero general purpose storage Fermigrid

9. Bilateral Interoperability Matrix CDFUSCMSDZeroGeneral Purpose Farm OSG Fermilab Storage CDFVVVVprogressV USCMSXVprogressVVV DZeroXVVVprogressV GP Farm XVprogressVprogressV OSGXVprogressVVprogress  work to do for a joint use of resource  will focus on the CDF/DZero effort which use a common data handling system

10. FermiGrid – 4 Elements  Common Grid Services  Stakeholder Bilateral Interoperability  Development of OSG Interfaces  Exposure of the Permanent Storage System

11. FermiGrid – Common Grid Services user Gate keeper GUMS identity mapping service SAZ site authentification service VOMS server maps UID blacklists Job manager OSG service accept jobs from the Open Science Grid (OSG) and schedule these jobs for execution  accept jobs from the Open Science Grid (OSG) and schedule these jobs for execution  utilize several Common Grid Services

12. FermiGrid – stakeholder bilateral interoperability OSG “guest” VO Users Fermilab VO Users FermiGrid Gateway & Central Services resource head node worker nodes resource head node worker nodes resource head node worker nodes resource head node worker nodes

13. GRAM head node Testbed of SAMGrid forwarding mechanism / LCG User Interface Grid2Fabric interface Batch system adapter LCG handler GRAM forwarding node LCG Resource Broker GRAM head node SAM

14. GRAM head node FermiGrid: OSG gateway Grid2Fabric interface Batch system adapter handler GRAM forwarding node Condor MMS GRAM head node Condor SchedD

15. FermiGrid – Milestones & Time Line Work done: End Feb 2005Hardware installation May 2005Common Grid Services available Summer 2005Gridify the General Purpose Farm Summer 2005Work with DZero to transition from static gridmap files to use FermiGrid Common Grid Services Plans 2006: install general purpose desktop cluster add general availability storage service failover