1. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 1 General components of Grid middleware and User Interfaces Roberto Barbera EGEE is funded by the European Union under contract IST-2003-508833

2. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 2 Overview The multi-layer model of middleware services The Command Line user interface The GENIUS Portal Summary and conclusions

3. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 3 Middleware architecture Collective Services Information & Monitoring Replica Manager Grid Scheduler Local Application Local Database Underlying Grid Services Computing Element Services Authorization Authentication and Accounting Replica Catalog Storage Element Services SQL Database Services Fabric services Configuration Management Configuration Management Node Installation & Management Node Installation & Management Monitoring and Fault Tolerance Monitoring and Fault Tolerance Resource Management Fabric Storage Management Fabric Storage Management Grid Fabric Local Computing Grid Grid Application Layer Data Management Job Management Metadata Management Service Index APPLICATIONS GLOBUS CondorG (via VDT) M / W

4. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 4 Middleware interfaces Collective Services Information & Monitoring Replica Manager Grid Scheduler Local Application Local Database Underlying Grid Services Computing Element Services Authorization Authentication and Accounting Replica Catalog Storage Element Services SQL Database Services Fabric services Configuration Management Configuration Management Node Installation & Management Node Installation & Management Monitoring and Fault Tolerance Monitoring and Fault Tolerance Resource Management Fabric Storage Management Fabric Storage Management Grid Application Layer Data Management Job Management Metadata Management Object to File Mapping Service Index Computing Elements System Managers ScientistsOperating Systems File Systems Storage Elements Mass Storage Systems HPSS, Castor User Accounts Certificate Authorities Application Developers Batch Systems PBS, LSF, etc.

5. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 5 Job workflowReplicaCatalogue UI JDL Logging & Book-keeping ResourceBroker Job Submission Service StorageElement ComputingElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Globus RSL Output “sandbox” Job Status Publish grid-proxy-init Expanded JDL SE & CE info

6. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 6 The Command Line user interface The user interacts with Grid via a Workload Management System (WMS) The Goal of WMS is the distributed scheduling and resource management in a Grid environment. What does it allow Grid users to do? To submit their jobs To execute them on the “best resources” The WMS tries to optimize the usage of resources To get information about their status To retrieve their output

7. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 7 Job Description Language (JDL) The supported attributes are grouped in two categories: Job Attributes Define the job itself Resources Taken into account by the RB for carrying out the matchmaking algorithm (to choose the “best” resource where to submit the job) Computing Resource –Used to build expressions of Requirements and/or Rank attributes by the user –Have to be prefixed with “other.” Data and Storage resources –Input data to process, SE where to store output data, protocols spoken by application when accessing SEs

8. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 8 JDL: relevant attributes JobType Normal (simple, sequential job), Interactive, MPICH, Checkpointable Or combination of them Executable (mandatory) The command name Arguments (optional) Job command line arguments StdInput, StdOutput, StdError (optional) Standard input/output/error of the job Environment List of environment settings InputSandbox (optional) List of files on the UI local disk needed by the job for running The listed files will automatically staged to the remote resource OutputSandbox (optional) List of files, generated by the job, which have to be retrieved

9. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 9 JDL: relevant attributes Requirements Job requirements on computing resources Specified using attributes of resources published in the Information Service If not specified, default value defined in UI configuration file is considered Default: other.GlueCEStateStatus == "Production" (the resource has to be able to accept jobs and dispatch them on WNs) Rank Expresses preference (how to rank resources that have already met the Requirements expression) Specified using attributes of resources published in the Information Service If not specified, default value defined in the UI configuration file is considered Default: - other.GlueCEStateEstimatedResponseTime (the lowest estimated traversal time) Default: other.GlueCEStateFreeCPUs (the highest number of free CPUs) for parallel jobs (see later)

10. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 10 JDL: relevant attributes InputData Refers to data used as input by the job: these data are published in the Replica Location Service (RLS) and stored in the SEs) LFNs and/or GUIDs DataAccessProtocol (mandatory if InputData has been specified) The protocol or the list of protocols which the application is able to speak with for accessing InputData on a given SE OutputSE The Uniform Resource Identifier of the output SE RB uses it to choose a CE that is compatible with the job and is close to SE

11. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 11 Job submission edg-job-submit [–r ] [-c ] [-vo ] [-o ] -r the job is submitted directly to the computing element identified by -c the configuration file is pointed by the UI instead of the standard configuration file -vo the Virtual Organization (if user is not happy with the one specified in the UI configuration file) -o the generated edg_jobId is written in the Useful for other commands, e.g.: edg-job-status –i (or edg_jobId) -i the status information about edg_jobId contained in the are displayed

12. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 12 UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status

13. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 13 UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status submitted Job Statu s UI: allows users to access the functionalities of the WMS (via command line, GUI, C++ and Java APIs)

14. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 14 UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status edg-job-submit myjob.jdl Myjob.jdl JobType = “Normal”; Executable = "$(CMS)/exe/sum.exe"; InputSandbox = {"/home/user/WP1testC","/home/file*”, "/home/user/DATA/*"}; OutputSandbox = {“sim.err”, “test.out”, “sim.log"}; Requirements = other. GlueHostOperatingSystemName == “linux" && other. GlueHostOperatingSystemRelease == "Red Hat 6.2“ && other.GlueCEPolicyMaxWallClockTime > 10000; Rank = other.GlueCEStateFreeCPUs; submitted Job Statu s Job Description Language (JDL) to specify job characteristics and requirements

15. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 15 UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Input Sandbox files Job waiting submitted Job Status NS: network daemon responsible for accepting incoming requests

16. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 16 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status WM: responsible to take the appropriate actions to satisfy the request Job

17. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 17 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Where must this job be executed ?

18. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 18 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Matchmaker: responsible to find the “best” CE where to submit a job

19. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 19 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Where are (which SEs) the needed data ? What is the status of the Grid ?

20. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 20 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker CE choice

21. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 21 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Job Adapter JA: responsible for the final “touches” to the job before performing submission (e.g. creation of wrapper script, etc.)

22. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 22 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status JC: responsible for the actual job management operations (done via CondorG) Job submitted waiting ready

23. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 23 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status Job Input Sandbox files submitted waiting ready scheduled

24. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 24 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Input Sandbox submitted waiting ready scheduled running “Grid enabled” data transfers/ accesses Job

25. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 25 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done

26. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 26 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox submitted waiting ready scheduled running done edg-job-get-output

27. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 27 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done cleared

28. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 28 Job monitoring UI Log Monitor Logging & Bookkeeping Network Server Job Contr. - CondorG Workload Manager Computing Element RB node LM: parses CondorG log file (where CondorG logs info about jobs) and notifies LB LB: receives and stores job events; processes corresponding job status Log of job events edg-job-status edg-job-get-logging-info Job status

29. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 29 Other (most relevant) UI commands edg-job-list-match Lists resources matching a job description Performs the matchmaking without submitting the job edg-job-cancel Cancels a given job edg-job-status Displays the status of the job edg-job-get-output Returns the job-output (the OutputSandbox files) to the user edg-job-get-logging-info Displays logging information about submitted jobs (all the events “pushed” by the various components of the WMS) Very useful for debug purposes

30. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 30 Data Management Tools Tools for Locating data Copying data Managing and replicating data Meta Data management On EDG you have Replica Location Service (RLS) Replica Metadata Service (RMC) Replica Optimisation Service (ROS) Replica Manager (RM) RM RLS ROS RMC

31. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 31 Storage Element Replication Services: Basic Functionality Replica Manager Replica Location Service Replica Metadata Catalog Storage Element Files have replicas stored at many Grid sites on Storage Elements. Each file has a unique Grid ID. Locations corresponding to the GUID are kept in the Replica Location Service. Users may assign aliases to the GUIDs. These are kept in the Replica Metadata Catalog. The Replica Manager provides atomicity for file operations, assuring consistency of SE and catalog contents.

32. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 32 Storage Element Higher Level Replication Services Replica Manager Replica Location Service Replica Optimization Service Replica Metadata Catalog SE Monitor Network Monitor Storage Element The Replica Manager may call on the Replica Optimization service to find the best replica among many based on network and SE monitoring. Hooks for user-defined pre- and post- processing for replication operations are available.

33. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 33 Naming Conventions Logical File Name (LFN) An alias created by a user to refer to some item of data e.g. “lfn:cms/20030203/run2/track1” Site URL (SURL) (or Physical File Name (PFN)) The location of an actual piece of data on a storage system e.g. “srm://pcrd24.cern.ch/flatfiles/cms/output10_1” Globally Unique Identifier (GUID) A non-human readable unique identifier for an item of data e.g. “guid:f81d4fae-7dec-11d0-a765-00a0c91e6bf6” Logical File Name 1 Logical File Name 2 Logical File Name n GUID Physical File SURL n Physical File SURL 1

34. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 34 Replica Metadata Catalog (RMC) vs. Replica Location Service (RLS) RMC: Stores LFN-GUID mappings RLS: Stores GUID-SURL mappings Logical File Name 1 Logical File Name 2 Logical File Name n GUID Physical File SURL n Physical File SURL 1 RMC RLS RM RLS ROS RMC

35. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 35 Replica Location Service (RLS) The Replica Location Service is a system that maintains and provides access to information about the physical location of copies of data files. It is a distributed service that stores mappings between globally unique identifiers of datafiles and the physical identifiers of all existing replicas of these datafiles. Design is a joint collaboration between Globus and EDG-WP2 RM RLS ROS RMC

36. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 36 The Replica Manager Interface – Management Commands copyAndRegisterFile args: source, dest, lfn, protocol, streamscopyAndRegisterFile Copy a file into grid-aware storage and register the copy in the Replica Catalog as an atomic operation. replicateFile args: source/lfn, dest, protocol, streamsreplicateFile Replicate a file between grid-aware stores and register the replica in the Replica Catalog as an atomic operation. deleteFile args: source/seHost, all deleteFile Delete a file from storage and unregister it. Example edg-rm --vo=tutor copyAndRegisterFile file:/home/bob/analysis/data5.dat -d lxshare0384.cern.ch

37. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 37 The Replica Manager Interface – Catalog Commands (1) registerFileargs: source, lfnregisterFile Register a file in the Replica Catalog that is already stored on a Storage Element. unregisterFileargs: source, guidunregisterFile Unregister a file from the Replica Catalog. listReplicas args: lfn/surl/guid List all replicas of a file. registerGUIDargs: surl, guid Register an SURL with a known GUID in the Replica Catalog. listGUIDargs: lfn/surl Print the GUID associated with an LFN or SURL.

38. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 38 The Replica Manager Interface – Catalog Commands (2) addAliasargs: guid, lfn Add a new alias to GUID mapping removeAliasargs: guid, lfn Remove an alias LFN from a known GUID. printInfo() Print the information needed by the Replica Manager to screen or to a file. getVersion() Get the versions of the replica manager client.

39. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 39 The Replica Manager Interface – Optimization Commands listBestFileargs: lfn/guid, seHostlistBestFile Return the 'best' replica for a given logical file identifier. getBestFileargs: lfn/guid, seHost, protocol, streamsgetBestFile Return the storage file name (SFN) of the best file in terms of network latencies. getAccessCostargs: lfn/guid[], ce[], protocol[]getAccessCost Calculates the expected cost of accessing all the files specified by logicalName from each Computing Element host specified by ceHosts.

40. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 40 The Replica Manager Interface – File Transfer Commands copyFile args: soure, destcopyFile Copy a file to a non-grid destination. listDirectory args: dir List the directory contents on an SRM or a GridFTP server.

41. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 41 The “transparent” grid access local disk StorageElement StorageElementStorageElement ReplicaCatalogue UI dis k ResourceBroker ComputeElementComputeElement VOcolleague VOcolleague

42. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 42 A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, phone). It can keep the same user interface independently of the underlying middleware. It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly.

43. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 43 Title 1 OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBU S toolkit DataGRID architecture GENIUS web portal GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) [https://genius.ct.infn.it] INFN/NICE collaborationhttps://genius.ct.infn.it

44. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 44 GENIUS: how it works Roberto Barbera Apache EnginFrame GENIUS https+java/xml+rfb WEB Browser ED GUI Loc al WS the Grid EDG+GSI 3-tier model

45. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 45 Grid authentication with MyProxy ED G UI Loc al WS MyProx y Server GENIU S Server (EDG UI) grid-proxy-init myproxy-init any grid service myproxy-get-delegation output the Grid execution WEB Browser

46. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 46 GENIUS home page

47. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 47 GENIUS file services

48. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 48 GENIUS authentication with MyProxy

49. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 49 GENIUS grid settings

50. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 50 GENIUS VO selection

51. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 51 GENIUS graphic job editor (work in collaboration with DATAMAT)

52. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 52 GENIUS graphic workflow editor (integration with TRIANA from GridLab)

53. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 53 GENIUS single job submission

54. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 54 GENIUS single job queue

55. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 55 GENIUS multi job submission

56. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 56 GENIUS multi job queue

57. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 57 GENIUS data spooler (1/2)

58. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 58 GENIUS data spooler (2/2)

59. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 59 GENIUS RLS browsing

60. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 60 GENIUS data publication

61. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 61 GENIUS data replication

62. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 62 GENIUS information services

63. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 63 GENIUS monitoring services

64. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 64 GENIUS interactive services

65. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 65 GENIUS P2P services

66. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 66 GENIUS for PDA (1/2) Home Page Services Remote file browsing Remote file inspection

67. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 67 GENIUS for PDA (2/2) GridICE integration RC browsing Job monitoring Job submission

68. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 68 GENIUS for cell phone

69. Induction: General components of Grid middleware and User Interfaces –April 26-28, 2004 - 69 Summary and conclusions Let’s go to the practical