1. The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th

2. Portals & Portlets 20032 The PROGRESS project Duration: December 2001 – May 2003 (R&D) Budget: ~4,0 MEuro Project Partners –SUN Microsystems Poland –PSNC IBCh Poznań –Cyfronet AMM, Kraków –Łódź Technical University Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

3. Portals & Portlets 20033 PROGRESS (2) Cluster of 80 processors Networked Storage of 1,3 TB Software: ORACLE, HPC Cluster Tools, Sun ONE, Sun Grid Engine

4. Portals & Portlets 20034 PROGRESS architecture

5. Portals & Portlets 20035 PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM GRID SERVICE PROVIDER 4-tier new grid-portal environment Grid-Portal Environment PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM 3-tier classical grid-portal environment

6. Portals & Portlets 20036 Grid Service Provider (1) Features Use of grid resources most comfortable to end users. Easy building of numerous portals and other user interfaces. Users can switch between various interfaces and use the same GSP services. Various thematic scientific web portals sharing the same grid resources. Possibility to provide all GSP clients (user interfaces) with computing resources belonging to two or more different grids.

7. Portals & Portlets 20037 Grid Service Provider (2) Necessary services to provide: –Job Submission Service managing the creation of user jobs, submission to the grid and execution monitoring (typically through reverse reporting, performed by the Grid Management System about events connected with job execution) –Application Management Service storing information about applications available for running in the grid assisting application developers in adding new applications to the application factory –Provider Management Service keeping up-to-date information on the services available within the provider

8. Portals & Portlets 20038 GSP within PROGRESS Content Provider Webservice Session Bean Entity Beans

9. Portals & Portlets 20039 Job Submission Service (1) Creating computational jobs, submitting them to the grid for execution and viewing the results Job description is prepared using the XRSL language and is transferred to the Grid Resource Broker for the execution of the job Grid Resource Broker reverse reports on grid events connected with the job „Workflowed” jobs: sequences and parallels

10. Portals & Portlets 200310 Job Submission Service (2) Web Services interface –Create, modify, delete and submit computing jobs (single and "workflowed” task), copy jobs –Manage job tasks, including: setting application parameters, adding references to input and output files, setting task resource requirements –Monitoring job execution –Change task status (used by the Grid Resource Broker)

11. Portals & Portlets 200311 Application Management Srv. (1) Application repository management Application descriptor contains a reference to the application executable: a reference to a file stored in the DMS or a path to a binary on grid computing server filesystems Also included in the application descriptor: available (required or optional) arguments, required environment variables and required input and output files PROGRESS applications may be unconfigured or configured: one executable -> multiple configured applications Virtual applications

12. Portals & Portlets 200312 Application Management Srv. (2) Web Services interface –Add and remove applications, modify application definitions –Manage virtual applications

13. Portals & Portlets 200313 Provider Management Service Enables keeping up-to-date information on services available in the grid service provider Service descriptor contains information on the Web Service interface: URL at which the service is available, the service namespace reference (URN) and the service WSDL reference Services may have multiple instances: informational services Web Services interface –Add and delete services, modify their descriptors –Add and delete instances of services

14. Portals & Portlets 200314 Informational Services Examples of instance enabled services Intended for use by web portals PROGRESS example: short news service Other: document directory, discussion forum (under development)

15. Portals & Portlets 200315 Short News Service Web Services interface –Add, modify, delete and read news –Add and delete own instances (informational services are examples of multiple instance services)

16. Portals & Portlets 200316 XRSL Language Extended Resource Specification Language (XRSL) is an XML based language designed for description of computing jobs The XML documents describing grid computing jobs are passed to the Grid Resource Broker, which analyzes them and executes jobs in accordance with requirements included

17. Portals & Portlets 200317 Web Services Communication HPC Portal Grid Service Provider Data Management System Grid Resource Broker saveJob() getApplications() getTemplates() saveTaskOfJob() saveStdOfTask() submitJob() getUserJobs() getJobStatus() listUserDirectory() addUserFile() getUserFileLocation() submitJob() changeTaskStatus()

18. Portals & Portlets 200318 Authentication & authorization Utilize the services available within the Sun One Portal Server 6.0 package: authentication techniques, user database, portlet access control, identity server Authorization system for the Grid Service Provider and the Data Management System: based on the RAD model Apply a Single Sign-On mechanism

19. Portals & Portlets 200319 Authorization scheme Portal GRID SERVICE PROVIDER Identity server RAD based authorization system Logon Authentication Request Method invocation Token validation Resource access authorization

20. Portals & Portlets 200320 Other PROGRESS modules User interfaces –Web Portal: grid job management, application management, provider management, short news reading and editing, DMS file system management –Migrating Desktop: grid job management and DMS file system management Grid Resource Broker: enables the execution of PROGRESS grid jobs in the PROGRESS grid; uses the XRSL language for grid job descriptions Data Management System: storing the input and output files, metadata, multiple media data containers

21. Portals & Portlets 200321 Visualization of job results

22. Portals & Portlets 200322 PROGRESS HPC Portal

23. Portals & Portlets 200323 SC2002 Demo

24. Portals & Portlets 200324 PROGRESS future R&D finished within the project, test and deployment phase now With the Grid Service Provider: –numerous thematic scientific portals possible to deploy (PROGRESS HPC Portal is a bioinformatic portal) –users may be provided with resources belonging to two or more grids – the Grid Service Provider may be equipped with means of communicating with multiple grids PROGRESS HPC Portal contents: adding new applications, adding new visualization applets, bioinformatic society building

25. Portals & Portlets 200325 PROGRESS http://progress.psnc.pl/ http://progress.psnc.pl/portal/ http://www.psnc.pl/ bogdan@man.poznan.pl