Grid Portals Dennis Gannon Marlon Pierce Indiana University

Portlets and Containers One of the problems of previous portal development is that there is no good way to share interface components. One of the problems of previous portal development is that there is no good way to share interface components. How do developers share web interfaces?How do developers share web interfaces? Also, how can we avoid constantly reinventing things like login services, customization services, page organization, access controls. Also, how can we avoid constantly reinventing things like login services, customization services, page organization, access controls. Answer: use portlets and containers. Answer: use portlets and containers. Becoming a recognized best practice for portal development because it enables distributed portal development.Becoming a recognized best practice for portal development because it enables distributed portal development.

OGCE Release 1 Combines Grid and Collaboration Portlets in CHEF Framework OGCE OGCE The Open Grid Computing Environments Collaboratory Funded by the NSF National Middleware Initiative Argonne National Lab Indiana University University of Michigan NCSA San Diego State University Texas Advanced Computing Center Globus proxy manager and GRAM portlets allow remote command execution GridFTP portlets allow remote file browsing and management Portal Engine: Jetspeed Velocity CHEF Teamlets: Written in JAVA Responsible for GUI Operate in the context of a session. Rely on services for any persistent or “cross-user” information. Services Persistent System-wide Multiple implementations of services Configurable as to what implementation provides what service Servlets: Access services outside of the portal engine: AccessServlet and WebDavServlet Services API Web Server: Tomcat Turbine Non-HTTP Components (i.e. ) CHEF Teamlets support group collaboration through shared data. Context services manage Grid application metadata. GPIR Web Services provide Virtual Organization information services. Portlet architecture allows portlets to be reused between portals. Group calendars Group chat Topic-based newsgroups support multiple communicatio n channels as RSS feeds.

Standard Portlet Architecture Supports Reusable Components OGCEOGCE The Open Grid Computing Environments Collaboratory Funded by the NSF National Middleware Initiative Argonne National Lab Indiana University University of Michigan NCSA San Diego State University Texas Advanced Computing Center JSR 168 standard allows portlets to be reused across multiple containers. OGCE2 is building Grid portlets that can operate in open source containers such as uPortal and GridSphere. Container independent services allow data like Grid credentials to be shared between portlets. The Java CoG provides an abstraction layer over different toolkits and capabilities. Compatibilit y tools support Velocity- based OGCE1 portlets in JSR 168 containers GT2 GT3 OGSA/ WS-RF GT3 OGSA/ WS-RF SSH Condor Unicore CoG Abstraction Layer (job submission, file transfer, authentication)CoG Abstraction Layer (job submission, file transfer, authentication) CoG Applications Data and Task Management Layer (workflow)Data and Task Management Layer (workflow) Gridfaces Layer (portals, Swing, SWF)Gridfaces Layer (portals, Swing, SWF) Others AvakiOthers Avaki CoG Others SETIOthers SETI CoG Nano materialsNano materials Bio- InformaticsBio- Informatics Disaster ManagementDisaster Management Portals GridIDE Development Support New CoG interfaces also support task composition and workflow uPortal Gridsphere MyProxy and GRAM portlets in uPortal and GridSphere

Web Portal Package every Web Service with its own user interface as a document fragment Package every Web Service with its own user interface as a document fragment Portlets are underlying technology Portlets are underlying technology OGCE Open Grid Computing Environment is developing lots of useful portlets OGCE Open Grid Computing Environment is developing lots of useful portlets ComputingComputing GISGIS Access Grid etc.Access Grid etc. Core Web Services Portlet User Interface Components Application Web Services and Workflow Aggregate Portals

Portal Architecture Clients (Pure HTML, Java Applet..) Aggregation and Rendering Portal Internal Services Portlet Class Portlet Class: WebForm SERVOGrid (IU) Web/Grid service Computing Data Stores Instruments GridPort etc. (Java) COG Kit ClientsPortal PortletsLibrariesServicesResources Local Portlets Remote or Proxy Portlets Hierarchical arrangement

OGCE Consortium Individual portlet for the Proxy Manager Use tabs or choose different portlets to navigate through interfaces to different services 2 Other Portlets Each Service has its own portlet

GGF 15 NEESGrid Realtime access to earthquake Shake table experiments at remote sites.

GGF 15 Mesoscale Meteorology NSF LEAD project - making the tools that are needed to make accurate predictions of tornados and hurricanes. - Data exploration and Grid workflow

GGF 15 Teragrid Gateway Portals TeraGrid –The largest “public” super- computing grid in the US. 50 TFlops –Massive Data storage capability Over 1 Petabyte on-line storage TeraGrid Gateways –Access points for communities. –Two types: A gateway between 2 grids –Open Science Grid gate way is one example. –Science Community Portal is the other type Includes LEAD portal, Nanohub, Renci Bioportal, NVO An additional set of new science portals just being developed … including TeraGrid –The largest “public” super- computing grid in the US. 50 TFlops –Massive Data storage capability Over 1 Petabyte on-line storage TeraGrid Gateways –Access points for communities. –Two types: A gateway between 2 grids –Open Science Grid gate way is one example. –Science Community Portal is the other type Includes LEAD portal, Nanohub, Renci Bioportal, NVO An additional set of new science portals just being developed … including

GGF 15 The Architecture of Gateway Services The Users Desktop. Gateway Services Grid Portal Server Grid Portal Server Physical Resource Layer Core Grid Services Proxy Certificate Server / vault Proxy Certificate Server / vault Application Events Resource Broker User Metadata Catalog User Metadata Catalog Replica Mgmt Application Workflow Application Workflow App. Resource catalogs App. Resource catalogs Application Deployment Application Deployment Execution Management Execution Management Information Services Information Services Self Management Self Management Data Services Data Services Resource Management Resource Management Security Services Security Services OGSA-like Layer Portlets

SERVOGrid Portal Screen Shots

What Is a Portlet? A portlet is a piece of Java code that runs in a Web server inside a container servlet. A portlet is a piece of Java code that runs in a Web server inside a container servlet. Portlets can do two things: Portlets can do two things: Perform non-visual operations such as make connections to remote hosts, perform operations.Perform non-visual operations such as make connections to remote hosts, perform operations. Example: get a list of local files. Example: get a list of local files. Create their displayCreate their display The portlet passes its display to its parent, which is responsible for constructing the entire display. The portlet passes its display to its parent, which is responsible for constructing the entire display. Typically this is HTML, with tables uses to organize component displays.Typically this is HTML, with tables uses to organize component displays. Other displays are possible (VoiceXML, WML).Other displays are possible (VoiceXML, WML).

What is JSR 168? Defines the (Java) standard for vendor container-independent portlet components. Defines the (Java) standard for vendor container-independent portlet components. Portlets can be developed independently of the container.Portlets can be developed independently of the container. Many implementations: Many implementations: Gridsphere, uPortal, WebSphere, Jetspeed2, ….Gridsphere, uPortal, WebSphere, Jetspeed2, …. From the portlet development point of view, it is really very simple: From the portlet development point of view, it is really very simple: You write a java class that extends GenericPortlet.You write a java class that extends GenericPortlet. You override/implement several methods inherited from GenericPortlet.You override/implement several methods inherited from GenericPortlet. You use some supporting classes/interfacesYou use some supporting classes/interfaces Many are analogous to their servlet equivalents Many are analogous to their servlet equivalents Some (portletsession) actually seem to be trivial wrappers around servlet equivalents in Pluto. Some (portletsession) actually seem to be trivial wrappers around servlet equivalents in Pluto.

Some Open Source JSR 168 Containers GridSphere GridSphere uPortal uPortal LifeRay LifeRay eXo platform eXo platform StringBeans StringBeans Jetspeed2 Jetspeed2

File Management File management services allow you to File management services allow you to Upload, download files between desktop and remote HPCUpload, download files between desktop and remote HPC Download entire directories as zipped files.Download entire directories as zipped files. Delete remote files.Delete remote files. Navigate remote directories.Navigate remote directories. Unzip/untar remotely.Unzip/untar remotely. Targeted ASC and ARL initially Targeted ASC and ARL initially ARL is available in productionARL is available in production

Access to Portlets Obviously not all users have accounts at all centers. Obviously not all users have accounts at all centers. An ASC file browser should be accessible only to users with an ASC account.An ASC file browser should be accessible only to users with an ASC account. Jetspeed has role based accessed control to portlets. Jetspeed has role based accessed control to portlets. Each user can be assigned to one or more user roles (“ERDC”, “ASC”, etc). Each user can be assigned to one or more user roles (“ERDC”, “ASC”, etc). This controls which portlets a user can add to his or her display. This controls which portlets a user can add to his or her display.

Portal Security We are building off Indiana’s Gateway’s approach for Web-based security for DOD portals. We are building off Indiana’s Gateway’s approach for Web-based security for DOD portals. Approved for ARL and ASCApproved for ARL and ASC Users kinit to a web server to get a ticket. Users kinit to a web server to get a ticket. SSL, MD’d sessions, Certificates maintain secure connection.SSL, MD’d sessions, Certificates maintain secure connection. Web server typically located in “DMZ”Web server typically located in “DMZ” Web server manages session IDs, invokes backend requests with Kerberos client utilities. Web server manages session IDs, invokes backend requests with Kerberos client utilities. Browser Web Server HPC DMZ HTTPS krcp, krsh