Ian Foster Computation Institute Argonne National Lab & University of Chicago Application Hosting Services — Enabling Science 2.0 —

2 “Web 2.0” l Software as services u Data- & computation-rich network services l Services as platforms u Easy composition of services to create new capabilities (“mashups”)—that themselves may be made accessible as new services l Enabled by massive infrastructure buildout u Google projected to spend $1.5B on computers, networks, and real estate in 2006 u Many others are spending substantially l Paid for by advertising Declan Butler, Nature

3 Science 2.0: E.g., Virtual Observatories Data Archives User Analysis tools Gateway Figure: S. G. Djorgovski Discovery tools

4 Science 2.0 People create services (data or functions) … which I discover … & compose to create a new function... and then publish as a new service.  I find “someone else” to host services, so I don’t have to become an expert in operating services & computers!  I hope that this “someone else” can manage security, reliability, scalability, … !! “Service-Oriented Science”, Science, 2005

5 The Importance of “Hosting” and “Management” Tell me about this star Tell me about these 20K stars Support 1000s of users E.g., Sloan Digital Sky Survey, ~10 TB; others much bigger

6 Creating Web Services l Take an “application” u An arbitrary executables u A procedure in Java or another language u A Web service l And provide a “Web Service” interface u Address authentication & authorization u Pass input data (XML, files, …?) u Invoke the application u Permit monitoring & control u Return output data (XML, files, …?)

7 Creating Services: E.g., Introduce Authoring Tool l Define service l Create skeleton l Discover types l Add operations l Configure security l Modify service Introduce: Hastings, Saltz, et al., Ohio State University See also: SOAPLab, OPAL, pyGlobus, Gannon, etc.

8 Composing Web Services: E.g., BPEL Workflow System Data uchicago.edu Analytic osu.edu Analytic duke.edu <BPEL Workflow Doc> <Workflow Inputs> <Workflow Results> BPEL Engine link caBiG: BPEL work: Ravi Madduri et al. link

9 Hosting & Management: Application Hosting Services Resource Provider Appln Code Appln Code Application client AHS management Hosting Service Author ization Resource Provider Provisioning Persistence Users Admins PDP Policy management Application deployment Application Prep Tool(s) Appln Code Application providers

10 Apache Tomcat Service Container Realization: We Have Much of This in GT4!! RPs Resource Service GetRP GetMultRPs SetRP QueryRPs Subscribe SetTermTime Destroy EPR ResourceHome RPs Resource Service GetRP GetMultRPs SetRP QueryRPs Subscribe SetTermTime Destroy EPR ResourceHome RPs Resource Service GetRP GetMultRPs SetRP QueryRPs Subscribe SetTermTime Destroy EPR ResourceHome PIP PDP WorkManagerDB Conn Pool JNDI Directory Security Persistence Management State Authorization GT4 Web Services Container Globus Toolkit Version 4: Software for Service-Oriented Systems, LNCS 3779, 2-13, 2005

11 GRAM services GT4 Container GRAM services Delegation RFT File Transfer request GridFTP Remote storage element(s) Local scheduler User job Compute element GridFTP sudo GRAM adapter FTP control Local job control Delegate FTP data Client Job functions Delegate Service host(s) and compute element(s) Realization: We Have Much of This in GT4!! SEG Job events File staging Credential management GT4 Web Services GRAM Globus Toolkit Version 4: Software for Service-Oriented Systems, LNCS 3779, 2-13, 2005

12 GT4 Application Hosting Service Prototype InterfaceCommentsStatus Application“runApplication”: parse argumentsYes Deployment“createApplication” operationYes ManagementWSRF: monitor, notify, lifetimeSome PolicyRemote policy management: TBDSoon AuthorizationGT4 authorization frameworkYes PersistenceGT4 persistence frameworkYes ProvisioningGRAM, initiallySimple Joint work with Ravi Madduri

13 Provisioning: Astro Portal Stacking Service l Purpose u On-demand “stacks” of random locations within ~10TB dataset l Challenge u Rapid access to K “random” files u Time-varying load l Solution u Dynamic acquisition of compute, storage = + S4S4 Sloan Data Web page or Web Service Joint work with Ioan Raicu & Alex Szalay

14 Preliminary Performance (TeraGrid, LAN GPFS) Joint work with Ioan Raicu & Alex Szalay

15 Next Steps l Integration with service authoring tools l More sophisticated provisioning u Dynamic, as in AstroPortal stacking service l More sophisticated management u Remote policy management u Auditing & accounting l Harmonization of different approaches l We welcome partnerships u On extending the technology u On applying the technology

16 Summary l “Science 2.0” or “service-oriented science” is not only sexy, it’s important! l Making it work requires that we get a handle on how to host & manage services l Application hosting services are an important part of the mix l GT4 provides most of the pieces needed to build a good application hosting service l We are looking for partners to extend & apply this technology Thanks to Carl Kesselman, Matei Ripeanu, Ravi Madduri for discussions