1. July 2004SC4DEVO -Caltech1 IVOA WebServices William O’Mullane The Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY

2. July 2004SC4DEVO -Caltech2 What exactly is a WS ? FROM http://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsa- arch.html#whatiswshttp://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsa- arch.html#whatisws [Definition: A Web service is a software system identified by a URI, whose public interfaces and bindings are defined and described using XML. Its definition can be discovered by other software systems. These systems may then interact with the Web service in a manner prescribed by its definition, using XML based messages conveyed by internet protocols.] Note: Our definition of the term "Web services" does not presuppose the use of SOAP as a packaging format or a processing model. Nor does it presuppose the use of WSDL as a service description language. There are, and will be in the future, plenty of Web services that use raw HTTP as a data transfer protocol and some mutually agreed-upon XML format as the message content. The Web Services *reference architecture* does, however, assume that the higher levels of the Web services protocol stack are built on the foundation of SOAP and WSDL.

3. July 2004SC4DEVO -Caltech3 Cone and SIAP CONE –returns all objects within SR or given RA and DEC as XML –has SIZE=0 – returns some metadata as XML SIAP –returns refs and descriptions of images at POS(RA,DEC) of SIZE(H,W) –has FORMAT=Metadata – returns some metadata But not properly described in a manner which may be used automatically So technically NOT WebServices

4. July 2004SC4DEVO -Caltech4 WS/SOAP in IVOA and NVO NVO (and IVOA) find WS a good stepping stone to the GRID without the complexity of GLOBUS etc. SOAP/WS was not mature enough when CONE/SIAP defined (>2years ago) General feeling this may be good – but still no agreement to use WS/SOAP extensively e.g. Simple Spectral Access (SSAP) is now being defined in similar manner to SIAP. NVO and AstroGrid very much in favour of WS. –Platform independent –Tools – language indepentant WebGrid Services group (G. Rixon IVOA, R. Williams NVO)– starting to define standards

5. July 2004SC4DEVO -Caltech5 Registry Layer Existing Data Centers Data Services Semantics (UCD) SIAP, SSAP VOTable FITS, GIF,… OpenSkyQuery SkyQueryVOPlot OASIS conVOT Topcat Mirage AladinDIS Disks, Tapes, CPUs, Fiber Grid Middleware SRB, Globus, OGSA SOAP, GridFTP data mining visualization image source detection Virtual Observatory Architecture Digital Library Other registries XML, DC, METS OAI ADS VOSpace storage services Databases, Persistency, Replication Virtual Data Workflow (pipelines) Discover Compute Publish Collaborate Authentication & Authorization crossmatch HTTP ServicesSOAP Services Grid Services stateless, registered & self-describing & persistent, authenticated Portals, User Interfaces, Tools Compute Services Bulk Access interfaces to data

6. July 2004SC4DEVO -Caltech6 VO Support Interfaces Working Draft http://www.ivoa.net/internal/IVOA/VOSupportInterfaces-0.2.pdf T HE US N ATIONAL V IRTUAL O BSERVATORY

7. July 2004SC4DEVO -Caltech7 getAvailability- Mandetory Is service alive? –Needs to be more than a ping service should check databases etc. UpTime ValidTo – planned downtime

8. July 2004SC4DEVO -Caltech8 GetRegistration Method to return VOResource Make service the owner of the MetaData Could be used by registry: –Register only the base url –Registry calls MetaData creates the entry –Registry may then refresh periodically

9. July 2004SC4DEVO -Caltech9 Logging Will be a large issue – all VO’s will need to report usage Good to be able to ask service about usage patterns Implies Logging is done What is the minimum useful info we need? Does it need to be secured –Partially secured?

10. July 2004SC4DEVO -Caltech10 Single Sign On Proposal http://www.ivoa.net/twiki/bin/view/IVOA/IvoaGridAndWebServices/I VOA.SingleSignOnProposal http://www.ivoa.net/twiki/bin/view/IVOA/IvoaGridAndWebServices/I VOA.SingleSignOnProposal T HE US N ATIONAL V IRTUAL O BSERVATORY

11. July 2004SC4DEVO -Caltech11 SingleSignOn - Goal Identification for Access control e.g: –any part where a user stores data or changes the system state; –a minority of archive services where access to the data is restricted; –services that limit use of resources (storage, CPU time, etc.). Allowing –a user to have one password for the entire VO. –a user to sign in once per session on the VO, not once per use of a service; –services to 'sub-contract' work to other services in a user's name. Authorization to be done by service provider

12. July 2004SC4DEVO -Caltech12 SSO – WSSecurity WSSecurity now seems ok Wish to utilize the libraries for SSO in VO So we have: WSS:Security element in SOAP Header –WSU:Timestamp (signed)-> Uniqueness –Multiple Identity warrants – X509v3 DS:Signature in SOAP body

13. July 2004SC4DEVO -Caltech13 SSO- Certificate Authorities Must deal with different warrants: Long Lived e.g. one year, CA sees ID like passport Short Lived e.g. one day issued perhaps by a community : CA part of runtime Suggested for VO Referee e.g. CA endpoint passed in message – service requests warrant from CA Need to experiment – requires trust between CAs

14. July 2004SC4DEVO -Caltech14 Asynchronous Activity Proposal http://www.ivoa.net/twiki/bin/view/IVOA/IvoaGridAndWebServices/IVOA. AsynchronousActivityProposal T HE US N ATIONAL V IRTUAL O BSERVATORY

15. July 2004SC4DEVO -Caltech15 Asynchronous Activity a major archive query traversing a large DB table; a data-mining job run from a batch queue; a workflow with many steps; a workflow repeated for many data sets. Related : –CASJobs –GAF recently –Open Sky Query

16. July 2004SC4DEVO -Caltech16 Asynch – What we need. context: a way of associating a web- service operation with an activity; a way of getting information about the state of a context; management of the lifecycle of contexts such that resources are not leaked; notification by services of changes in contexts, e.g. "job complete".

17. July 2004SC4DEVO -Caltech17 VOSpace – not yet a proposal Allow interaction of MyDB MySpace SRB Common WSDL in front of all – not all functionality Common namespace for all systems

18. July 2004SC4DEVO -Caltech18 Functioning Web Services Yes its not all paper work ! T HE US N ATIONAL V IRTUAL O BSERVATORY

19. July 2004SC4DEVO -Caltech19 WebServices at CDS http://cdsweb.u-strasbg.fr/cdsws.gml Coordinate Conversions Aladain Image Name resolver (NED/SIMBAD/VIZIER) UCD – Unified Content Descriptor Vizier Catalogue Metadata

20. July 2004SC4DEVO -Caltech20 NVO Searchable Registry http://Nvo.stsci.edu/VORegistry Publication site for astronomical resources: –Individual or Groups of Services, collections, data, etc. Harvests (collects) resources from other registries Search Interfaces: simple and complex (as WS) –mixes WS with tradiitonal services Implements VO standards –IVOA Resource XML schema: astronomical metadata Dublin core standard VO Service descriptions and access points –OAI (Open Archive Initiatives) VO interdisciplinary science gateway Standard is working draft

21. July 2004SC4DEVO -Caltech21 Cone Search Service Full Searchable Registry STScI/JHU harvest (pull) Data Inventory Service search for services Registry Model DIS SkyNode Simple Image Access Data Providers Local Publishing Registry Local Publishing Registry Heasarc NCSA Local Publishing Registry Local Publishing Registry Local Publishing Registry Vizier Caltech Astrogrid Web User search for services publish

22. July 2004SC4DEVO -Caltech22 Galaxy Morphology http://sdssdbs1.stsci.edu/nvo/GalaxyMorph/galmorph.aspx Uses multiple components WebService used to hide complete grid computing process This is a good approach for VO (like Denis showed earlier) How it works http://nvo.ncsa.uiuc.edu/cgi-bin/SlideShow.cgi

23. July 2004SC4DEVO -Caltech23 Open Sky Query http://openskyquery.net Demonstrates ADQL0.7.4 (Working draft) Demonstrates SkyNode0.7.4 (working Draft) Creates workflow to cross match multiple distributed catalogs Open Standards based –SOAP/WSDL –VOTable1.1

24. July 2004SC4DEVO -Caltech24 OpenSkyQuery -Architecture March 2004

25. July 2004SC4DEVO -Caltech25 Issues Single Sign On –Security –Certificates Asynch activity