1. Hanisch ADASS 1999

2. Distributed Data Systems and Services for Astronomy and the Space Sciences Robert J. Hanisch Space Telescope Science Institute Baltimore, MD ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

3. What does it mean for a service to be “distributed”? Databases/archives need not be located at the same physical site User’s query is passed to, and responses are returned from, multiple services via a common protocol Responses/results presented to the user in an integrated fashion, as if resources were local and of similar structure ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

4. What does it mean for a service to be “distributed”? ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999 Space Mission Data Ground-Based Data Catalogs

5. We need distributed information services because... No one site can hold all information Information is dynamic; static catalogs and indexes quickly become obsolete Astronomers use multiple types of data — images, spectra, time series; catalogs, journal tables; journal articles — all should be easily located and accessed with query terms and syntax natural to the discipline Common entry point for multiple resources simplifies life for users ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

6. Distributed information services in astronomy provide... Information discovery: Search across distributed resources and services –ASDS, Astrobrowse Information retrieval: Catalog services and on-line archives –VizieR, MAST, HEASARC, IRSA, … Information integration: Catalog cross- correlation, image and graphical overlays, intelligent query/response management –IMPReSS, AMASE, SkyView, SkyCat, Aladin, Jsky ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

7. Astrobrowse

8. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999 Astrobrowse

9. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999 Astrobrowse

10. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999 Starcast

11. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

12. Starcast

13. IMPReSS

14. AMASE ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

15. SkyView ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

16. SkyView ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

17. SkyView ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

18. SkyCat ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

19. Aladin ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

20. ASDS

21. Next Step: Distributed Information Services for Space Science Maximize scientific return from space science missions Enable cross-cutting research utilizing what have traditionally been disconnected data resources Provide access to and awareness of enabling tools and technologies –Software libraries –Computational resources ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

22. Barriers to Interoperability Between Astrophysics and Other Areas of Space Science Lack of visibility of many data sets Some data not available electronically Need for data format conversion tools Lack of guidelines, standards, and oversight for data providers Discipline-oriented, PI-oriented culture Difficulty in locating data of potential interest ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

23. Planetary Exploration Search for Origins Structure and Evolution of the Universe Sun-Earth Connection Planetary Data System Astrophysics SEC Data System PDS Management Council PDS Central Node (JPL) Discipline Nodes Astrophysics Data Centers Coordinating Council Datatype-Based Data Centers IRSA (IPAC) MAST (STScI) HEASARC (GSFC) ADC (GSFC) ADS (SAO) Non-NASA Partners SECDS Coordinating Council Management Office Service Groups Solar Physics Terrestrial Environment Imagery In Situ Space Physics Data Providers NASA Science Themes: NASA Space Science Data Management Structure

24. Astrophysics Space Science Data Systems Science Themes Structure and Evolution of the Universe Search for Origins Planetary Exploration Sun-Earth Connection Astrophysics Data Centers Coordinating Council Datatype-Based Data Centers  IRSA (IPAC) - Infrared, Interferometry  MAST (STScI) - EUV, UV, Opt, Near-IR  HEASARC (GSFC) - EUV, X-ray, Gamma-ray  ADC (GSFC) - Catalogs  ADS (SAO) - Abstracts  Chandra (SAO) SEC Data System SECDS Coordinating Council Management Office Service Groups  Solar Physics  Terrestrial Environment Imagery  In Situ Space Physics Data Providers Planetary Data System PDS Management Council PDS Central Node (JPL) Discipline Nodes  Atmospheres  Geosciences  Imaging  Navigation & Ancillary Info  Planetary Plasma Interactions  Rings  Small Bodies

25. Models for a Space Science Information System “Good” - user can access many resources (current WWW; AstroWeb, SPDS) “Better” - web-based client directs user queries to appropriate services (current AstroBrowse system) “Best” - web-based client locates services relevant to user, sends queries, and collates responses (goal of ISAIA) ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

26. The Web User “good” User Query Agent “better” Astro- browse User Query/ Response Agent “best” ISAIA Space Science Data Services

27. Building a Distributed Data System for Space Science Standardize query protocols through use of profiles –Profiles map generic terms onto discipline or site-specific metadata and define the allowed logical operators (=, >, x.. y) Keep infrastructure light-weight –Potential barrier for participation must be kept as low as possible –Data providers must not have to modify internal data services/structures Automate maintenance and distribution of profiles, e.g., using GLU ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

28. AstroBrowse AstroBrowse is a first generation effort to implement the query agent Concept by R. Hanisch and S. Murray (SAO), implementations by T. McGlynn/C. Heikkila (HEASARC) and T. Kimball (STScI), GLU support from P. Fernique and M. Wenger (CDS) as well as CDS implementation AstroGLU ~1000 resources (observation logs, catalogs) Preselection of which resources to query by data type, bandpass, data location, etc. Searches done using object coordinates (obtained from SIMBAD or NED name resolvers ) ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

29. ISAIA ISAIA (Integrated System for Archival Information Access) is the next step in implementation of the query/response agent Intended to span all space science disciplines Will layer upon and interface to existing systems (e.g., Planetary Data System DIS, Distributed Inventory System, and emerging SECDS) Profiles map high-level standard terms to resource-specific qualifiers Profile maintenance is distributed among participating sites and services via GLU ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

30. ISAIA Development Requirements “Light weight”: minimal to zero costs to data providers for participation, no constraints on how an organization manages its data internally Preserve identity of participating services yet make their data available as seamlessly as possible Development Plan Define profiles (work in progress) Implement query agent based on profiles (next step in evolution of AstroBrowse) Develop integrator ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

31. ISAIA Profiles Three components: –Resource profile characterizes data holdings and allows query agent to determine which sites and services to send queries to –Query profile provides map of generic query terms to site/service specific terms (e.g., bandpass  filter name) –Returned information profile labels returned metadata to facilitate integration of results from different services Profile implementation likely to utilize XML ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

32. ISAIA Resource Profile Queryable fields are those that can be used to restrict the records returned from the resource based on a comparison with a test value or values. Would typically be used to determine if the resource is of interest to the user and should be sent subsequent queries for specific data. Non-Queryable fields are simply attributes of the resource ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

33. ISAIA Resource Profile FACILITYname of observatory, mission, program, etc. DISCIPLINEastronomy, space physics, planetary science, solar physics INSTRUMENT HOSTname of telescope (HST, IUE, COBE, …) INSTRUMENT NAMEname of instrument (WFPC, NICMOS, FIRAS, …) INSTRUMENT TYPEmagnetometer, spectrometer, imager, photometer,... OBSERVED PHYSICALphoton, electron, proton, ion, atom, molecule, magnetic QUANTITYfield, electric field, pressure, temperature,... SAMPLING MODEtime series, image, aperture, spectrum, visibility, scan,... DATA CLASSpointed observation, survey observation, derived (catalog), simulation, model fit, ephemeris, software, literature DATA FORMATFITS, CDF, PDF, HDF, ASCII, … TIME SPANrange of times covered by resource PRIN. INVESTIGATORname of PI for INSTRUMENT NAME OBJECT NAMEastronomical object name, planet name, region of space OBJECT TYPEasteroid, planet, star, quasar, solar wind, aurora BANDPASSoptical, UV, IR, 2-10keV,... Queryable Fields ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

34. RESOURCE NAMEname of the data resource described by this profile DATA SERVICE SITEname of the data center name providing the data CURATORname of person or organization responsible for knowledge of the data RESOURCE URLURL for accessing the resource for end-users SUB-PROFILESidentifiers for sub-profiles supported by this resource Non-Queryable Fields ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999 ISAIA Resource Profile

35. Following development of profiles, proto-typing will also be done on an integrator An integrator is an application which receives query responses, labeled using the terms of the response profile, and presents response information in a uniform format Functions include –conversion of units and coordinates into common system (,, , , l, b, t) –sorting of tabular data –maintaining intermediate results –cross-correlation ISAIA Integrator ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

36. ISAIA Team R. Hanisch (STScI), PI T. McGlynn, N. White (GSFC/HEASARC) J. King (GSFC/NSSDC) C. Cheung, E. Shaya (GSFC/ADC) R. Plante, R. McGrath, D. Guillaume (NCSA/UIUC) J. Mazzarella (IPAC/Caltech) A. Rots (SAO) S. Hughes (PDS/JPL) S. McMahon (PDS/JPL) M. A’Hearn (UMd) R. Beebe (NMSU) F. Genova, F. Ochsenbein, P. Fernique, M. Wenger, F. Bonnarel (CDS) P. Giommi (BSDC) Interested in collaborations with other groups! ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999

37. URLs Space Science Data System –http://ssds.nasa.gov/ –http://spds.gsfc.nasa.gov/ –http://pds.jpl.nasa.gov/ AstroBrowse –http://heasarc.gsfc.nasa.gov/ab/ –http://archive.stsci.edu/starcast/ –http://simbad.u-strasbg.fr/glu/cgi-bin/ astroglu.pl ISAIA –http://heasarc.gsfc.nasa.gov/isaia/ GLU –http://simbad.u-strasbg.fr/glu/glu.html ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999