1. How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Christophe.Arviset@esa.int Research and Scientific Support Department Science Operations and Data Systems Division European Space Astronomy Centre ESA, Villafranca del Castillo, Madrid, Spain

2. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 2 ESAC and VO Services  ISO Data Archive  Standard User Interface : http://www.iso.vilspa.esa.es/ida/ http://www.iso.vilspa.esa.es/ida/  SIAP : http://pma.iso.vilspa.esa.es:8080/aio/jsp/siap.jsp?FORMAT=METADATA http://pma.iso.vilspa.esa.es:8080/aio/jsp/siap.jsp?FORMAT=METADATA  SSA : http://pma.iso.vilspa.esa.es:8080/aio/jsp/siap.jsp?POS=304,38&SIZE=1&imagetype=sp ectrum http://pma.iso.vilspa.esa.es:8080/aio/jsp/siap.jsp?POS=304,38&SIZE=1&imagetype=sp ectrum  XMM-Newton Science Archive  Standard User Interface : http://xmm.vilspa.esa.es/xsa/ http://xmm.vilspa.esa.es/xsa/  SIAP : http://xsa.vilspa.esa.es:8080/aio/jsp/siap.jsp?FORMAT=METADATA http://xsa.vilspa.esa.es:8080/aio/jsp/siap.jsp?FORMAT=METADATA  VOSpec  Tool to handle spectra from VO SSAP compliant server  http://pma.standby.vilspa.esa.es:8080/vospec/ http://pma.standby.vilspa.esa.es:8080/vospec/

3. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 3 Inter-Operability : 3 steps process  Step 1: Specific inter-operability services  Postcard Server (access to preview images) via HTML  Product Server (access to data) via HTML request and data back by FTP  Step 2: Generic Archive Inter-Operability System (AIO)  Includes original HTML postcard and product servers  Query Server (access to metadata)  Product Server (access to data) in socket mode, with XML request  Step 3: VO compliant Inter-Operability System  Build extra layer on top of existing AIO system to comply with Virtual Observatory standards  Flexibility for any future standard changes

4. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 4 Archive VO compliant Architecture Project Business Logic Translation Layer Meta Data in Database Data Products on hard disks Product Request Products GUI Database/Product Request GUI Database Result / Product DB/Product Request DB Result / Product Project Product Request Project Product DB/Product Request DB Result / Product SIAP/SSA Request VOTable / Product Translation Layer Archive Inter Operability Project Product Request Project Product (Scriptable Interface) Foreach observation in (list) AIOgetdata (datatype) Process data DB/Product Request DB Result / Product

5. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 5 From IRSA From outside to ISO data From CDS/VizieR ISO Postcard Server From ADS From HEASARC

6. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 6 Step 1: Specific inter-operability services  Remote client needs to know the list of observations (metadata) in the archive  Provision and regular updates of the “observation log”  Access to postcard server via HTML  http://xsa.vilspa.esa.es:8080/aio/jsp/createPostcards.jsp?obsno=0112570601 http://xsa.vilspa.esa.es:8080/aio/jsp/createPostcards.jsp?obsno=0112570601  Access to product server via HTML, data back via FTP  http://xsa01.vilspa.esa.es:8080/aio/jsp/product.jsp?obsno=0112570601&level=ODF http://xsa01.vilspa.esa.es:8080/aio/jsp/product.jsp?obsno=0112570601&level=ODF  Drawbacks  Difficult and static access to metadata  Difficult to make automatic script to download lots of data  Limited level of data processing accessible (raw, fully processed)

7. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 7 Step 2: AIO System  Complete Inter-Operability system  Access to metadata dynamically (via XML scripting)  Access to postcard server (preview image) as before via HTML  Access to product server (data) as before via HTML, data back in FTP  Access to product server in socket mode (XML request), data back through socket  Access to all level of data processing products, access to individual files  Provides powerful scriptable interface for internal and external users Foreach observation in (list) AIOgetdata (datatype) Process data  Used a lot by Scientists for Calibration and Monitoring purposes  As if they have the complete data repository on their local disk

8. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 8 Step 3: VO compliant AIO System  Our existing AIO already carried all the functionalities required by the new VO standards  Access to metadata (database)  Access to products (data repository)  By using “Translation Layer”, easy to convert the VO standards interfaces into our AIO interfaces  Little effort required  Translation Layer easy to code using XML  As VO standards evolve, our AIO system remains, but we just have to adapt our translation layers

9. Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department VOTech Kick-Off, 16/11/ 2004, page 9 Conclusions  Archive Inter-Operability aspects  Own inter-operability system for project specific needs (AIO)  Adapt own AIO system to VO interoperability standards via translation layers  Adapting ISO and XMM-Newton archives to VO standards (SIAP, SSAP)  Made easy by use of open 3-tier architecture  Keep your own project back-end (data store, database) as is  Use of translation layers will facilitate changes while VO standards are still evolving  Jsp/Servlets/Java has proven to be a good suite for developing VO interoperability