European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.

Slides:

Advertisements

Similar presentations

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé AIDA WP3 - Curation September 2009, VOTech, Trieste Curation.

Advertisements

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VOSpec IVOA Poona Sep 2004 VOSpec: A Tool to.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.

ESA/ESAC European Space Astronomy Center Villafranca del Castillo MADRID SPAIN IVOA Workshop 2004 Cambridge Mass Pedro OSUNA ESAC(VILSPA) proposals for.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations Sep 2006, Moscow, Russia Simple Line.

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Alberto Micol ISO & CharDM IVOA Cambridge, The Characterisation.

MEx Metadata extraction. IVOA Interop, Moscow, 19-Sep-2006 Metadata extraction The problem The problem Data centres need their data described homogeneously.

SLAP: Simple Line Access Protocol v0.5

Pierre Fernique - CDS - Interop Beijing Some new functions 2. Support for very large images & catalogs 3. More VO data servers 4. More supported.

6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.

2008 NVO Summer School1 Finding Services in the NVO Registry Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.

9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.

2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.

Sept NVO Summer School1 Cone, SIAP, and OpenSkyQuery Client Development Gretchen Greene, Maria Nieto-Santisteban T HE US N ATIONAL V IRTUAL O.

Publishing catalogues: HIPASS and SUMSS Australian Virtual Observatory 2003 Workshop 17th-18th November 2003 Sydney David Barnes, Brett Beeson, Travis.

Building FHIR Servers on Existing Applications

CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.

October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.

Caching the MDSPlus Data via Hibernate By Ajith M Jose Comp6703 Project Client: Raju Karia Supervisor: Dr. Henry Gardner (Development of “WebScope”)

2 - Declared in dataSet Table 3 - Described in attribut Table 1 - A table of data (here HIRES data from Clementine) SITools is based on a concept of services:

Multiple Tiers in Action

TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.

OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Homogeneous Access to Tabular Data Beijing, China - May.

2003 April 151 Data Centres: Connecting to the Real World Clive Page.

3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,

WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.

DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

The ASDC SED Builder Milvia Capalbi (INAF-ASDC) in collaboration with Paolo Giommi (ASI-ASDC), Giulia Stratta (INAF-ASDC), Roberto Primavera (ElsagDatamat)

Tero Oittinen Sampo Team Department of Astronomy University of Helsinki,Finland Using ESO Reflex to access astronomical WebServices by The Sampo.

Last News of and

ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations May 2007, Beijing, China Simple Line.

Virtual Observatory Interfaces reused in the Virtual Atomic and Molecular Data Centre Guy Rixon Institute of Astronomy University of Cambridge September.

Designing and Developing WS B. Ramamurthy. Plans We will examine the resources available for development of JAX-WS based web services. We need an IDE,

How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.

Marianne BargiottiBK Workshop – CERN - 6/12/ Bookkeeping Meta Data catalogue: present status Marianne Bargiotti CERN.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi VOSpec, new functionalities Madrid, 6-7Oct 2005 New functionalities.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado Spectroscopic lines in the VO context Mar 2007, ESAC, Madrid,

ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Isa Barbarisi Beijing, May 2007 VOSpec new functionalities.

Integrated Grid workflow for mesoscale weather modeling and visualization Zhizhin, M., A. Polyakov, D. Medvedev, A. Poyda, S. Berezin Space Research Institute.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado IVOA Interop meeting Strasbourg, May 2009 (1/12) SLAP v0.9.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro OSUNA ESAC ADT Team VO-tech Cambridge 2004 VOSpec: A Tool to Handle.

AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Applications May 2006, Victoria, Canada VOQuest A tool.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain ESAVO Registry.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Andrea Laruelo IVOA Interoperability Cambridge September 2007 Mathematical.

Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado

ESA-VO Registry Aurélien STEBE, Christophe ARVISET.

Science Operations & Data Systems Division Research & Scientific Support Department IVOA Tutorial Strasbourg Pedro OSUNA How to adapt existing archives.

UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado AIDA Tech. Meeting Strasbourg, March 2009 (1/8) WP7 Task.

12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.

ESAVO/European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna ASVOWS Mar 2007 ESAC Astronomical Spectroscopy.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Pedro Osuna VOSpec Kyoto May 2005 VOSpec: A Tool to Handle VO-Compatible.

Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)

Outline Server side Dependencies Installing it Configuring it Client side coding Browser setup.

Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.

DGC Paris Spitfire A Relational DB Service for the Grid Leanne Guy Peter Z. Kunszt Gavin McCance William Bell European DataGrid Data Management.

ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.

© Roy Williams 2002 The Uphill Battle of Semantic Interoperability Roy Williams California Institute of Technology.

IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.

Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) How to implement CDI ? M. Fichaut,

Interoperability and Prototype

SVO - ESAVO Use case: Comparison of evolutionary synthesis models

ESA/VO - European Space Astronomy Centre (ESAC)

Presentation transcript:

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia DALToolKit Ingestor & Server Create simple DAL servers easily Aurélien Stébé ESAVO - European Space Astronomy Centre (ESAC)

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia System Architecture Config Files FITS FilesIngestor DB Server DAL Request VOTable File Sys

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALIngestor  Java client applet extracting FITS metadata  Takes as input : FITS Files to create SIAP / SSAP / SLAP /... services Config Files mapping FITS Keyword and DB Columns  Gives as output : RDBMS table filled with extracted FITS Files metadata  Future : Support for more input formats : Images, VOTable, ASCII...

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALIngestor - GUI

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer  Java server application serving FITS metadata  Takes as input : Standard “S*AP” data query string (SIAP, SSAP, SLAP, etc...) Standard “S*AP” metadata query string (FORMAT=METADATA) Config Files & FITS Files & Metadata Table  Gives as output : VOTable v1.1 filled with FITS metadata FIELDS info from Config Files metadata  Future : Create templates for all the other DAL protocols

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer - config  Mapping configuration params  Input/output configuration params  VOTable configuration params POSRA RA_NOM POS_RA ssa:Char.SpatialAxis... Observed Right Ascension double 1 deg pos.eq.ra [0,360[

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer - config (examples)  POS and SIZE params POS Search position in the form “RA,Dec” char * SIZE Size of the search region double deg ]0,90]

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer - config (examples)  Reference and Format params Reference ssa:Access.Reference -URLREF Dataset access URL char * meta.ref.url ”application/fits” AS Format FORMAT ssa:Access.Format MIME type of the dataset char * ALL,COMPLIANT,METADATA,votable,fits,xml,application/fits

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer - config (examples) TIME Exposure search interval TimeStart TIME-MIN ssa:Char.TimeAxis.Coverage.Bounds.Start Exposure start time... TimeStop TIME-MAX ssa:Char.TimeAxis.Coverage.Bounds.Stop Exposure stop time...

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALServer - extra  Output format : VOTable v1.1 (more soon...)  Support for Circle / Rectangular Region Search : POS and SIZE  Support for intervals : 18/42 or /42 or 18/  Support for lists : IR, X-Ray, Visible  Support for fixed values :  Automatic Web Form generation : ”application/fits” AS Format

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow Conclusions  Fast DAL service deployment : time to fill config file  Not limited to SIAP / SSAP, can serve all “S*AP”  Create service from FITS Files or flat tables  Full VOTable FIELDS params support  Search Region, intervals, lists, fixed values support  2 new XMM SSAP and 1 SLAP services for VOSpec in a few minutes  Questions ?

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow Hands on Session Main Steps  Environment set up (Tomcat, MySQL... as necessary)  Copy test FITS files under Tomcat to make them public  DALToolKit Server config - params/columns information  Install DALToolKit Ingestor & Server under Tomcat  Metadata ingestion from FITS files to the database  DALToolKit Server testing using Aladin / VOSpec    