UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.

Slides:



Advertisements
Similar presentations
May 18, 2006IVOA Interoperability Meeting Fine-grained vs. Coarse-grained Registries or How much detail about a resource should be stored in a registry?
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
8 September 2008NVO Summer School 2008 – Santa Fe1 Publishing Data and Services to the VO Ray Plante Gretchen Greene T HE US N ATIONAL V IRTUAL O BSERVATORY.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Query Methods (SQL). What is SQL A programming language for databases. SQL (structured Query Language) It allows you add, edit, delete and run queries.
19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Relational Schema: Updates and New Interface(s) Theresa Dower Registry WG 16 May 2013 IVOA.
2003 April 151 Data Centres: Connecting to the Real World Clive Page.
The SADI plug-in to the IO Informatics’ Knowledge Explorer...a quick explanation of how we “boot-strap” semantics...
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
F. Genova, VOTECH kickoff meeting, 2004/11/ Interoperability standards F. Genova, M. Allen, T. Boch, F. Bonnarel, S. Derriere, P. Fernique, F. Ochsenbein,
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Last News of and
An Introduction to Designing and Executing Workflows with Taverna Katy Wolstencroft University of Manchester.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Open Data Protocol * Han Wang 11/30/2012 *
VAMDC tutorial for prospective data-providers Guy Rixon meeting, IPR, November 2013.
T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VAO Registry Status Spring 2014 Theresa Dower Registry WG IVOA Interoperability Meeting – Madrid 2014.
Virtual Observatory Interfaces reused in the Virtual Atomic and Molecular Data Centre Guy Rixon Institute of Astronomy University of Cambridge September.
MapServer Support for Web Coverage Services Stephen Lime - Minnesota DNR Dr. Thomas E. Burk - University of Minnesota MUM Ottawa, Canada.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
Scientific Workflow Interchanging Through Patterns: Reversals and Lessons Learned Bruno Fernandes Bastos Regina Maria Maciel Braga Antônio Tadeu Azevedo.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
1 Advanced Software Architecture Muhammad Bilal Bashir PhD Scholar (Computer Science) Mohammad Ali Jinnah University.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik materials by: Katy Wolstencroft University of Manchester.
Web: Minimal Metadata for Data Services Through DIALOGUE Neil Chue Hong AHM2007.
IVOA, Kyoto May Data Access Layer Thoughts on ADQL/DAL Integration Doug Tody (NRAO) International V IRTUAL O BSERVATORY.
VAMDC infrastructure VAMDC 7th Developer’s workshop Guy Rixon.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
30 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE VOTable interface with Registry Joint Apps/DM/Registry.
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
IVOA RM, VOResources, Identifiers, Interfaces Chenzhou CUI.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Coordination Portal/Data sources L2:Data access & Handling Points to be raised : - Downloading data sources/data via the Portal…keeping visibility of data.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
Using VAMDC: tutorial introduction Guy Rixon VAMDC annual meeting 2013, Open University.
Taverna, myExperiment and HELIO services Anja Le Blanc Stian Soiland-Reyes Alan Willams University of Manchester.
Software Architecture Patterns (3) Service Oriented & Web Oriented Architecture source: microsoft.
HELIO: Discovery and Analysis of Data in Heliophysics Robert Bentley, John Brooke, André Csillaghy, Donal Fellows, Anja Le Blanc, Mauro Messerotti, David.
Exploring Taverna 2 Katy Wolstencroft myGrid University of Manchester.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
GCI Architecture GEOSS Information System Meeting 20 September 2013, ESA/ESRIN (Frascati, Italy) M.Albani (ESA), D.Nebert (USGS/FGDC), S.Nativi (CNR)
Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.
HELIOGATE – A USER EXPERIENCE PERSPECTIVE G.Pierantoni, E. Carley, B. Bentley S. Olabarriaga E. Sciacca, G. Taffoni, G. Castelli, U. Becciani.
An Introduction to Designing and Executing Workflows with Taverna
PDAP Query Language International Planetary Data Alliance
A step-by-step guide to DOI registration
Session 2: Metadata and Catalogues
Shim (Helper) Services and Beanshell Services
Google Sky.
An Introduction to Designing and Executing Workflows with Taverna
Presentation transcript:

UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin Benson Mullard Space Science Laboratory (MSSL/UCL), UK

Introduction VAMDC – Atomic and Molecular Data Centre. Main goal to build interoperable e-science environment-based interface. Targeting 17 existing A+M databases. Had no service interface and many no relational database. Allowed to define a common data model and ingestion into database along with a common interface. Heliophysics explores the Sun-Solar System. Provides an infrastructure to explore more than 200 instruments, propagation model, and other Heliophysics catalogues such as specific Event Catalogues. Much of the data already had services, required a ‘façade’ layer to give HELIO clients a common query interface. Web based GUI were built, but a need to run workflows was evident. Helio employed people from Taverna in the beginning. Kevin Benson who had experience with Taverna implemented two separate plugins for each of these domains. 2

3 Plugin Goals Discover Services Query Interface Run Application Codes Provide Utility Services if needed. **NEW (Components): From Carole talk. Some of the plugins ‘could’ be converted to ‘Components’ How to Reach these Goals?

4 Discovery  Registry (IVOA) Metadata that describes Resources. Such as a Service, Catalogue, Specific Service (i.e. Cone Search, SIA), Registries. Publishing Registries are established that manage a particular set of Resources usually for that institute. Full Registries contain all Resources and harvest the publishing registries.

5 Discovery  Registry (IVOA) 4 Key areas about the registry (*Optional): Identifier: ivo://vamdc.eu/hitran/service Core Metadata – Contact, Description, Subject, Date *Service Capabilities: hec/HelioLongQueryService hec/HelioLongQueryService *Application Input&Output metadata Table and Column Metadata Standard ID. Usually goes with a specification Location of the Service including mirrors.

6 Taverna Plugin With Resources being discoverable in a Registry. The plugin can do a query to the Registry following the IVOA Registry Interface Spec to discover the necessary Metadata and construct ‘Services’ into the Services panel.

7 Querying of a Service Both Helio and VAMDC support an IVOA protocol called TAP (Table Access Protocol). Responses are different in that HELIO returns an IVOA standard called VOTable. VAMDC has a particular AM data model that is more established called XSAMS. Both are XML based. IVOA_TAP (Helio) shows a few More common ports that are used to query In Helio. ‘Reference’ is a boolean true if you only want a URL link. False if you want the results back to Taverna. ‘Query’/’Where’ are similar SQL style queries. URL/Ivorn is a key input, tells it the location of the query service. URL  URL to the service, maybe even a test url not in the registry. Ivorn/Identifier from the Registry  Whereby the plugin will look up an ‘available’ service in the Registry. Note: Services Panel has known Services from the Registry available that have ‘output’ ports of an Ivorn (or URL) to be fed as ‘input’ into these TAP Services.

8 Running Applications VAMDC and Helio both have a desire to run particular command line based Applications. Example of a few: Flare Plotting Spectrum fitting Coordinate Transformation Both call a UWS Restful type service from the IVOA. Taverna plugin can do all the complicated calling and polling for the application to be completed. Again the Registry can provide the needed inputs and outputs.

9 Utilities and Helper Services Utilities and Helper Services are provided with VAMDC and Helio plugins. There main area is converting results into different formats (Consumer Services). AstroTaverna  Another plugin AstroTaverna has a wide range of features that are very useful individually or combinging with the Helio/Vamdc plugins. Most recognized of use: VOTable data such as fetching/parsing/visualizing. Including Cross-Match. Calling VOServices  Cone, Simple Image Access, and Simple Spectral Access. Services again found from an IVOA Full Registry. Parameter Description Language Services (newish). Calling more complicated applications.

10 Example of all services. Walk-through

11 Conclusions Workflows are in myExperiment. Need to add more from Helio side that use the plugin. Learn more at this workshop and upgrade plugins. Cleanup – Maven and logging. No ‘real’ funding for Development work at this time. Proposals in the works. VAMDC twiki.obspm.fr/twiki/bin/view/VAMDC/TavernaUserGuide twiki.obspm.fr/twiki/bin/view/VAMDC/TavernaUserGuide HELIO vernaInstallationGuide vernaInstallationGuide plugins/ plugins/