HDMC VxO SPASE 10-12 June 2008 VO-oriented activities of the CDPP M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud.

Slides:



Advertisements
Similar presentations
AMDA service Visualisation module Analysis module Time Table manager Local database Remote database Download module.
Advertisements

The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Remote Visualisation System (RVS) By: Anil Chandra.
A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.
1Key – Report Creation with DB2. DB2 Databases Create Domain for DB2 Test Demo.
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
V. Génot, C. Jacquey, E. Budnik, R. Hitier, M. Bouchemit, M. Gangloff Toulouse, France R. Conseil, D. Heulet, and C. Huc CNES Science archives.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Operating a Virtual Observatory Raymond J. Walker, Jan Merka, Todd A. King, Thomas Narock, Steven P. Joy, Lee F. Bargatze, Peter Chi and James Weygand.
SpaceGRID and EGSO Satu Keski-Jaskari Maria Vappula Parallal Computing – Seminar
1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.
Implementing ISO Aleta Vienneau and David Danko ESRI.
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
The Virtual Space weather Applications Network of Tools – ViSpaNeT - A Virtual Observatory for SWE data and model assets P. Beltrami Karlezi etamax space.
AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
THEMIS launch meeting Cape Canaveral Feb , 2007 C. Jacquey, V. Génot, E. Budnik, R. Hitier, M. Bouchemit CDPP/CESR, Toulouse, France AMDA Automated.
Plasma Node: Use Case Analysis Frascati, EuroPLANET N7 meeting, October 9, 2007 C. Jacquey, N. André, M. Gangloff, R. Hitier, E. Pallier, E. Budnik, V.
The SPASE Data Model: Standard Metadata for Space Science Data Description J. Thieman, T. King, A. Roberts, J. King, C. Harvey, and P. Richards Oct. 24,
Sun-Earth Connection MO&DA Programs - March 26, Page 1 What NASA needs from us? Presented to the Workshop: VOs in Space and Solar Physics
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP. Jacquey 1 C., V. Génot 1, E. Budnik 2, R. Hitier 3, M. Bouchemit 1, M.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
ViRBO and Autoplot. ViRBO Overview Virtual Radiation Belt Observatory Facilitate Search, Access, and Visualization of Radiation Belt Data Search – Develop.
International Conference on Comparative Planetology: Venus - Earth - Mars ESTEC, Noordwijk, The Netherlands, Thursday 14 May :10:00, Abstract #
Arc/Info 8’s Metadata Collection tool: ArcCatalog A user’s perspective By Frank Roberts Coeur d’Alene Tribe GIS.
Data discovery and data processing for environmental research infrastructures Roberto Cossu ENVRI WP4 leader ESA.
Combined use of AMDA, CAA, QSAS and CL based on time-table exchange. C. Jacquey, V. Génot, E. Budnik, M. Bouchemit, M. Gangloff, CDPP/CESR B. Cecconi,
The european ITM Task Force data structure F. Imbeaux.
VO Sandpit, November 2009 CEDA Metadata Steve Donegan/Sam Pepler.
Workshop 1.4: ESPON Database ESPON Internal Seminar November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
SPASE: Metadata Interoperability in the Great Observatory Environment Jim Thieman Todd King Aaron Roberts Joe King AGU Joint Assembly May 23, 2006.
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP usable for THEMIS data exploitation. THEMIS SWT, Boulder March 23-25,
The Virtual Magnetospheric Observatory VMO/U Ray Walker Todd King Steven Joy.
R. Suresh (NASA/MTECH) Ben Burford (JAXA) Bernhard Buckl (DLR) Contact: - CEOS WGISS Meeting, Beijing, China, September 2004 A RSS.
The CDPP (Centre de Données de Physique des Plasmas) is the french national centre of natural plasma data. Development of new tools and interoperability.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
SPASE and the VxOs Jim Thieman Todd King Aaron Roberts.
VSO Status Update HDMC Meeting 9 June Vision To allow solar physicists to identify and search for data even if they don't know it exists. Make.
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Plasma Node demonstrators 1/Registry : –Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX ) –Compliant with the SPASE data model
F. Genova, VO as a Data Grid, 2003/06/301 Interoperability of astronomy data bases Françoise Genova, CDS.
SWT Overview 1 UCB, Nov15/16, 2006 Mirror site and services at CESR and CDPP Christian Jacquey, CDPP, CESR, Emmanuel Penou, CESR,
The Virtual Heliospheric Observatory and Distributed Data Processing T.W. Narock 1,2, A. Szabo 2, A. Davis 3 1. L3 Communications,
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
VxO Kickoff Meeting - May 22, 2006 The Evolving Heliophysics Data Environment: “VxO Kickoff” Chuck Holmes Joe Bredekamp May 22, 2006.
A Perspective on the Electronic Geophysical Year Raymond J. Walker UCLA Presented at eGY General Meeting Boulder, Colorado March 13, 2007.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
The Virtual Heliospheric Observatory VHO. The VHO Team Adam Szabo (lead)NASA/GSFC Andrew DavisCaltech George HoJHU/APL Justin KasperMIT Jan MerkaU. Maryland,
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
R. Maggiolo 1, M. Echim 1,2, D. Fontaine 3, A. Teste 4, C. Jacquey 5 1 Belgian Institute for Space Aeronomy (IASB-BIRA); 2 Institute.
Generation of plasma boundary datasets for CAA Tiera Laitinen Finnish Meteorological Institute.
HELIO: Discovery and Analysis of Data in Heliophysics Robert Bentley, John Brooke, André Csillaghy, Donal Fellows, Anja Le Blanc, Mauro Messerotti, David.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.
Solar System Plasma data archiving in France
Flanders Marine Institute (VLIZ)
The IMPEx Data Model and Protocol
EuroPlanet Integrated and Distributed Information Service (IDIS)
Maria Teresa Capria December 15, 2009 Paris – VOPlaneto 2009
PLANETARY ATMOSPHERES DEVELOPMENTS OF DATA ARCHIVING, TOOLS AND SERVICES AT IPSL IN FRANCE Alain Sarkissian General Portal IDIS (Europlanet) VO-Planéto.
Institut de mécanique céleste et de calcul des éphémérides
Presentation transcript:

HDMC VxO SPASE June 2008 VO-oriented activities of the CDPP M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud Key points of the CDPP activities:Involvement in SPASE Searchable registries AMDA IVOA connection (OV-France) Projects under development: EUROPLANET/IDIS Time-Table exchange (CAA, CDPP, QSAS, CL) Project in perspective:HELIO-2

HDMC VxO SPASE June 2008 EuroPlaNet What is EuroPlaNet ? What is IDIS ? Current status EuroPlaNet Resource inventory IDIS Plasma Node Registry Demonstrator IDIS Plasma Node Science Demonstrator –What is AMDA ? –Access remote data in AMDA Current status ( data tree as a whole ) The future ( selected data only) –Lessons learned –Event tables management with AMDA The future of EuroPlaNet ( )

HDMC VxO SPASE June 2008 What is EuroPlaNet ? A European network for the development of planetary sciences in Europe Coordinates different activities : N1-Management N2-Discipline working group N3-Coordination of earth-based and space observations N4-Outreach N5-Personnel exchanges N6-Meetings and conferences N7-Integrated and Distributed Information Service (IDIS) IDIS will provide a common and user-friendly access to the data and information produced by the various types of research activities IDIS is the first step towards a European Planetary VO

HDMC VxO SPASE June 2008

EuroPlaNet IDIS Architecture IDIS TOP NODE europlanet-idis.fi Interiors and Surfaces DLR Berlin Atmospheres IPSL/SA Paris Plasma Sciences IWF Graz CDPP Toulouse Small bodies and Dust INAF-IFSI Rome Other labs Node structure

HDMC VxO SPASE June 2008 Current status of IDIS Every node provides a web server with a list of resources Every node implements a prototype of searchable registry of resources in XML according to the SPASE model The Plasma Node implements 2 demonstrators : registry and science

HDMC VxO SPASE June 2008 Plasma Node Registry Demonstrator –Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX ) –Compliant with the SPASE data model –eXist database (native XML, parameter level) –Search engine ( measurement type, region) –Goals: demonstration and experimentation

HDMC VxO SPASE June 2008 Plasma Node Registry Search Engine : Search criteria: –Time span –Measurement type –Observed region –Resource type ( numerical data, display data or catalog) Response: –Spase Xml descriptor –Possibility to use XSL style sheet to customize presentation

HDMC VxO SPASE June 2008 Plasma Node registry Interface Possibility to select a measurement type

HDMC VxO SPASE June 2008 Response is a list of SPASE descriptors

HDMC VxO SPASE June 2008 Plasma Node Science Demonstrator Based on the AMDA Service Access remote data (MAPSKP, Vex- MAG,HST) with a SPASE compatible description

HDMC VxO SPASE June 2008 AMDA Automated Mutiple Dataset Analysis  Multi spacecraft and multi-instrument data  Visualisation  User defined parameter computation  Standard model computation  Data and computed parameter extraction  Automated or visual search on the data  AMDA local database (CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, ISEE)  Access to remote databases (CDAWeb, MAPSKP, THEMIS/CESR, …) Visualisation Parameter editor Download data Conditional or Visual search Remote data access Time-Table manager Service Possible to get a « guest « account for a limited period (one hour) or a permanent login

HDMC VxO SPASE June 2008 Data access in AMDA Local DB

HDMC VxO SPASE June 2008 AMDA : external tree Select data on a remote server Save parameter to user’s workspace

HDMC VxO SPASE June 2008 Access remote data in AMDA Spase Compatible Registry Local DB MAPSKP(remote) VEX-MAG (remote) HST (remote) AMDA GetAvailableData GetDatasetInfo GetDatasetURLs

HDMC VxO SPASE June 2008 Plasma Node registry interfaces Registry Spase XML Descriptors MapsKP server Daily update (data) (metadata) describes WEB SERVICES getAvailableData data tree getDatasetInfo spase descriptor getDatasetURLs URLs of granules AMDA Build data treeBuild parameters Wget(datasetURLs ) XQUERY

HDMC VxO SPASE June 2008 Registry Spase XML Descriptors MapsKP server Daily update (data) (metadata) describes WEB SERVICES getAvailableData (measurementType= ThermalPlasma) data tree getDatasetInfo spase descriptor getDatasetURLs URLs of granules AMDA Build data treeBuild parameters Wget(datasetURLs ) XQUERY Plasma Node registry interfaces

HDMC VxO SPASE June 2008 Lessons learned The SPASE model may be used for the EuroPlaNet IDIS Plasma Node Some additions/modifications needed to read data files Need to update some lists (coordinate systems, regions)

HDMC VxO SPASE June 2008 Cassini coordinate systems not available in the SPASE lists [KSM, KSO, KG]

HDMC VxO SPASE June 2008 Use « ParameterKey » to read Elements

HDMC VxO SPASE June 2008 Time [UTC] Bx By Bz |B| T00:00: T00:01: T00:02: T00:03: An example of Data File : Magnetic Field in KG Coordinates Field 0Field 1Field2Field3Field4 Parameter key

HDMC VxO SPASE June 2008 FLOAT FLOAT An auxiliary XML descriptor is used to describe information needed to access the tabular data in an ASCII file

HDMC VxO SPASE June 2008 The future of EuroPlaNet ( ) Key challenge for FP 7 Datamodel (s) for planetology The CDPP will be responsible for this work package

HDMC VxO SPASE June 2008 Event tables management in AMDA Time (or Event) Tables are collections of times when ‘something’ happens or time spans when some conditions are true. Currently produced and managed « manually » by the scientists for their own use or for a community of users. AMDA is increasing the possibilities of these tables : it provides a generic tool to create, manage and share these objects How to generate Time tables with AMDA : With the search tool based on mathematical criteria applied to the contents of the data With the visual search tool AMDA can ingest Time Tables : Coming from statistical studies ( e.g magnetopause crossing lists ) Produced by users Current status:

HDMC VxO SPASE June 2008 VISUAL SEARCH Record intervals of interest in time table by mouse click

HDMC VxO SPASE June 2008 Edit search criteria with math operators or functions Define a time interval

HDMC VxO SPASE June 2008 Edit search criteria with math operators or functions Define a time interval

HDMC VxO SPASE June 2008 Time Table generated by CDPP; Conditions: MOM_C1(6)/MOM_C1(5)>1; Source: AMDA Search ; Creation Date : Tue Jun 3 14:10: ; CDPP time tag for beginning of interval time tag for end of interval T02:00: T04:10: T04:40: T06:20: T06:30: T07:10:00 An example of Time Table generated with AMDA Tables may be exported in VOTable Format (IVOA Standard to exchange tabular data) Management of Time Tables

HDMC VxO SPASE June 2008 time tag for beginning of interval time tag for end of interval Geomagnetic Latitude Geomagnetic Longitude Local Time of onset T02:00: T04:10:

HDMC VxO SPASE June 2008 Event tables : Next step Exchange of standardized time tables between data centres, services, tools. A complete description of a time table may be difficult : –Description of the data source –Description of search criteria : visual, mathematical –Description of the methods used (models, …) Use Spase « catalog » resource ? A project started (early 2008) : Exchange of TT between CAA QSAS CL and AMDA

HDMC VxO SPASE June 2008 In perspective : HELIO 2 Virtual Observatory for the 4D heliosphere  VO for solar and solar system plasma data  Allow search, access, extraction of data  Provide tools and services for :  feature recognition  catalogue management  data mining … Call: FP7-INFRASTRUCTURES , September 11, 2008 Likely interfaces with US VxOs and EUROPLANET-IDIS