Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb. 2008.

Slides:



Advertisements
Similar presentations
VODA - A Sampo Project Johan Lindroos – CSC Scientific Computing Ltd, Finland Pekka Järveläinen – CSC Scientific Computing Ltd, Finland Richard Hook -
Advertisements

AMDA service Visualisation module Analysis module Time Table manager Local database Remote database Download module.
Instant JChem 2009 US + EU Seminars Confidential. Copyright© 2009 ChemAxon Kft, Informatics Matters Ltd Instant JChem Instant JChem Seminar series Q
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Remote Visualisation System (RVS) By: Anil Chandra.
Dream Report: Advanced Manual Data Entry
Enhancing Spotfire with the Power of R
Measurement Systems Analysis with R&R INNOVATOR Lite TM The House of Quality presents.
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
V. Génot, C. Jacquey, E. Budnik, R. Hitier, M. Bouchemit, M. Gangloff Toulouse, France R. Conseil, D. Heulet, and C. Huc CNES Science archives.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Introduction To Form Builder
BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.
A Scalable Application Architecture for composing News Portals on the Internet Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta Famagusta.
HDMC VxO SPASE June 2008 VO-oriented activities of the CDPP M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud.
S. Derriere et al., ESSW03 Budapest, 2003 May 20 UCDs - metadata for astronomy Sébastien Derriere François Ochsenbein Thomas Boch CDS, Observatoire astronomique.
AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Applets & Video Games 1 Last Edited 1/10/04CPS4: Java for Video Games Applets &
Fluency with Information Technology INFO100 and CSE100 Katherine Deibel Katherine Deibel, Fluency in Information Technology1.
VO & Astro-Wise & others A.Belikov OmegaCEN
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
THEMIS launch meeting Cape Canaveral Feb , 2007 C. Jacquey, V. Génot, E. Budnik, R. Hitier, M. Bouchemit CDPP/CESR, Toulouse, France AMDA Automated.
Solar Terrestrial Physics: ESA SpaceGRID Chris Perry, Rutherford Appleton Laboratory 21st March 2003.
SPEDAS SoftwareSlide − 1Snowmass, CO – June 2015 SPEDAS Developers Workshop GEM – Snowmass, CO June 17, 2015.
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP. Jacquey 1 C., V. Génot 1, E. Budnik 2, R. Hitier 3, M. Bouchemit 1, M.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
Combined use of AMDA, CAA, QSAS and CL based on time-table exchange. C. Jacquey, V. Génot, E. Budnik, M. Bouchemit, M. Gangloff, CDPP/CESR B. Cecconi,
Touchstone Automation’s DART ™ (Data Analysis and Reporting Tool)
The european ITM Task Force data structure F. Imbeaux.
Research Design for Collaborative Computational Approaches and Scientific Workflows Deana Pennington January 8, 2007.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP usable for THEMIS data exploitation. THEMIS SWT, Boulder March 23-25,
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
The CDPP (Centre de Données de Physique des Plasmas) is the french national centre of natural plasma data. Development of new tools and interoperability.
1 Getting Started Exercise Part 1. 2 Profiles related to the exercise When starting use archive profile: GettingStarted_Start.zip The fully completed.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
INTRODUCTION TO GIS  Used to describe computer facilities which are used to handle data referenced to the spatial domain.  Has the ability to inter-
Mantid Stakeholder Review Nick Draper 01/11/2007.
Hellenic Centre for Marine Research (HCMR) MedOBIS - Ocean Biogeographic Information System for the Eastern Mediterranean and Black Sea.
Plasma Node demonstrators 1/Registry : –Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX ) –Compliant with the SPASE data model
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
JWST Pipeline/Analysis Tools Perry Greenfield Science Software Branch.
SWT Overview 1 UCB, Nov15/16, 2006 Mirror site and services at CESR and CDPP Christian Jacquey, CDPP, CESR, Emmanuel Penou, CESR,
7b. SDMX practical use case: Census Hub
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
Qtran Software Updates. Qtran Qtran Handles CAA Time Range data type (becomes 2 Epoch values in CDF) Single record of fill values written into empty.
OVT status Yuri Khotyaintsev Swedish Institute of Space Physics, Uppsala and the OVT team ovt.irfu.se November 18, 2015.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
Lecture 11 Introduction to R and Accessing USGS Data from Web Services Jeffery S. Horsburgh Hydroinformatics Fall 2013 This work was funded by National.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
R. Maggiolo 1, M. Echim 1,2, D. Fontaine 3, A. Teste 4, C. Jacquey 5 1 Belgian Institute for Space Aeronomy (IASB-BIRA); 2 Institute.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Databases (CS507) CHAPTER 2.
MS Access Forms, Queries, Reports Matt Martin
E.C. Auden1, J.L. Culhane1, Y. P. Elsworth2, A. Fludra3, M. Thompson4
Database System Concepts and Architecture
16th CAA Cross-calibration Workshop
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
Solar System Plasma data archiving in France
IsoveraDL Performance Enhancements
The New Face of Information Retrieval: The Ankara University Open Access Platform Prof. Dr. Sekine Karakaş Prof. Dr. Doğan.
What's New in eCognition 9
X-ray high resolution spectra in the VO: the case of XMM-Newton RGS
Presentation transcript:

Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb. 2008

We all use time as an ordering quantity Goals of this meeting 1/ Context - Define time tables : TT - Show the scientific interest of TT exchange (see use case presentation) - See how time is handled in our different systems 2/ Actions - Define a common TT format - Define an exchange protocole for communication between services / centres / tools - Define TT management tools : merge, intersect, extend, shift (SW) 3/ Perspectives Think beyond time tables : catalogues of statistical parametres (mean, max, min)

Time Table management with AMDA Automated Multi Dataset Analysis cdpp-amda.cesr.fr

-What is AMDA ? - objectives - functionalities -How does the information circulate inside AMDA ? - parameters - TT -Communication between centres / services / tools - External data : CDAWeb, MAPSKP - CAA connexion demo

… for simple browse, building catalogues, performing statistics Objectives Ease manipulation of data from heterogeneous origins … Plot Combine Search Download Mission Instrument Resolution Local Remote User owned

1/ Activity 2/ Data 3/ Time frame Using AMDA Select

The parameter level A parameter is any time series : - magnetic or electric field vector - particles moments - indices combinations of the previous  valid on a given time range  at a given time resolution  used for : - plotting - searching - downloading,... 17/11/ /12/2005 Sampling 4s The file organisation inside the archive is hidden to the user

New parameter contruction 1/2 mouse clicks define time resolution define parameter name supply description

Save new parameter in user workspace The newly constructed parameter is now an element of the database. It is computed on the fly only when it is needed (virtual object concept). Parameters from -different missions -different instruments -with different time resolution may be conbined New parameter contruction 2/2

Tools are implemented : -‘time shifting’ to account for time lag between instruments, -‘resampling’ to account for resolution difference between instruments.

The Time Table level an easy way to communicate information between data centres/archives - Time tables, or event lists, are a collection of times when ‘something’ happens or time spans when some conditions are true. - They are usually manually created and managed by scientists for their own need or the one of restricted community. - AMDA enhances the potentialities of these objects by offering a generic tool to create, handle and communicate them between databases/archives and users. These time-tables may be used for : - extracting sub-databases, - executing massive and/or interactive treatments, - creating catalogues, - serving as reference in the community

Create a time table : 1- Conditional Search Edit a condition with mathematical operators/functions mouse clicks T  /T // > 1 Define time span or use a time table

An example: search of the events when the cross-tail current is “encircled” by CLUSTER Test: X1< -10 Re BX 1 * BX 2 * BX 3 * BX 4 > 0 min([BX 1 BX 2 BX 3 BX 4 ]) < 0 max([BX 1 BX 2 BX 3 BX 4 ]) > 0 Looking for the time periods when 2 s/c are above the neutral sheet and the 2 other ones are below magnetic field magnetic field X coordinate

Create a time table : 2- Visual Inspection Record intervals of interest by mouse clicks

The time table may be edited in the user workspace

Tables may be exported in VOTable format TT format

VOTable latest release: Version August 11, 2004 VO standard and as such supported by IVOA VOTable is designed as a flexible storage and exchange format for tabular data, with particular emphasis on astronomical tables.

Complex tables (catalogues) may be produced : - with multiple time tags - associated parameters : average, max, min - geographic information -...

Service 1 Service 2 Magnetospheric data Service 3 Service 4 Solar archive Ionosphere Thermosphere archive KP archive 2 KP archive 2 HR archive 1 HR archive 2 Time table - AMDA What were the input conditions ? What are the consequences ? Time table circulation in a multi-archive environment applying delay

Interface for building the external base data tree External Bases User build data tree CDAWeb MAPSKP CDPP …

External data tree Local base External base user-extract Parameters are available on the fly which implies : - data downloading (3 days at a time) - format transformation - building the AMDA parameter

Local Database AMDA System CDAWeb CDPP MAPSKP Connexion à des bases externes others

Connexion to CAA

Time Tables at CDAWeb

Conjunction Event Finder for

Architecture d’AMDA