SWT Overview 1 UCB, Nov15/16, 2006 Mirror site and services at CESR and CDPP Christian Jacquey, CDPP, CESR, Emmanuel Penou, CESR,

Slides:



Advertisements
Similar presentations
AMDA service Visualisation module Analysis module Time Table manager Local database Remote database Download module.
Advertisements

The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre.
Copyright, UCL LEADERS: Linking EAD to Electronically Retrievable Sources Developing a Generic Toolkit: Architecture and technology issues ALLC/ACH Conference.
WHAT IS ELINK? Thermoflow, Inc.
Enhancing Spotfire with the Power of R
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
V. Génot, E. Budnik, C. Jacquey, J.A. Sauvaud, I. Dandouras, CESR, Toulouse, France E. Lucek, Imperial College, London, UK CDPP and ISSI 81 teams Statistical.
V. Génot, C. Jacquey, E. Budnik, R. Hitier, M. Bouchemit, M. Gangloff Toulouse, France R. Conseil, D. Heulet, and C. Huc CNES Science archives.
The Virtual Heliospheric Observatory VHO Adam Szabo, Tom Narock, Jan Merka, Aaron Roberts, Jon Vandegriff, George Ho, Jim Raines, Peter Schroeder, Andrew.
CDAWeb+ Java client: an Experiment in Integrating Disparate Data Systems Robert M. Candey (Code 612.4) Reine A. Chimiak (Code.
Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.
Page 1 An Overview of the Space Physics Data Facility (SPDF) for ViRBO Team Presented 8/31/2007 at GMU [ ]
The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.
Dynamic Web Pages (Flash, JavaScript)
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
HDMC VxO SPASE June 2008 VO-oriented activities of the CDPP M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud.
AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Page 1 An Overview of the Space Physics Data Facility (SPDF) for ViRBO Team Presented 8/31/2007 at GMU [ ]
Flexible tools for integrating observations and models Johan De Keyser Emmanuel Gamby Belgian Institute for Space Aeronomy.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
THEMIS launch meeting Cape Canaveral Feb , 2007 C. Jacquey, V. Génot, E. Budnik, R. Hitier, M. Bouchemit CDPP/CESR, Toulouse, France AMDA Automated.
Plasma Node: Use Case Analysis Frascati, EuroPLANET N7 meeting, October 9, 2007 C. Jacquey, N. André, M. Gangloff, R. Hitier, E. Pallier, E. Budnik, V.
Database structure for the European Integrated Tokamak Modelling Task Force F. Imbeaux On behalf of the Data Coordination Project.
SPEDAS SoftwareSlide − 1Snowmass, CO – June 2015 SPEDAS Developers Workshop GEM – Snowmass, CO June 17, 2015.
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP. Jacquey 1 C., V. Génot 1, E. Budnik 2, R. Hitier 3, M. Bouchemit 1, M.
International Conference on Comparative Planetology: Venus - Earth - Mars ESTEC, Noordwijk, The Netherlands, Thursday 14 May :10:00, Abstract #
Documentation: What we might do in an ideal world Ian McCrea.
Outline 3  PWA overview Computational challenges in Partial Wave Analysis Comparison of new and old PWA software design - performance issues Maciej Swat.
Combined use of AMDA, CAA, QSAS and CL based on time-table exchange. C. Jacquey, V. Génot, E. Budnik, M. Bouchemit, M. Gangloff, CDPP/CESR B. Cecconi,
Touchstone Automation’s DART ™ (Data Analysis and Reporting Tool)
The european ITM Task Force data structure F. Imbeaux.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG April 2008 Meudon, France.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
AMDA, Automated Multi-Dataset Analysis: A web-based service provided by the CDPP usable for THEMIS data exploitation. THEMIS SWT, Boulder March 23-25,
THEMIS Workshop 1 UC Berkeley, 18 December 2004 Data Products and Access Tim Quinn UC Berkeley.
THEMIS PROJECT NAS UCB, June 2003 Science Operations Tim Quinn 4 June 2003.
The CDPP (Centre de Données de Physique des Plasmas) is the french national centre of natural plasma data. Development of new tools and interoperability.
Presented by Jens Schwidder Tara D. Gibson James D. Myers Computing & Computational Sciences Directorate Oak Ridge National Laboratory Scientific Annotation.
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
The RSNA Teaching File System (MIRC) John Perry.  MIRC Overview – Teaching Files  RSNA Clinical Trial and Research Software  Hands On: Using the RSNA.
HDF EOS Workshop David Han Code
Authors: S. Beyene1, C. J. Owen1, A. P. Walsh1, A. N. Fazakerley1, E
S T A T I S T I C S A U S T R I A March SuperSTAR A joint development with STR D.Burget October 2007 © STATISTICS AUSTRIA I n f.
05/22/2006 VxO Workshop 1 A Virtual Observatory for the Ionosphere-Mesosphere- Thermosphere Community D. Morrison, M. Weiss, R. Daley, L. Immer, S. Nylund,
Plasma Node demonstrators 1/Registry : –Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX ) –Compliant with the SPASE data model
11/20/0711 Group Four Brian CurtisImran Shah Byeonghwa ParkFrancis Kanyugi CSI 710 Project 11/20/07.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG November 2007 Pasadena, California.
THEMIS SOCScience Data Products − 1March 29, 2006 Science Data Products Timothy Quinn.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
The overview How the open market works. Players and Bodies  The main players are –The component supplier  Document  Binary –The authorized supplier.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
OSSIM Technology Overview Mark Lucas. “Awesome” Open Source Software Image Map (OSSIM)
OVT status Yuri Khotyaintsev Swedish Institute of Space Physics, Uppsala and the OVT team ovt.irfu.se November 18, 2015.
Cluster Active Archive Science User Working Group (CAASUWG) - update Matt Taylor on behalf of CAASUWG.
R. Maggiolo 1, M. Echim 1,2, D. Fontaine 3, A. Teste 4, C. Jacquey 5 1 Belgian Institute for Space Aeronomy (IASB-BIRA); 2 Institute.
Generation of plasma boundary datasets for CAA Tiera Laitinen Finnish Meteorological Institute.
8th Cross-calibration Workshop CIS data delivery report Kinsale – October 2008.
Working with MAVEN Data
16th CAA Cross-calibration Workshop
CIS Data Archival Status
Solar System Plasma data archiving in France
Integrated Computational Materials Engineering
MATLAB Basics Nafees Ahmed Asstt. Professor, EE Deptt DIT, DehraDun.
LCG Monte-Carlo Events Data Base: current status and plans
Some highlights Already started:
What’s New from Platform Computing
Presentation transcript:

SWT Overview 1 UCB, Nov15/16, 2006 Mirror site and services at CESR and CDPP Christian Jacquey, CDPP, CESR, Emmanuel Penou, CESR,

What is envisioned at CESR and CDPP Mirror site of the THEMIS space data:  Relay for distributing the THEMIS space data  Backup of THEMIS space data AMDA: service for Automated Multi-Dataset Analysis  Help for event search  Help for event characterisation and statistics CL: software for integrated detailed analysis of THEMIS/CLUSTER (and others) data

THEMIS SWG meeting SSL Nov , 2006 C. Jacquey, V. Génot, E. Budnik, R. Hitier AMDA / SP Automated Mutiple Dataset Analysis / Space Physics

Example: event search Old fashion: “paper” search AE, ALISEE-data IMP-8 AE, AL ISEE MAG ISEE- electron IMP8 MAG IMP8 PLA Current fashion: web Event search takes time and energy CDAWeb SPDF UCLA CAA CDPP And others

Automated Mutiple Dataset Analysis / Space Physics AMDA / SP: the goals Multiple Dataset: the study of the (multi-scale) dynamics of plasma objects requires to perform the integrated analysis of multi-point and multi-instrument data Automated (or semi-automated) Analysis: help for  Search, characterisation, classification of events  Extensive exploitation of the vast database (statistics)  “historical” studies (example: through solar cycles)  Building catalogues  Building virtual constellations

AMDA, fact sheet Now, very first prototype (construction started in June 2006 after kind of phase-A) Built on an existing data system (DD_System, A. Fedorov) Built in IDL, C, FORTRAN, Javascript Works on standardised and “simple” data, NetCDF Includes models (Tsyganenko, Shock, MP, NS, …) Attempt for using web-services of CDAWeb and the up-coming VxOs Forum for user feedback Already in use for scientific studies

Schematic description of the envisioned system User interface System interface Local database Services CASSINI MAPSKP CDAWeb SPDF External interface Virtual objects AMDA Distant services Distant database Distant database Distant services Web-services USER

Demo Derived parameters computation (calculator) Automated and semi-automated search Sub-dataset conditional extraction Distant access to complementary data

An example: search of the events when the cross-tail current is “encircled” by CLUSTER Test: X1< -10 Re BX 1 * BX 2 * BX 3 * BX 4 > 0 min([BX 1 BX 2 BX 3 BX 4 ]) < 0 max([BX 1 BX 2 BX 3 BX 4 ]) > 0 Looking for the time periods when 2 s/c are above the neutral sheet and the 2 other ones are below

Looking for possible X-line with a pair of spacecraft BZ1 * BZ2 < 0 AND VX1 * VX2 < 0 AND BX1/Blob < 0.5 AND BX2/Blob < 0.5

CL Software for detailed analysis of multi-datasets in space physics Developed by Emmanuel Penou Scientific specifications by Jean-André Sauvaud THEMIS SWG meeting SSL Nov , 2006

CL: fact sheet Multi-missions (CLUSTER, VEX, MEX, DEMETER, ACE, STEREO, …) and multi-instrument (B,E, particles, Waves) SOLARIS, LINUX, WINDOWS IDL and C L1 files L2 files Calibration files Processing Visualisation Computation of derived products Export data (CDF, ASCII) (Conditionnal search) (Internal format CDF, ASCII)

Demo  Predefined plots  Building, editing, manipulating plots  External files. CDF files  High level products: -distribution function -spectrograms in PA, 1/V  -partial moments  Remote running

Conclusion: what can be done at CESR and CDPP for the THEMIS community? Mirror site for space THEMIS data Distributing CL, but limited user help Remote running of CL on dedicated machine(s) AMDA for event search, catalogue building, statistics on “simple” THEMIS and complementary data Coupling AMDA event search and CL (and any other softwares or system: CDAWeb, UCB, …) by exporting time-tables

Some examples: AMDA + CL (or other softwares): 1)Users produces time-tables on AMDA based on their own defined criteria applied on the content of the data they selected 2)Time-tables sent to CL 3)Users browse user-defined plots on the periods of the time- tables and then run detailed analysis on CL SSCWeb (or DARTS) + AMDA: 1)Users produces time-tables on SSCWeb based on criteria applied on the orbitography and conjonctions. 2)Time-tables sent to AMDA 3)Users produces secondary time-tables on AMDA based on criteria applied on the content of the data for the periods of SSCWeb time-tables 4)Then, these secondary time-tables are exported to detailed analysis softwares or are used inside AMDA for building catalogues, or …

Contacts CL: AMDA: forum for feedback on the CDPP services (in french for now)