Training course 2, Ostende, 20-22 May 2014 IFREMER work-flow for production of CDIs data Michèle Fichaut, IFREMER, SISMER M. Fichaut, IFREMER.

Slides:



Advertisements
Similar presentations
IRRA DSpace April 2006 Claire Knowles University of Edinburgh.
Advertisements

OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 Tools for data management in the frame.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Training Workshop – Ostende – October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 MIKADO tool M. Fichaut, V. Tosello, M.
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Cruise Summary Report Content Management SDN2 1. Training Workshop - Ostend, Belgium.
Training course – Ostende – 2-6 July 2012 Training Workshop – Ostende – 1-4 March 2010 Practical work on NEMO Converting files M. Fichaut.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management Catherine Maillard First Training Session Ostende, February.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management First Training Session – Ostende February Catherine Maillard.
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
Computer and Marine Data Department - SISMER 1 SISMER Systèmes d’Informations Scientifiques pour la Mer French National Oceanographic Data Centre Michèle.
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
IQuOD Data Flow Tim Boyer NODC. Inflow How will IQuOD quality controlled data get into the World Ocean Database?
Global Distribution Software Modules AWR Worldwide Enterprise Network.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
Research Services Introduction to research data management - a physical science case study Slides provided by DaMaRO Project, University of Oxford.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 NEMO reformatting tool v1 M. Fichaut.
7 th TTG meeting – Trieste – 3-4 March, 2015 SeaDataNet tools, new developments IFREMER : M. Fichaut, A. Briand, M. Larour, T. Loubrieu, V. Tosello ALTRAN.
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
Data on the Web Life Cycle Bernadette Farias Lóscio March, 2014.
Distributed system development, including standards and interoperability By Dick M.A. Schaap – technical coordinator Bologna, September 08.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
Synthesis of the technical activity and State of development of the on-line system V1 By Dick M.A. Schaap – technical coordinator Madrid, March 09.
EU/MAST-MATER database ( ): A reference database of high quality multidisciplinary data collected within the framework of a major international.
Eurotrace Hands-On The Eurotrace File System. 2 The Eurotrace file system Under MS ACCESS EUROTRACE generates several different files when you create.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
MAY SEA-SEARCH MEETING CYPRUS METADATA and XML in compliance with ISO Michèle FICHAUT, IFREMER/SISMER Gilbert MAUDIRE, IFREMER/ISI Mickaël.
Data Buoy Cooperation Panel Hester Viola
TTG, March 2014, Barcelona WP3: Capacity building and training.
MAY ICES – MDM 2004, BRUSSELS Processing and Quality Checks of Shipboard ADCP Michèle FICHAUT, IFREMER/SISMER.
Training session: Concept of CDI, RSM and Download Manager Peter Thijsse (MARIS) – Training workshop Oostende – 6 july 2012.
I nternational Data Exchange Workshop May 9-11, 2007, Kiel, Germany Nautilus, the Ifremer Web portal Eric MOUSSAT Data manager, marine geology and geophysics.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
Welcome to SeaDataNet Technical Task Team Meeting + a few basic questions that the co-ordinator expects to get a preliminary answer before the Kick-Off.
Business Continuity Planning for OPEN OPEN Development Conference September 18, 2008 Ravi Rajaram IT Development Manager.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, IFREMER.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) How to implement CDI ? M. Fichaut,
2 nd training course – Ostende – May, 2014 What’s new in NEMO 1.5?
Metadata generation, control and updating Peter Thijsse - MARIS.
3rd Training Workshop June 2008, Ostende Management of CSR Anne Che-Bohnenstengel, BSH  Metadata Formats  Defined Vocabularies  Content Management.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, C. GUYOT, IFREMER.
Data management dedicated for assessing and modeling of the Mediterranean and Black Seas ecosystem changes (SESAME integrated project). Isaac Gertman,
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
MIKADO – Generation of ISO – SeaDataNet metadata files
SeaDataNet tools NEMO, OCTOPUS, MIKADO
Introduction to the 1st training session of SeaDataNet 2
NEMO – Reformating tool
Practical work on NEMO Converting files
SeaDataNet tools NEMO, MIKADO, VALIDATOR
OCTOPUS – SeaDataNet Format conversion tool
ISRAMAR Work Flow for SeaDataNet
MIKADO: Generation of CDI ISO19139 XML files
INSTM (Tunisia) : SeaDataNet contribution
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
Tools for generation of SDN NetCDF (CFPOINT) files
Hovedside.
Data aggregation and products generation
Practical work on NetCDF - CFPOINT
Presentation transcript:

Training course 2, Ostende, May 2014 IFREMER work-flow for production of CDIs data Michèle Fichaut, IFREMER, SISMER M. Fichaut, IFREMER

– Training course 2, Ostende, May /18 Data inventory : CDIs from 137 labs Per InstrumentDatasets Argo floats bathythermographs discrete water samplers CTD current meters2 116 Total Access% SDN licence62.4 Unrestricted35.0 By negociation2.6

– Training course 2, Ostende, May /18 Two work flow descriptions Delayed mode data –Physical and chemical data collected during French cruises : CTDs, Discrete water samples, Current meters,… Near real time data –French Argo floats data

– Training course 2, Ostende, May /18 1. Input of CSR in IFREMER database Work-flow – Phys/Chem data from French cruises SISMER DB   SDN CSR catalogue SISMER DB Once a year

– Training course 2, Ostende, May /18 2. Input of metadata linked to CSR’s (in // to step 1) Work-flow – Phys/Chem data from French cruises SISMER DB if New project (EDMERP) New Organisation (EDMO) New dataset (EDMED) New chief scientist SISMER DB   SDN EDMO, EDMED and EDMERP catalogues

– Training course 2, Ostende, May /18 3. Data recovery from French laboratories From French CSRs Chief scientists Work-flow – Phys/Chem data from French cruises SISMER DB Once a year

– Training course 2, Ostende, May /18 Work-flow – Phys/Chem data from French cruises 4. Reformating data files, per cruise and per data type Files at format X Files at SDN format (MEDATLAS) No standard vocabulary Standard SDN vocabulary

– Training course 2, Ostende, May /18 Work-flow – Phys/Chem data from French cruises 5. Quality checks (same flag scale than SDN), par data type (CTDs, Bottle…), cruise per cruise IFREMER SCOOP Software File format SDN MEDATLAS No QC File format SDN MEDATLAS No QC File format SDN MEDATLAS QC File format SDN MEDATLAS QC

– Training course 2, Ostende, May /18 Work-flow – Phys/Chem data from French cruises 6. Archiving File format SDN MEDATLAS QC File format SDN MEDATLAS QC IFREMER server Metadata loading in-house software File archiving DB SISMER MEDATLAS files

– Training course 2, Ostende, May /18 Work-flow – Phys/Chem data from French cruises 7. CDIs XML generation, new data and updated data (timestamp in the DB) SISMER DB MIKADO XML for CDIs Twice a year

– Training course 2, Ostende, May /18 Twice a year Work-flow – Phys/Chem data from French cruises 8. Update of the coupling table SISMER DB SQL query with SQL developper Update Coupling table COUPLING table IDNumber (38,0) LOCAL_CDI_IDVarchar2 (64) MODUSNumber (1,0) FORMATVarchar2 (8) FILENAMEVarchar2 (521) SQL_QUERYVarchar2 (4000) CONNECTION_STRINGVarchar2 (128) LOGINVarchar2 (20) PASSWORDVarchar2 (20) MAPPING_FILEVarchar2 (128) XMLEXPORT_DATEDate COUPLING table ID12345 LOCAL_CDI_IDLocal_unique_id MODUS3 FORMATMEDATLAS FILENAMEfilename SQL_QUERY CONNECTION_STRING LOGIN PASSWORD MAPPING_FILE XMLEXPORT_DATE24/06/2009

– Training course 2, Ostende, May /18 Work-flow – Phys/Chem data from French cruises 9. CDIs XML sent to MARIS XML for CDIs MARIS central catalogue Catalogue Service Web Manual Automatic Twice a year

– Training course 2, Ostende, May /18 1. Data and metadata loaded in IFREMER database Work-flow – French Argo float Coriolis DB Argos Irridium CLS Automatic QC Every day

– Training course 2, Ostende, May /18 2. Manual QC of the data, by set of data not yet manually QCed Work-flow – French Argo float Coriolis DB IFREMER SCOOP2 software Every working day

– Training course 2, Ostende, May /18 Work-flow – French Argo floats 3. CDIs XML generation, new data and updated data (timestamp in the DB) CORIOLIS DB MIKADO XML for CDIs Every month

– Training course 2, Ostende, May /18 Work-flow – French Argo floats 4. Update of the coupling table SISMER DB SQL query with SQL developper Update Coupling table COUPLING table ID12345 LOCAL_CDI_IDLocal_unique_id MODUS2 FORMATODV FILENAMEfilename SQL_QUERYSql_query CONNECTION_STRING jdbc:oracle… LOGINlogin PASSWORDpassword MAPPING_FILEMap_Argo XMLEXPORT_DATE24/06/2009 Every month

– Training course 2, Ostende, May /18 Work-flow – French Argo floats 5. CDIs XML sent to MARIS XML for CDIs MARIS central catalogue Catalogue Service Web Manual Automatic Every month

– Training course 2, Ostende, May /18

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.