CAA/CFA Meeting | CFA Team | ESAC | Octiber 11 2011 CFA Under Development CAA/CFA Meeting ESAC, Oct 11 th 2011 European Space AgencyCFA Team.

Slides:

Advertisements

Similar presentations

CNES implementation of the ISO standard An extension of the current CNES implementation of the ISO metadata standard.

Advertisements

Beatriz Martinez - SAT CFA Team 2 nd CFA Implementation Review ESAC, Madrid, 06 Jun 2013 CLUSTER FINAL ARCHIVE (CFA) Future developments.

GTS MetaData Generation data GTS data bases GTS Switch Volume C1 Central Support Office Information Classes white-list Metadata Synchronization.

OAI in DigiTool DigiTool Version 3.0.

CAA 10th Cross Calibration Workshop, Paris, France, 2-4th Nov CLUSTER / STAFF Action items C. Burlaud, P. Robert, M. Maksimovic, N. Cornilleau-Wehrlin,

2011 ILWS Science Workshop 28 Aug – 1 Sept Status of Cluster Active Archive (CAA) and Cluster Final Archive (CFA) Harri Laakso, Philippe Escoubet,

PIM Platform Free text search. When you type in the search field a suggestion tool helps you to find a concept from the ontology.

Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.

NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.

SOFIA Archiving Requirements for the SOFIA Data Cycle System Mark Morris, UCLA Joe Mazzarella & Steve Lord, IPAC John Milburn & Jochen Horn, UCLA.

09 May 2014page 1 ROCC to PPL ICD Initial Definition ExoMars Rover Operations Control Center ROCC.

7. German CDISC User Group Meeting Define.xml Generator ODM Validator (define.xml validation) 2010/03/11 Dimitri Kutsenko Marianne Neumann.

1 Introducing Reportnet Miruna Badescu. 2 A linear view of Reportnet process.

UIS EDEN Workflow Engine Overview of workflow engine for IU’s OneStart portal.

New logging and notification system for the Offline DropBox Martynas Mitrulevičius Thursday, 26 April 2012 AlCaDB/PdmV meeting Vilnius University, Lithuania.

NCSU Libraries Ingest Workflow Issues: Metadata North Carolina Geospatial Data Archiving Project Steve Morris North Carolina State University Libraries.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

FGM report 10 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Chris Carr, Tim Oddy, André Balogh I mperial College London November 2009.

© 2012 Avaya, Inc. All rights reserved, Page 1 Module Duration: Module 05: Handling Data in Bulk 3 Hours.

CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Development Status CAA/CFA Review ESTEC, May 19 th 2011 European Space AgencyAndrea Laruelo.

FGM report 9 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Paul French, Chris Carr, Tim Oddy, André Balogh I mperial College London March.

Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

1 San Diego’s Regional Planning Agency Regional Metadata Inventory Tool Presented at the San Diego Regional GIS Council meeting.

Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA User Support.

ARCSS Data Management Support Overview and Update James Moore Steve Williams NCAR Earth Observing Laboratory 3-5 October 2007.

1 AGRIDES Walk-through. 2 AGRIDES - File Content AGRIDES allows to upload one file per transaction:  File –Message 1 Document A –Message 2 Document B.

Microsoft Visual SourceSafe “(VSS) does not eliminate the need for discipline and coordination. It only makes discipline and coordination easier to live.

Create Content Capture Content Review Content Edit Content Version Content Version Content Translate Content Translate Content Format Content Transform.

CCSDS Meeting data Archive Ingest - June 2006 CNES 1 CCSDS - MOIMS Area Data Archive Ingest WG CNES Report Rome meeting – June 2006 Claude Huc.

CLUSTER/STAFF DATA at CAA. 11th Cross-Calibration Meeting, 7-9th April 2010, Goslar. C. Burlaud, P. Robert, O. Santolik, N. Cornilleau-Werhlin, P. Canu,

Central Data Repository introduction What does it do? Session I.

Developer Best Practices R.SANTHANA GOPALAN. Developer Best Practices What is Workspace ? The directory where the developer edit the source files, compile,

EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT collaborative.

The “application” Profile Type (draft-channabasappa-sipping-app-profile-type-01) Sumanth Channabasappa Josh Littlefield Salvatore Loreto 70th IETF, Vancouver,

Qtran Software Updates. Qtran Qtran Handles CAA Time Range data type (becomes 2 Epoch values in CDF) Single record of fill values written into empty.

1 Collaboration for Beijing and Tokyo GISC prototypes Akira Nakamori JMA ET-WISC-III Jun.2008.

CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.

Generating ADL Descriptions ADL Module for Together 6.x Massimo Marino Lawrence Berkeley National Laboratory.

An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop BGS, Edinburgh, June 2015.

An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop NOC, Liverpool, Sept 2015.

1 CAA 2009 Cross Cal 9, Jesus College, Cambridge, UK, March 2009 Caveats, Versions, Quality and Documentation Specification Chris Perry.

Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.

Unity Application Generator How Can I… Export variables of a Control module with all parameters, modify the some of the parameters like Initial values.

Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.

8th Cross-calibration Workshop CIS data delivery report Kinsale – October 2008.

Laboratoire de Physique des Plasmas 20 TH CAA CROSS-CAL M EETING CLUSTER-STAFF REPORT O CTOBER 2014 G ÖTTINGEN The STAFF Team Laboratoire de Physique.

WHISPER report whisper team 16th CAA Cross-Calibration workshop Toulouse, France, 7-8 November 2012 CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE Laboratoire.

Spacebel - Hoeilaart, February 2009 SPS Mandatory I/F Development Slide 1 HMA SPS Mandatory I/F Development HMA-T Phase 2 Acceptance Review 1 18.

Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.

8 th Cross-Calibration Workshop, Kinsale, Ireland, October 20081/14 Draft Replies and Actions to the Recommendations of the Review Panel for Final.

Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.

CAA inventory plots and graphical products overview Delphine Herment (ESTEC) ESAC - 17/03/2011.

20 th CAA Cross-Calibration Workshop MPS, Göttingen, Germany Oct CAA Dataset Inventory.

Instrument Teams to SOC Test Specifications

CAA Operational Review 9 Double Star PEACE Team Report

BI Share Quick reference guide.

Simulation Production System

Status Report of EDI on the CAA

Presented by Martine Deprez Head of Unit, EC - SG/A1 – Development and Advice Carine Smets Team Leader e-TrustEx Business – EC - SG/A1 – Development.

Ingest Processing Explained

ASPOC Presentation for the CAA Operations Review-1 Klaus Torkar and Harald Jeszenszky IWF/OAW Graz ESTEC, May 2006.

CAA-OR (End of Phase 1) CAA DWP Operations Review

Annual Report of the DWP Experiment 9th CAA Operations Review

Status Report of EDI on the CAA

Exploitation of ISS Scientific data - sustainability

CEF e-Invoicing Readiness Checker

What is it?. Using the Canard Question Module Editor to produce and publish DDI Metadata.

EXP file structure.

ESA/VO - European Space Astronomy Centre (ESAC)

Presentation transcript:

CAA/CFA Meeting | CFA Team | ESAC | Octiber CFA Under Development CAA/CFA Meeting ESAC, Oct 11 th 2011 European Space AgencyCFA Team

CAA/CFA Meeting | CFA Team | ESAC | Octiber Concatenation Tool - First version ready - Allows overlapping of files -Allowing detached headers? -Duplicated metadata (overlapping allowed)

CAA/CFA Meeting | CFA Team | ESAC | Octiber Concatenation Tool (II) -Duplicated metadata -Handling different cases: -Missing “include” sentence -“Include” within a “parameters” file -Metadata already present in the file

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD -Current version 0.3-  Defines the interfaces between the CAA and the SAT/CFA  Requirements pertaining to the transfer of data and metadata.  Two different phases: - Initial synchronization of CAA and CFA repositories - Regular transfer of new products

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD - New Available Data Notification - CAA to create and place in a proper directory an Ingestion Request File CFA to check ingestion request files directory To be defined: - Data levels to be transferred (File/Dataset/Mission…) -Ingestion Request File format -Ingestion Request Files directory CAA_FileListing_ log.12

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD - Ingestion Finished Notification - CAA to check ingestion result files directory CFA to create and place in a proper directory an Ingestion Result File Define: -Ingestion Results File format (name, content…) -Ingestion Results Files directory. This file gathers: -rsync issues -Possible ingestion failures

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD - Repository structure - CAA repository structure ICD /caa-cfa-p0/CFADROPZONE /DATA /EXP /YEAR /XML /EXP /YEAR /HEADERS ?? First products delivery rsync CFA repository structure -rsync keeps CAA structure -import module needs to know type of product without opening files

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD Metadata - Metadata Dictionary -  Delivered as:  Ceh  XML + ceh  XML only  Cef ( level) +XML

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD Metadata - CAA Internal Metadata -  Delivered as:  Detached XML containing only internal metadata + ceh for “dictionary”metadata  Detached XML containing both internal and “dictionary” metadata  Detached XML containing internal/”dictionary” metadata + ceh for “dictionary”metadata (redundant metadata, different keywords)  Cef ( level) +XML (files do not have detached headers)

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD - Missing headers -

CAA/CFA Meeting | CFA Team | ESAC | Octiber CAA-CFA ICD - Future deliveries - - Re-delivery of files - Redelivery of headers - Plots deliveries (QL as normal datasets) -Inventory plots (TBD) - Dataset  Documentation - User Profiles -More things to be defined?

CAA/CFA Meeting | CFA Team | ESAC | Octiber Questions ? → Suggestions