DWD GISC Node Current Status

Agenda Welcome Current status: Overview based on functional blocks High Level Architecture Web Interface DAR Component Catalogue systems, Metadata and identified issues GISC-to-GISC communication Experience with Blog solution and AFD Schema for GISC backup scenario Data Components MSS, AFD and subscription management Topics for further collaborations Q&A DWD GISC Node - Current Status

High level architecture: Functional blocks Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Gray List Container WMO GISC-GISC Interface Delivery tools Moving Weather AFD controller Datapool(s) controller/manager access adapter data sources Input Management Receiver External DCPC Web functions Frontend Web services (interfaces) Web services (core) Business logic DAR component controller/manager catalogue editor DAR-Generator/Importer DWD GISC Node - Current Status

HLA: Web Interface (User/Admin/Customer) Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Gray List Container WMO GISC-GISC Interface Delivery tools Moving Weather AFD controller Datapool(s) controller/manager access adapter data sources Input Management Receiver External DCPC DAR component controller/manager catalogue editor Web functions Frontend Web services (interfaces) Web services (core) Business logic DAR-Generator/Importer DWD GISC Node - Current Status

HLA: Web Interface (User/Admin/Customer) WebWerdis Redesign of WebWerdis Navigation structure / search functions Internationalization Integrate logging framework (necessary for monitoring) Code clean-up Integration with Geonetwork Geonetwork Customization of GUI DWD GISC Node - Current Status

High level architecture: Metadata Management Logging, Monitoring and Reporting Authorisation/Authentication services DAR-Generator/Importer Subscription Management Datapool(s) controller/manager access adapter data sources DAR component catalogue editor Gray List Container Receiver WMO GISC-GISC Interface Delivery tools Moving Weather AFD controller Input Management External DCPC Web functions Frontend Web services (interfaces) Web services (core) Business logic DWD GISC Node - Current Status

High level architecture: Metadata Management DAR Catalogue Did extensively Performance Tests (Geonetwork 2.2, terraCatalog 2.3) DWD formulated test cases Contracted external partner for tests Functional Tests DAR Generator / Importer Developed DAR metadata generator (template driven architecture) External review of DAR metadata Prototype DAR importer Issues we identified during our work Tested DAR catalogues fulfilled most, but not all INSPIRE and WMO requirements DAR Metadata Paper with Request for Clarification (JMA, CMA and DWD) Schematron rules for validating WMO profile would be very helpful DWD GISC Node - Current Status

High level architecture: Metadata Management Metadata Harvesting CMA and DWD did several functional tests with OAI-PMH in 09/09 Different implementations of OAI-PMH could not harvest each other Deleted metadata records: different implementations Standard vanilla implementations modify harvested metadata Ongoing tests between CMA and DWD Started January 2010 Initial tests showed 1 record ~ 1 second  space for improvement Backup strategy Exchange of metadata files as products DWD GISC Node - Current Status

High level architecture: G2G communication Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Gray List Container WMO GISC-GISC Interface Delivery tools Moving Weather AFD controller Datapool(s) controller/manager access adapter data sources Input Management Receiver External DCPC Web functions Frontend Web services (interfaces) Web services (core) Business logic DAR component controller/manager catalogue editor DAR-Generator/Importer DWD GISC Node - Current Status

HLA: GISC-to-GISC communication Collaboration CMA and DWD Memorandum of Understanding signed end of last year Two Workshops held GISC-to-GISC communication tests with CMA CMA and DWD installed Blog solution and AFD solution Data sets with appropriated time profile (issue warning during model transfer) Blog solution CMA and DWD did several improvements on publishing and polling components Usage of tar minimize latency of transfer Necessary to include size of “metadata” (AtomFeed) into calculation of transfer volume Identified several further improvements like prioritization, AtomFeed handling, logging JMA has provided a new improved solution in 10/2009 AFD solution Average transport time between 4-5 sec during 24hour continuously test, warnings between 3-4 sec In case of unsecured connection sometimes corrupted data occur DWD GISC Node - Current Status

HLA: GISC-to-GISC communication backup Technical specification requires a bilateral agreement from 2 GISC for a backup scenario CMA and DWD prepared proposal for priorities in DAR metadata First common draft of dissemination metadata (XML schema) Need to prove in practice DWD GISC Node - Current Status

High level architecture: Delivery components Logging, Monitoring and Reporting Authorisation/Authentication services Subscription Management Datapool(s) controller/manager access adapter data sources Delivery tools Moving Weather AFD controller Gray List Container WMO GISC-GISC Interface Input Management Receiver External DCPC Web functions Frontend Web services (interfaces) Web services (core) Business logic DAR component controller/manager catalogue editor DAR-Generator/Importer DWD GISC Node - Current Status

High level architecture: Delivery components Message Switching System REST Web-Service to manage and control Moving Weather First proposal for generic Interface Integration into WebWerdis (still under work) AFD Web-Service to manage and control AFD (in consideration) Manage AtomFeed (in consideration) Subscription Management Controller: time and event triggered management (still under work) Customization according to GISC-to-GISC backup necessary DWD GISC Node - Current Status

Q&A DWD GISC Node - Current Status