Updating the existing advanced viewing services G. Santinelli G. Hendriksen Deltares

Index WPS Database Data products ingestion Web services Viewing services Additions Conclusions 7/4/2019

WPS database WP4.2. Performance of the services for visualisation of timeseries, profiles, timeprofiles; on retrieving the data from WPS database, but also with the interaction between Oceanbrowser (benchmarking). For uploading and further maintenance of the database of aggregated data Deltares has developed a number of scripts, would like to make them public, build an API for data queries. We need a staging process whereby the loading is first done, tested in another version of the database and added to the main production database with a new version. 7/4/2019

Data products ingestion Regional coordinators Ocean browser automated quality control, feedback & approval Geoserver + PyWPS ETL PostgreSQL/PostGIS BackOffice for final approval? 7/4/2019

Data products ingestion Current situation data model New additional table CDI id Local_cdi_id Edmo location observation id cdi_id Parameterid Datetime Depth value Obs-p01 Id observationid [P01] 1:n n:1 1:n parameter Id altlabel preflabel p35 7/4/2019

Data products ingestion A few recommendations In file formats (small errors) Inconsistent headers Parameters not available in BODC vocabs Changes in formats of ODV due to new version P01 terms next to P35 in ODV collections …Most ideal situation is to store P01 in the aggregated ODV collections and serve the P35 value to end-users. 7/4/2019

Web services API to easily query parts of the database is partly there and it has to be made public Generation of a WPS service that returns data in a certain format Test: http://emodnet02.cineca.it/wps?DataInputs=[mindatetime=2000-01-01T00:00:00.000Z;maxz=10;maxdatetime=2001-01-01T00:00:00.000Z;bbox=0,0,45,45;width=512;markersize=0.5;minz=0;p35=EPC00007]&service=wps&request=Execute&Identifier=observed_cindex&version=1.0.0 7/4/2019

Web services WPS returns a list of aggregated data products needed or selected, with link to catalogue for CDI Data Discovery and Access Service. It is depending on: Depth – limits Bbox Time – limits Parameter (P35) For the contaminants and eutrophication data: All of the above but… P01 7/4/2019

Viewing services EMODNET CHEMISTRY – PLOTS in the portal 7/4/2019

Viewing services Those can be run and configured from Oceanbrowser, and saved as image Options: 7/4/2019

Viewing services Show profiles, timeseries, timeprofiles Monthly statistics keep on being provided MATOMO has been added to the services for centralized counting. WPS and WMS Services are running in the cloud containerized environment and maintained. 7/4/2019

Additions / next steps Eutrophication Contaminants 7/4/2019

Additions / next steps With the Eutrophication and Contaminants datasets: Start over again with ‘clean slate’ of the database, build the data model only for the new upcoming collections; API for Web Services may have to change to take into account the new format and requirements A new data model that comprises CDI version index in the CDI table A new data model that comprises regional collection Version no., and Entry date and DOI Change ingestion functions to cater for new model and actual uploading of the data Building an API for data retrieval Tuning visualization services based on new model 7/4/2019

Conclusions Web Services are still up and running A list of recommendations have been given Data model accepting P01 has been prepared New collections are additions to the project 7/4/2019

Question? … 7/4/2019