1. Updating the existing advanced viewing services
G. Santinelli
G. Hendriksen
Deltares

2. Index WPS Database Data products ingestion Web services
Viewing services
Additions
Conclusions
7/4/2019

3. WPS database
WP4.2. Performance of the services for visualisation of timeseries, profiles, timeprofiles; on retrieving the data from WPS database, but also with the interaction between Oceanbrowser (benchmarking).
For uploading and further maintenance of the database of aggregated data Deltares has developed a number of scripts, would like to make them public, build an API for data queries.
We need a staging process whereby the loading is first done, tested in another version of the database and added to the main production database with a new version.
7/4/2019

4. Data products ingestion
Regional coordinators
Ocean browser
automated quality control,
feedback & approval
Geoserver + PyWPS
ETL
PostgreSQL/PostGIS
BackOffice for final approval?
7/4/2019

5. Data products ingestion
Current situation data model
New additional table
CDI id
Local_cdi_id
Edmo
location
observation id
cdi_id
Parameterid
Datetime
Depth
value
Obs-p01 Id
observationid
[P01]
1:n
n:1
1:n
parameter Id
altlabel
preflabel
p35
7/4/2019

6. Data products ingestion
A few recommendations
In file formats (small errors)
Inconsistent headers
Parameters not available in BODC vocabs
Changes in formats of ODV due to new version
P01 terms next to P35 in ODV collections
…Most ideal situation is to store P01 in the aggregated ODV collections and serve the P35 value to end-users.
7/4/2019

7. Web services
API to easily query parts of the database is partly there and it has to be made public
Generation of a WPS service that returns data in a certain format
Test:
7/4/2019

8. Web services
WPS returns a list of aggregated data products needed or selected, with link to catalogue for CDI Data Discovery and Access Service. It is depending on:
Depth – limits
Bbox
Time – limits
Parameter (P35)
For the contaminants and eutrophication data:
All of the above but…
P01
7/4/2019

9. Viewing services
EMODNET CHEMISTRY – PLOTS in the portal
7/4/2019

10. Viewing services
Those can be run and configured from Oceanbrowser, and saved as image
Options:
7/4/2019

11. Viewing services Show profiles, timeseries, timeprofiles
Monthly statistics keep on being provided
MATOMO has been added to the services
for centralized counting.
WPS and WMS Services are running in the cloud containerized environment and maintained.
7/4/2019

12. Additions / next steps
Eutrophication
Contaminants
7/4/2019

13. Additions / next steps
With the Eutrophication and Contaminants datasets:
Start over again with ‘clean slate’ of the database, build the data model only for the new upcoming collections;
API for Web Services may have to change to take into account the new format and requirements
A new data model that comprises CDI version index in the CDI table
A new data model that comprises regional collection Version no., and Entry date and DOI
Change ingestion functions to cater for new model and actual uploading of the data
Building an API for data retrieval
Tuning visualization services based on new model
7/4/2019

14. Conclusions Web Services are still up and running
A list of recommendations have been given
Data model accepting P01 has been prepared
New collections are additions to the project
7/4/2019

15. Question? …
7/4/2019