Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben J. de Boer
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Preview tailored data > WCS > WFS > SOS > SOAP > netCDF-CF- OPeNDAP > ISO SQL– PostGIS > SVN > GIT > http > ftp > KML > WMS > WFS > CSW graphics of data standard data raw data catalogue of data work done on server work done on client Exchange, develop standards spatio-temporal standards database standards (lab and field data) ISO standards what where when who why how … data URLs smart phone & tablet users scientists professionals
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE In relation with WP’s/ Tasks D4.3 D4.1 D4.5 T5.2 D4.8 D3.3 datamanagement Dissemination D4.8 D4.1 T5.2 D3.3 T5.1
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Techniques in data management Version control (SubVersion, GIT,…) OGC netCDF + OPeNDAP OGC CF Conventions OGC PostGIS GeoServer CSW ncWMS, ADAGUC Data & tools as-is via version control General purpose data storage: syntax standard Geospatial semantic standard Server side OGC tailoring & graphics Discovery meta-data catalog ISO SQL (PostgreSQL) geospatial semantics servlets ETL
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Data management systeem (DAS) modelling (DDS) (DAS) (DMS) Mobile applications Monitoring Network EO/RS EO/RS tools Version control DAS – Data Acquisition Sub- system DMS - Data Management Sub- system DDS - The Data Dissemination Sub-system Catalogue service
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Open source and - standards Software PostgreSQL Geoserver Geonetwork Mapnik (QGIS) Python OpenStreetMap OGC (exchange of data) Semantic vocubularies CF WORMS (PESI)
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Reason ?
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Quality assurance Vessel visualisation of location and speed of fish tracks carried out during monitoring. The red lines show deviation from the protocol (maximum speed between 5-10 km/hour). It seemed that this was due to input errors.
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Clear standards
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Clear standards
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE For FAST Data will be available on an opensource platform: –Scientists –Basis of dissemination- and calculation platform
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE First step in generalization Repository Web-based system for version control Allows a worldwide community of people to collaborate online Everyone (with proper credentials) can add/alter/remove and retrieve data Nothing can be added/altered/removed without being noticed Makes sure that changes are merged without conflicts Bear in mind, it is password controlled, so not fully open
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Frequently used commands Commit Checkout (sparse) Update Add/ Delete/ Modify Log
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Checkout (sparse) Create a local copy (only once) Checkout Depth (Windows) Fully recursive Immediate children, including folders Only file children Only this item svn checkout --depth (Command line) Infinity Immediates Files Empty
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Update Download: Server -> Local copy Note: update before working on a file!
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Commit Upload: Local copy –> server Always add a log message! Command line: svn commit -m”[insert log message]”
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Add/delete Svn add Used when a new file or folder is added to the repository, before committing. Otherwise, the file will only stay local Svn delete Used when a file or folder should be deleted. Otherwise, the file or folder is only deleted locally and will reappear at the following update
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Language: English (folder names, file names, code) Don’t use spaces in file/folder names, preferably no capitals Always add a log message (also in English) Update regularly! conventions
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE In practice Install subversion client –Tortoise ( Sparse checkout of the repository of you country Identify some data Commit data Checkout the data (mind the capitals) temporary username: oegast temporary password: 0terra Let’s do it!!!
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Meta-data for cataloguing: save *.xml Think about copyright and ownership already now! Think about life cycle after end of FAST: shift to library / Datacentre DOI
KICK-OFF MEETING. Delft, 9-11 April FP – SPACE OpenEarth wiki (openearth.eu)