Data Standards Workflow Raw dataScriptsDatabase Store raw data in subversion to keep track of history Stored files (netcdf) accessible through the web Extract Transform Load Charts & Maps Tools and websites Provide Add meta information Script to convert raw data into netcdf OpenEarth RawData OpenEarth OPeNDAP OpenEarth Tools
Data Standards Workflow Raw dataScriptsDatabase Store raw data in subversion to keep track of history Stored files (netcdf) accessible through the web Extract Transform Load Charts & Maps Tools and websites Provide Add meta information Script to convert raw data into netcdf OpenEarth RawData OpenEarth OPeNDAP OpenEarth Tools
Extract subversion storing raw data
Subversion Remote file server Work on local copy Track changes Subversion server Local copy checkout update commit Delete Add Copy Extract Procedure
Subversion server Local copy checkout update commit Delete Add Copy Procedure: check out Extract – storing raw data
Checkout the directory (i.e. create local copy) Right mouse click (RMC) for Tortoise menu D:\data\micore Extract – storing raw data Procedure: check out
Subversion server Local copy checkout update commit Delete Add Copy Procedure: add Extract – storing raw data
Add a directory for your data branches/ tags/ trunk/ organization/ datasetname cache/ raw/ scripts/ inspire_description.xml course Pc number/ cache/ raw/ transect.txt scripts/ inspire_description.xml Allows for use of authorization We’re working under course today. Add your pc directory You can store your data here, after the course We’ll make this file later Get this file from: OpenEarthRawData\course\example\raw Extract – storing raw data
Add the pcname directory to your local subversion copy Extract – storing raw data Procedure: add
Subversion server Local copy checkout update commit Delete Add Copy Procedure: commit Extract – storing raw data
RMC for Tortoise menu Commit your local changes. Changes will be sent to server. Some useful message here Extract – storing raw data Procedure: commit
Subversion Remote file server Work on local copy Track changes Subversion server Local copy checkout update commit Delete Add Copy Extract - summary Procedure