Kick-off meeting Delft, April 9-11 2014 7FP – SPACE no. 607131 Data Fast First step in data management – repository Gerrit Hendriksen Gerben.

Slides:



Advertisements
Similar presentations
TortoiseSVN By Group 1 Team B. Installing TortoiseSVN.
Advertisements

SubVersion SubVersion svn.oss.deltares.nl. workflow.
Intro to Version Control Have you ever …? Had an application crash and lose ALL of your work Made changes to a file for the worse and wished you could.
Ravi Mathur Updated December 5,  ODTBX uses Git (see the ODTBX Git Tutorial) ODTBXODTBX Git Tutorial ◦ SourceForge account needed (free). SourceForge.
Datawarehouse Workflow: ETLP Extract Transform LoadProvide Make user- friendly formats Dynamic database Charts & Maps Tools & websites Archive native formats.
 Please sit next to your partner.  If you don’t have a partner, please find one now.
DataTools Models Data, models and tools: Dealing with any complex hydraulic engineering problem invariable use is made of: data, models and tools.
1. What is Subversion? Why do we need CM? Basic concepts Repositories Options Setup Clients Options Setup Operation Troubleshooting Slide 2.
Version Control System (Sub)Version Control (SVN).
Standard data raw data catalogue of data ISO SQL: postgresql GIT SubVersion VECTOR DATA OGC CSW: CATALOGUE: geonetworks, ckan, … OGC NETCDF: OPENDAP thredds.
Version Control System Sui Huang, McMaster University Version Control SystemSui Huang, McMaster University Version Control System -- base on Subversion.
Dedi Rahmawan Putra  Shared Document  Conventional Ways  Common Problems  What is TortoiseSVN  Advantages over another tools  Basic Concepts.
David Notkin Autumn 2009 CSE303 Lecture 22 Subversion is an open source version control system. Social Implications Friday version control system.
Using subversion COMP 2400 Prof. Chris GauthierDickey.
Using svn and git with Unity and sdk
SubVersioN – the new Central Service at DESY by Marian Gawron.
workflow. SubVersion Version control Quality control: “Something adheres to some criteria” Without a properly defined something there.
Version Control. What is Version Control? Manages file sharing for Concurrent Development Keeps track of changes with Version Control SubVersion (SVN)
Open Earth Team, Deltares Data sharing Sharing data, tools and thoughts A brief overview of possibilities recently conducted by Deltares.
Git for Version Control These slides are heavily based on slides created by Ruth Anderson for CSE 390a. Thanks, Ruth! images taken from
Version Control with Subversion. What is Version Control Good For? Maintaining project/file history - so you don’t have to worry about it Managing collaboration.
` Dutch Data Award for beta sciences 2012 Feb 27 th, Unesco-IHE SDI meeting Feb 28 th 2013, SRIE 2013.
Subversion. What is Subversion? A Version Control System A successor to CVS and SourceSafe Essentially gives you a tracked, shared file system.
علیرضا فراهانی استاد درس: جعفری نژاد مهر Version Control ▪Version control is a system that records changes to a file or set of files over time so.
The Design Workshop Introduction to Version Control 1.
Web Page Design I Basic Computer Terms “How the Internet & the World Wide Web (www) Works”
Subversion Code Deployment LifeCycle August 2011.
Instant Messaging for the Workplace A pure collaborative communication tool that does not distract users from their normal activities.
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
Subversion (SVN) Tutorial Source:
…using Git/Tortoise Git
Object-Oriented Analysis & Design Subversion. Contents  Configuration management  The repository  Versioning  Tags  Branches  Subversion 2.
Version Control Systems with Subversion (SVN) and Tortoise.
Version Control Menggunakan TortoiseSVN
(Sub)Version Control. 2 Keep large teams working on the same code Back up your work so you don't lose it all Compare changes to previous versions Revert.
Subversion (SVN) A Revision Control System Successor to CVS Carlos Armas Hervey Allen.
SENG 403 Tutorial 1 1SENG 403 – Winter Agenda Version Control Basics Subversion Basic actions in Subversion Some examples 2SENG 403 – Winter 2012.
DireXions – Your Tool Box just got Bigger PxPlus Version Control System Using TortoiseSVN Presented by: Jane Raymond.
` Dutch Data Award for beta sciences March 26 NCG.
NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
Tailored data graphics of data standard data raw data catalogue of data what where when who why how … data URLs smart phone & tablet users scientists professionals.
Version Control with SVN Images from TortoiseSVN documentation
1 GIT NOUN \’GIT\ A DISTRIBUTED REVISION CONTROL AND SOURCE CODE MANAGEMENT (SCM) SYSTEM WITH AN EMPHASIS ON SPEED. INITIALLY DESIGNED AND DEVELOPED BY.
Copyright © Curt Hill Tortoise SVN A Subversion Client.
When collaborating, it is important to manage changes in the models. For example: –To create or edit a submodel E.g. Habitat suitability is replaced with.
Intro to Git presented by Brian K. Vagnini Hosted by.
L.T.E :: Learning Through Experimenting Using google-svn for MtM Docs Development Denis Thibault Version 3.2 Mar 12 th, 2009.
Sabriansyah R.A Version Control. The Repository Subversion adalah sistem tersentralisasi untuk informasi sharing Repository adalah pusat penyimpanan data.
Engineering Projects In Community Service Matt Mooney Community Based Research University of Notre Dame.
1 CSE 303 Lecture 19 Version control and Subversion ( svn ) slides created by Marty Stepp
(1) Introduction to Subversion (SVN) and Google Project Hosting Philip Johnson Collaborative Software Development Laboratory Information and Computer Sciences.
What was done for AR4. Software developed for ESG was modified for CMIP3 (IPCC AR4) Prerelease ESG version 1.0 Modified data search Advance search Pydap.
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
© CGI Group Inc. User Guide Subversion client TortoiseSVN.
GIT Version control. Version Control Sharing code via a centralized DB Also provides for Backtracking (going back to a previous version of code), Branching.
Source Control Dr. Scott Schaefer. Version Control Systems Allow for maintenance and archiving of multiple versions of code / other files Designed for.
Subversion (svn) Basics Department of Computer Science Kent State University Prof. Jonathan I. Maletic.
Subversion Subversion is a brand of version control software that is frequently used to store the code and documentation of a project so as to permit.
Concurrent Versions System User guide for CS408
SVN intro (review).
Version Control.
Source Control Dr. Scott Schaefer.
catalogue of data information graphics of data processing of data
Services Course 9/9/2018 3:37 PM Services Course Windows Live SkyDrive Participant Guide © 2008 Microsoft Corporation. All rights reserved.
Concurrent Version Control
Dutch Data Award for beta sciences 2012
slides borrowed and adapted from Alex Mariakis and CSE 390a
WEB API.
User Guide Subversion client TortoiseSVN
Subversion Basics Guide
Presentation transcript:

Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben J. de Boer

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Preview tailored data > WCS > WFS > SOS > SOAP > netCDF-CF- OPeNDAP > ISO SQL– PostGIS > SVN > GIT > http > ftp > KML > WMS > WFS > CSW graphics of data standard data raw data catalogue of data work done on server work done on client Exchange, develop standards spatio-temporal standards database standards (lab and field data) ISO standards what where when who why how … data URLs smart phone & tablet users scientists professionals

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE In relation with WP’s/ Tasks D4.3 D4.1 D4.5 T5.2 D4.8 D3.3 datamanagement Dissemination D4.8 D4.1 T5.2 D3.3 T5.1

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Techniques in data management Version control (SubVersion, GIT,…) OGC netCDF + OPeNDAP OGC CF Conventions OGC PostGIS GeoServer CSW ncWMS, ADAGUC Data & tools as-is via version control General purpose data storage: syntax standard Geospatial semantic standard Server side OGC tailoring & graphics Discovery meta-data catalog ISO SQL (PostgreSQL) geospatial semantics servlets ETL

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Data management systeem (DAS) modelling (DDS) (DAS) (DMS) Mobile applications Monitoring Network EO/RS EO/RS tools Version control DAS – Data Acquisition Sub- system DMS - Data Management Sub- system DDS - The Data Dissemination Sub-system Catalogue service

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Open source and - standards Software PostgreSQL Geoserver Geonetwork Mapnik (QGIS) Python OpenStreetMap OGC (exchange of data) Semantic vocubularies CF WORMS (PESI)

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Reason ?

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Quality assurance Vessel visualisation of location and speed of fish tracks carried out during monitoring. The red lines show deviation from the protocol (maximum speed between 5-10 km/hour). It seemed that this was due to input errors.

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Clear standards

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Clear standards

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE For FAST Data will be available on an opensource platform: –Scientists –Basis of dissemination- and calculation platform

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE First step in generalization Repository Web-based system for version control Allows a worldwide community of people to collaborate online Everyone (with proper credentials) can add/alter/remove and retrieve data Nothing can be added/altered/removed without being noticed Makes sure that changes are merged without conflicts Bear in mind, it is password controlled, so not fully open

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Frequently used commands Commit Checkout (sparse) Update Add/ Delete/ Modify Log

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Checkout (sparse) Create a local copy (only once) Checkout Depth (Windows) Fully recursive Immediate children, including folders Only file children Only this item svn checkout --depth (Command line) Infinity Immediates Files Empty

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Update Download: Server -> Local copy Note: update before working on a file!

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Commit Upload: Local copy –> server Always add a log message! Command line: svn commit -m”[insert log message]”

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Add/delete Svn add Used when a new file or folder is added to the repository, before committing. Otherwise, the file will only stay local Svn delete Used when a file or folder should be deleted. Otherwise, the file or folder is only deleted locally and will reappear at the following update

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Language: English (folder names, file names, code) Don’t use spaces in file/folder names, preferably no capitals Always add a log message (also in English) Update regularly! conventions

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE In practice Install subversion client –Tortoise ( Sparse checkout of the repository of you country Identify some data Commit data Checkout the data (mind the capitals) temporary username: oegast temporary password: 0terra Let’s do it!!!

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE Meta-data for cataloguing: save *.xml Think about copyright and ownership already now! Think about life cycle after end of FAST: shift to library / Datacentre DOI

KICK-OFF MEETING. Delft, 9-11 April FP – SPACE OpenEarth wiki (openearth.eu)