OpenEarth OpenEarthTools = Open source management of Data, Models and Tools for marine & coastal science & technology.. and what about More information.

Slides:



Advertisements
Similar presentations
SubVersion SubVersion svn.oss.deltares.nl. workflow.
Advertisements

Datawarehouse Workflow: ETLP Extract Transform LoadProvide Make user- friendly formats Dynamic database Charts & Maps Tools & websites Archive native formats.
DataTools Models Data, models and tools: Dealing with any complex hydraulic engineering problem invariable use is made of: data, models and tools.
Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben.
Use of OpenEarthTools to make netCDF
Summary previous session 1 3 D:\ tools models add meta information netCDF on web server transform to netCDF netCDF on OPeNDAP server data.
YOU? OpenEarth PMR-NCV … OpenEarthTools = Open source management of
Data Portal for the “Climate changes Spatial Planning” program Henk Klein Baltink (KNMI) Fred Bosveld (KNMI) Hans de Wolf (Dutch Space)
Software to Manage EEP Vegetation Plot Data A design proposal Michael Lee January 31, 2011.
Copyright 2002 Prentice-Hall, Inc. Chapter 1 The Systems Development Environment 1.1 Modern Systems Analysis and Design Third Edition Jeffrey A. Hoffer.
An Object-Oriented Architecture Supporting Web Application Testing Presented By: Bhavdeep Singh.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Cyberinfrastructure Breakout Session Looking 5 years ahead... Broad themes that emerged: A) Calibration tools and skill assessment (MInt, as) B) More examples.
Data Warehouse Components
Data Standards Workflow Raw dataScriptsDatabase Store raw data in subversion to keep track of history Stored files (netcdf) accessible through the web.
workflow. SubVersion Version control Quality control: “Something adheres to some criteria” Without a properly defined something there.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
The Internetworked E-Business Enterprise
` Dutch Data Award for beta sciences 2012 Feb 27 th, Unesco-IHE SDI meeting Feb 28 th 2013, SRIE 2013.
Alfresco – An Open Source Content Management System - Bindu Nayar, Bhavana Mohanraj.
Linux Operations and Administration
Modelling information systems
Copyright 2002 Prentice-Hall, Inc. Chapter 1 The Systems Development Environment 1.1 Modern Systems Analysis and Design.
BIRT: general info and initial experience Katia Danilova 02/27/2008.
Why you should be using Version Control. Matt Krass Electrical/Software Engineer November 22, 2014.
Data management in the field Ari Haukijärvi 2nd EHES training seminar.
Keeping you Running Part I Experiences in Helping Local Governments Develop Cyber Security and Continuity Plans and Procedures Stan France & Mary Ball.
Managing Research Data – The Organisational Challenge at Oxford James A J Wilson Friday 6 th December,
Introduction to Versioning
Dream Report: Secure and Reliable Reporting Renee Sikes Applications Engineer Dream Report Brand Manager.
 Chapter 6 Architecture 1. What is Architecture?  Overall Structure of system  First Stage in Design process 2.
Configuration Management (CM)
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
A collaborative partnership between the State of Kansas Department of Revenue – Property Valuation Division (KDOR/PVD), the Kansas GIS Policy Board’s Data.
© 2007 by Prentice Hall 1 Introduction to databases.
Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.
Copyright 2002 Prentice-Hall, Inc. 1.1 Modern Systems Analysis and Design Jeffrey A. Hoffer Joey F. George Joseph S. Valacich Chapter 1 The Systems Development.
GIT version control. What is GIT Have you ever wished you could travel back in time when you develop a project…? Have you ever wished you could collaborate.
Alcatel-Lucent CDC Workshop, Coaching & Knowledge Transfer Coding.
QUICK START OF GITHUB Lin Shuo-Ren 2013/3/6 1. Why We Should Control The Version Although it rains, throw not away your watering pot. All changes should.
JWR 2 nd Dec 2013 wwww.OpenEarth.eu. OpenEarth is a workflow, and one free instance of that workflow Tools: internal + external: anything too small for.
MIS 105 LECTURE 1 INTRODUCTION TO COMPUTER HARDWARE CHAPTER REFERENCE- CHP. 1.
1 Yield Analysis and Increasing Engineering Efficiency Spotfire Users Conference 10/15/2003 William Pressnall, Scott Lacey.
Using Software-as-a-Service for tracking document delivery (& ILL) requests Perseus Rex Molina Cataloger Librarian Br. Fidelis Leddy Learning Resource.
Version Control System Lisa Palathingal 03/04/2015.
Copyright 2002 Prentice-Hall, Inc. Chapter 4 Automated Tools for Systems Development 4.1 Modern Systems Analysis and Design.
12 CVS Mauro Jaskelioff (originally by Gail Hopkins)
Oman College of Management and Technology Course – MM Topic 7 Production and Distribution of Multimedia Titles CS/MIS Department.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal at CERN Juraj Sucik Jarosław Polok.
From Missions to Measurements: an Ocean Discipline Experience.
CARBOOCEAN Data management and SOCAT Benjamin Pfeil, Are Olsen, Jeremy Malzcyk, Steve Hanhin, Alex Kozyr and many others Partner 16 WDC-MARE Partner 19.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Scripting Just Enough SSIS to be Dangerous. 6/13/2015 Visit the Sponsor tables to enter their end of day raffles. Turn in your completed Event Evaluation.
A S P. Outline  The introduction of ASP  Why we choose ASP  How ASP works  Basic syntax rule of ASP  ASP’S object model  Limitations of ASP  Summary.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
Simulation Production System
Chapter 1 The Systems Development Environment
Data Warehouse Components
CASE Tools and Joint and Rapid Application Development
Geographic Information System
EIN 6133 Enterprise Engineering
Chapter 1 The Systems Development Environment
A portal interface to myGrid workflow technology
Introduction to Systems Analysis and Design Stefano Moshi Memorial University College System Analysis & Design BIT
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
Data Management Components for a Research Data Archive
Chapter 1 The Systems Development Environment
Presentation transcript:

OpenEarth OpenEarthTools = Open source management of Data, Models and Tools for marine & coastal science & technology.. and what about More information at:

DataTools Models XBeach Information

SSB P 15 DataTools Models Information

Data quality, availability and accessibility for analysis is substandard Models and tools used and developed by specialists are insufficiently documented and often lack version control Developments to remedy the two above points are often hampered by the existence of (artificial) project boundaries Working like this is grossly inefficient We can do much better!! Although data, models, tools and information are the corner stones of hydraulic engineering projects: Introduction

Surely you recognize the following emotions? ohh, I used the wrong version ahh, where is the last version hmm, where was this measured oops, I forgot to include the timezone wow, you can actually show that in GoogleEarth? aarghh, the guy who measured it left? sigh, surely someone must have solved this problem before me! OpenEarth was started as a bottom up initiative by project engineers to break this apparent endless string of disappointment and frustration by introducing an open and project superseding approach. So how does it work? Introduction

Calculate missing (lat,lon) on the fly 1.PCTRANS marine: much ado with external files 2.General Mapping Toolbox: only *.eps on linux 3.arcGIS: $ 4.matlab mapping: $ 5.etc. 6.matlab CTRANSDV: Rijksdriehoek, UTM, LonLat Zitman > Verploeg > Bonekamp > Elias > de Boer > ? 7.OpenEarth SuperTrans Maarten van Ormondt (Deltares) GUI & matlab command line ~ 3000 EPSG transfomations free if you join OpenEarthTools >> [x,y]=ConvertCoordinates(5,52,EPSG,'WGS 84','geo','WGS 84 / UTM zone 31N','xy',...) Gradual improvement by cooperation Example: coordinate transformation What is OpenEarth?

What is OpenEarth 1.philosophy 2.community 3.repository 4.delivery (datawarehouse) Cooperate

What is OpenEarth 1.philosophy 2.community 3.repository 4.delivery (datawarehouse) Cooperate

1. PHILOSOPHY

Non-zero sum game: collaboration most efficient for everybody (more pie) Tit-for-tat is what people start using for cooperation People stop collaborating after 1 st bad experience Tiny % of free riders gradually destroys collaboration Tit-for-tat+1 approach would maintain collaboration Stop collaboration only after 2 nd bad experience. Noise in system: delays + misunderstandings + force majeure also gradually cooperativeness erodes. Tit-for-tat+many maintains collaboration Mutual trust Positive attitude Cooperative atmosphere Only 1 needed OET = car starter

2. COMMUNITY all collaborating is not enough chaos coordination needed but no overall boss like wikipedia Project nProject 1 DataTools Models Cooperate

central storage 3. REPOSITORY Cooperate 1.philosophy 2.community 3.repository 4.delivery

central storage 3. REPOSITORY check that out Cooperate 1.philosophy 2.community 3.repository 4.delivery

OpenEarth repository McTools repository Company repository 3. REPOSITORY

central storage 4. DELIVERY data providers data users 1.philosophy 2.community 3.repository 4.delivery

central storage 4. DELIVERY Cooperate data providers = data users 1.philosophy 2.community 3.repository 4.delivery

Summarizing: What is OpenEarth? In summary, OpenEarth is: A community of users … That cooperate on the philosophy … That all data, models, tools and information … Should flow openly To facilitate effective cooperation OpenEarth: Offers a free infrastructure composed of the best available open source components adhering to widely accepted international standards … Shares all data, models, tools and information provided by previous OpenEarth projects from one shared storage location … Provides training for users to gain the (minimum) skills to cooperate effectively Some more details about the OpenEarth infrastructure …

OPeNDAP Server Tools Models Subversion Server User Provider Pros: Easy Backup Version control: Shared access to … one central version Pros: Uniform workflow: More efficient collaboration Raw Data Pros: For NetCDF & OpenDAP: Free visualization tools Free ICT required Subversion server Linux (file) server OPeNDAP server For private use a OpenEarth clone costs: 20 k€ hardware (10TB) Few days of installation (training)

OpenEarth infrastructure: data, model output, … Extract Transform LoadProvide tools models add meta information netCDF on web server transform to netCDF netCDF on OPeNDAP server data providers = data users data (volts) Make user- friendly formats Dynamic database Charts & Maps Tools & websites Archive native formats

Every file is logged … … and every line in every file is logged. OpenEarth infrastructure: …, model code and tools

OpenEarth infrastructure: information

OpenEarth: regular training sessions

OpenEarth: successful application in projects And many others … Delft – USGS coop Delft Cluster North Sea and Coast Kustlijnzorg MoS 2 monitoring of SPM for MVII etc.

OpenEarth OpenEarthTools = Open source management of Data, Models and Tools for marine & coastal science & technology.. and what about More information at: