` Dutch Data Award for beta sciences 2012 Feb 27 th, Unesco-IHE SDI meeting Feb 28 th 2013, SRIE 2013
Need for marine and coastal science/engineering for biobanking1.png suspended mud particle 64 μm 6400 km: North Atlantic Oscillation (NAO) gap > Water scarcity Flood protection Water pollution Marine/coastal scales
OpenEarth is a workflow philosophytechnology community
OpenEarth philosophy Open up & collaborate philosophy Non-zero sum game: = 3 Tragedy of the Commons OpenEarth wants to keep sharing going
OpenEarth philosophy Open up & collaborate community
OpenEarth philosophy Open up & collaborate all collaborating is not enough chaos coordination needed but no overall boss we need smooth workflow like wikipedia
OpenEarth philosophy technology Open up & collaborate check this out
OpenEarth community: social media & hands-on philosophytechnology community
LinkedIn group 269 members
Sprint sessions: hands-on outreach & feed-back every year prior to Netherlands Centrum voor Kustonderzoek (NCK) days
OpenEarth philosophy: universal principles philosophy Technology principles community
1) data & tools are one: database alone is useless raw data: volts counts + software data product = ESA/NASA raw satellite volts ESA/NASA useful product physical units
2) good enough to share, if good enough to publish transparency to combat sloppiness, mistakes & fraud. No standardization yet
3) Quality is a version control process Sharing will generate feed-back: version control becomes inevitable update your own work allow altered copies to proliferate Version control is common practice for ISO 9001: doc, xls, pdf Toyota Kaizen: keep on improving Software engineering: windows update … science is lacking behind anyway
OpenEarth technology: a pragmatic choice philosophyTechnology: an open software stack community
Off-The-Shelf (OTS) vs off-the-drawing board We seek an open source software stack that can serve our needs today. We do embrace new technology, but will not allow it to delay us from proper data management now.
Cloud technology: operational de facto web-standards tailored data > OGC WxS … > ISO SQL- PostGIS > OGC netCDF- CF OPeNDAP SubVersion … > OGC KML … … graphics of data standard data raw data catalogue of data work done on server work done on client what where when who why how … data URLs smart phone & tablet users scientists professionals
Subversion: version control on data and tools
# commits Time in quarters
Web services to data subsets: linking with DOI
All data in Google Earth: DataTube weather models 10 km resolution satellite data 1km resolution Dutch digital elevation maps 100 m resolution scale of interest: km/yr coastal bathymetry 10 m resolution dune profiles 1m resolution Proces scale: km/yrscale of interest: km/yr
Data scarcity > data abundance: data scientist most sexy job 21 st century ’s yrs:Empirical Archimedes ea ’s yrs:Theoretical Newton ea. 3.10’s yrs:Computational Neumann ea. 4.Now4 th paradigm by Microsoft Research Portal to filter: deal with complaints overwhelmed users
Questions