1. Ocean data dissemination
Jon Blower, University of Reading, UK
Steve Hankin, Bob Keeley, Sylvie Pouliquen, Jeff de la Beaujardière, Edward Vanden Berghe, Frédérique Blanc, Margarita Conkright Gregg, Janet Fredericks, Derrick Snowden
… and many others

2. Modern science demands the ability to integrate different data streams
Drivers
Modern science demands the ability to integrate different data streams
We need to exchange data between communities
These are the two key drivers that are motivating progress in data dissemination technologies.

3. Theme 1: Integrating data

4. How do we disseminate data?
Global Telecommunications
System (GTS)
The Internet
We have a few current methods of data dissemination. GTS and paper, although they each have strengths are not suitable on their own for satisfying the needs in the previous slide. The internet provides the most flexible platform for sharing ocean data.
Paper records

5. Standardize data formats Standardize metadata in its various forms
Consistency is key
Standardize data formats
Standardize metadata in its various forms
Hankin, Pouliquen, Gregg, Fredericks, Snowden, Blanc CWPs

6. Example: Ocean Biogeographic Information System (OBIS)
100,000 records viewed
or downloaded per day
18.5 million records
633 distinct datasets
105,000 species
Species richness
Potential
spread of
invasive
Species
(lionfish)
Integrates data formerly held in Excel/Access. Standardized on universal but simple data format (“DarwinCore”)
Top figure shows the locations of the OBIS nodes
Bottom figure shows scientific outputs: left is Hurlbert’s index, right is potential spread of invasive species
Shows value of aggregating multiple data sources
Largest provider of species distribution data – success is due to simplicity of entering data into the system
1 million hits per month
Vanden Berghe CWP

7. Internet dissemination: where we are now (mostly)

8. Plugging tools directly into data services?
Web Service
Web Service
Web Service
e.g. OPeNDAP
This is a key slide. In order to remove humans from the loop, we need to be able to plug tools into data services. Websites don’t do the job – they need a human to point and click. What we need are web services – these are for machines to exchange data with each other. OPeNDAP is a familiar web service to many oceanographers.
The web services wrap existing databases, providing a standard view on them. We can’t put all the data in the same place, due to size and need for autonomy

9. Example: intercomparison of distributed data
ECCO-JPL minus World Ocean Atlas
… with harmonized metadata and direct communication between machines. This example is from the ocean modelling community. This is a difference plot between two datasets, which are located in different places, managed by different people, and which use different numerical grids. Through the approaches described in the previous slides, scientists can produce plots like this with a few mouse clicks. This can also be turned into a script for further manipulation. All technical details of the dataset are hidden from the user, who can concentrate on the meaning of the data.
Ocean observations tend to be more heterogeneous and require much supporting information to interpret correctly. How can we achieve this success in the observations community?

10. Consistency is key
Standardize data formats
Standardize metadata in its various forms
Plug directly into data services
Create integrated catalogues
Streamline access control

11. Example: SeaDataNet Amazon-like discovery and delivery of data
Integrates different data sources
Single sign-on
Links to Ocean Data View
Amazon-like method of discovering and downloading data
Deliberately kept relatively low-tech to ensure scalability and success
Focussed on delayed-mode data
Data presented consistently, using consistent terms and file formats
Link to tools (Ocean Data View)

12. Theme 2: Linking communities
Our key technologies are not widely-used in many other communities
We need technologies that are common across communities
Geographic Information Systems provide a promising approach
Commonly used by policymakers, decision-makers and terrestrial science groups
(Side note: Many other communities do not need to see the full complexity of ocean data)

13. Ocean data and OpenGIS www.reading.ac.uk/godiva2
Ocean model data now available through Web Map Services, for easy visualization and for integration with other community GIS tools.
Currently hard for ocean observation data.
Also see NOAA’s Environmental Data Connector

14. Ocean Data Portal Reed CWP http://www.oceandataportal.org/
Developed through International Oceanographic Data and Information Exchange programme
Integrates data from National Ocean Data Centres
Uses OGC WMS and WFS
Reed CWP

15. Katrina storm track plus SST
Shows positions of Argo floats and sea ice extents (OSTIA). Animation shows very nicely the under-ice Argos, which get released when the ice recedes.

16. Google Ocean: reaching the public
Whole load of present and historical ocean data now available through Google Earth
Gives GIS capabilities
It’s a visualization platform, but can give links to data too (which must be loaded in another tool)
This can act as a tool for discovery and evaluation. Can also help other communities to understand ocean data (and vice-versa)

17. Combining all the above: Some large integrating efforts
WMO Information System (WIS)
Global Earth Observation
System of Systems (GEOSS)
INSPIRE

18. Some Challenges Balancing new and established technologies
Serving multiple user communities
Maintaining links between technical and user communities
Long-term funding for data systems
Overcoming social barriers to data sharing

19. Recommendations Converge on small number of file formats
Pursue GIS integration, but proceed step-by-step and demonstrate benefit of each step
Set up cross-community pilot projects
Invest in linking data systems with end user tools
Second bullet: it’s easy to try to make a system do too much, but really we don’t need the GIS technologies to do everything. There are strong pushes from GEOSS and INSPIRE
Third bullet: let’s find out what other communities really need from us to inform our technology choices