1. Near Real-Time Ocean Data Management An Implementation of Open Source Technologies and OGC Protocols Charlton Purvis, University of South Carolina, a SEACOOS partner

2. Near Real-Time Ocean Data Management SEACOOS was initiated in 2002 with ONR funding to develop a coastal ocean information system for FL, GA, SC and NC. SEACOOS Over-Arching Goal: To significantly increase the quantity and quality of environmental information from the coastal ocean of the SE U.S. and facilitate its use in a wide range of societal, scientific, and educational applications.

3. Near Real-Time Ocean Data Management Observational platforms contributed by SEACOOS partners Observational platforms contributed by SEACOOS partners

4. Near Real-Time Ocean Data Management SEACOOS modeling Coordinating model simulations for the entire region

5. Near Real-Time Ocean Data Management The (tiny) data management big picture

6. Near Real-Time Ocean Data Management

7. Laundry list of core technologies Base environment Base environment Linux Linux Apache Apache Perl & PHP Perl & PHP Mapping & imaging Mapping & imaging University of Minnesota’s MapServer University of Minnesota’s MapServer ImageMagick ImageMagick AniS & Gifsicle AniS & Gifsicle Gnuplot Gnuplot Data storage PostgreSQL PostGIS Filesystem

8. Near Real-Time Ocean Data Management Data aggregation & storage Aggregation format flavors Aggregation format flavors netCDF (in situ and remotely-sensed data) netCDF (in situ and remotely-sensed data) PNG (RS imagery) PNG (RS imagery) Storage Storage Relational database (in situ, model output, some RS) Relational database (in situ, model output, some RS) Files (RS imagery) Files (RS imagery) Technology Technology Perl Perl PostgreSQL & PostGIS PostgreSQL & PostGIS

9. Near Real-Time Ocean Data Management Normalization Reporting time varies Reporting time varies In-situ data In-situ data E.g. daily, hourly, half- hourly, every 10 minutes E.g. daily, hourly, half- hourly, every 10 minutes Remotely-sensed data Remotely-sensed data E.g. twice daily E.g. twice daily Technology Technology PostgreSQL & PostGIS PostgreSQL & PostGIS

10. Near Real-Time Ocean Data Management Visualization : interactive mapping Production site http://www.seacoos.org Production site http://www.seacoos.org Production site Production site Development site Development site Development site Development site Technology Technology MapServer MapServer ImageMagick ImageMagick Perl & PHP Perl & PHP

11. Near Real-Time Ocean Data Management Visualization : graphs & animations Ad-hoc time-series graphs Ad-hoc time-series graphs Ad-hoc animations Ad-hoc animations Ad-hoc animations Ad-hoc animations Technology : MapServer | ImageMagick Gnuplot | Gifsicle |AniS Technology : MapServer | ImageMagick Gnuplot | Gifsicle |AniS

12. Near Real-Time Ocean Data Management Dissemination (it is the technology) OPeNDAP (DODS) data access OPeNDAP (DODS) data access OGC-friendly: WMS, WFS OGC-friendly: WMS, WFS pick a layer, any layer http://nautilus.baruch.sc.edu/seacoos_misc/show_sea_coos_obs_time_ranges.php pick a layer, any layer http://nautilus.baruch.sc.edu/seacoos_misc/show_sea_coos_obs_time_ranges.php pick a layer, any layer pick a layer, any layer

13. Near Real-Time Ocean Data Management Dissemination : example 1 Integrated Ocean Observing System hurricane demo http://www.openioos.org Integrated Ocean Observing System hurricane demo http://www.openioos.org Integrated Ocean Observing System hurricane demo Integrated Ocean Observing System hurricane demo

14. Near Real-Time Ocean Data Management Dissemination : example 2 NC OneMap Viewer http://gisdata.usgs.net/ website/NC_OneMap/ viewer.asp NC OneMap Viewer http://gisdata.usgs.net/ website/NC_OneMap/ viewer.asp NC OneMap Viewer NC OneMap Viewer

15. Near Real-Time Ocean Data Management Open source : obstacles & sustenance Obstacles Obstacles Documentation Documentation Stereotypes in a commercialized world Stereotypes in a commercialized world Sustenance Sustenance Communication Communication Listservs and twikis Listservs and twikis Information sharing protocol standards Information sharing protocol standards OGC OGC

16. Near Real-Time Ocean Data Management OGC sustenance? Prove it! Log layer usage Log layer usage Log layer usage Log layer usage Example layer : MODIS RGB composite Example layer : MODIS RGB composite Available via SEACOOS interactive maps and WMS Available via SEACOOS interactive maps and WMS

17. Near Real-Time Ocean Data Management Layer usage logging MODIS RGB composite total hits = 652 MODIS RGB composite total hits = 652 Interactive map hits = 105 Interactive map hits = 105 WMS hits = 547 WMS hits = 547

18. Near Real-Time Ocean Data Management An open source attitude SEACOOS data management SEACOOS data management Direct result of combined effort from academia, government, and the private sector Direct result of combined effort from academia, government, and the private sector Providing the foundation for other ocean observing systems to adapt and build upon Providing the foundation for other ocean observing systems to adapt and build upon Plenty of miles to go with more room to grow! Plenty of miles to go with more room to grow! Who am I? Who am I? Charlton Purvis, University of South Carolina, SEACOOS Charlton Purvis, University of South Carolina, SEACOOS cpurvis@sc.edu cpurvis@sc.edu Happy to help and share. Happy to help and share.