GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) SECOORA Data Management Activities: Operational Status Report GCOOS DMAC Meeting Orlando, FL (23-24 February 2009)

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) SECOORA Organizational Chart Board of Directors Stakeholder Advisory Council Executive Director Board Development Committee Governance Committee Finance and Audit Committee Public Policy Committee Program Coordinator Info Mgmt Coordinator Spec. Project Coordinator Science Advisory Committee DMAC/ODP Committee Education/ Outreach Committee Ops. and Maintenance Committee DMCC Stakeholder Advisory Council Liaison

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) SECOORA’s Regional DM Approach and Roles GCOOS MACOORA National Backbone Coordinating Node Info Provider Node Nodes: USF/FWRI UNC-CH USC Sectors: Government, Academia, Private MACOORA and Domain National and Database GCOOS/CaRA and Data Synthesis

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) SECOORA DMCC Participants NameAffiliation Jeff Donovan(FL) USF Dan Ramage(SC) USC Melissa Ide(US) NERRS-CDMO Xiaoyan Qi(NC) UNC-W Ivelina Rodenbaugh(FL) FL Fish & Wildlife Jeremy Cothran(SC) USC Jesse Cleary(NC) UNC-CH Sara Haines(NC) UNC-CH Vembu Subramanian(FL) USF Chris Calloway(NC) UNC-CH Susanna King(SC) USC Dwayne Porter(SC) USC and NERRS Samuel Walker(SC) SECOORA Madilyn Fletcher*(SC) ODP and USC Carroll Hood*(CO) Raytheon, Inc. NameAffiliation Lynn Leonard(NC) UNC-W Jennifer Dorton(NC) UNC-W Virgil Zetterlind(FL) EarthNC, Inc. Peter Sheng*(FL) University of Florida Brock Murch(FL) USF/IMaRS Chuanmin Hu(FL) USF/IMaRS Harvey Seim(NC) UNC-CH Steve Browdy(FL) OMS Tech, Inc. Charlton Galvarino(SC) Second Creek, LLC Debra Hernandez(SC) SECOORA Trent Moore(GA) SKIO Kathleen O’Keife(FL) FL Fish & Wildlife Scott Cross(US) NCDDC Tammy Small(US) NERRS-CDMO Justin Davis(FL) University of Florida DMAC-ODP Committee Members: Carroll Hood,* Madilyn Fletcher,* Peter Sheng,* Dwayne Porter, Lynn Leonard, Ken Galluppi, Wade Sheldon, Keqi Zhang, Kathleen O’Keife (* Committee Co-Chairs)

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) DMAC-ODP Committee: Project Oversight StateFunds ($400K)PercentageAwardees GA$50, %SKIO FL$154, %UM, USF-IMaRS, USF-CMS, FWRI SC$69, %USC NC$125, %UNC-CH, UNC-W Includes both Data Management and Radar allocations (Total: $400K)

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Example SECOORA DM/IM Partners

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Regional and National Expectations Address Property / Data Ownership Issues Establish Data Liability Disclaimer Ongoing Metrics for NOAA and OMB Reporting Long-Term Funding Support Maintain Operational Transparency Promote Use of Web Site for Activities/Exchanges –(e.g., don’t send attachments) User-Defined Project Identification/Design Scalability and Performance Testing (Ongoing Evaluation) –(e.g., Load Testing and Allocation) Increase Support of Modeling and Proposal-Writing Activities

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Success Stories for SECOORA DMAC Many In-Kind Contributions (FWRI, USC, USF, Sea Grant, etc.) Substantial HW/SW Investments and Hubs Formal DMAC Design and Implementation Plan Collaborative Approach within Southeast and Beyond Numerous Legacy Projects to Leverage Some Funding Success and Support within RA Leadership Actual Data Streams to Manage Formal DMAC Structure within Organization: –Board of Directors Executive Director –DMAC-ODP Program Committee »Data Management Coordinating Committee (DMCC)

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) DMAC-ODP: Regional Contributions to IOOS Database schema, QA/QC protocols, web services, DIF Identify regional DMAC activities where efficiency can be gained through direct collaboration or shared resources Continued activities relating to national standards and data interoperability National Operations Plan Reviews (Waves, DMAC, HF Radar) Documentation of existing products/services; Inventories Collaboration with other RAs (GCOOS and CaRA) –DM processes –Remote sensing efforts –Training and application development overlap

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Data Access, Management, and Integration

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) DMAC Technical Requirements Process Formal request (internal or external) to goes to DMAC- ODP Committee Priorities established and then passed to DMCC for technical requirements evaluation Joint meeting for reporting of requirements and identification of necessary resources Review for IOOS and/or GEOSS Compliance Task assignments and timeline established Activity executed and documented

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) DMCC Communication Strategies StrategyIssue Face-to-FaceKey objectives/vision Phone/Web Conf.Specific task assignments TRAC TaskingProject management; daily SVNVersion control; daily IRCProgrammer’s forum; daily General correspondence

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Progress and Ongoing Activities

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Data Integration Activities – Regional DM Partners: –DM Hubs (Strategic Plan; FL/SC/NC) –Remote Sensing Support (IMaRS) GCOOS / SECOORA / NASA – All providing support –QA/QC Protocols (SkIO) –User-Defined Applications (UNC-W) –Integration (USF-CMS) –Biological Data Integration (FWRI) –Communication (UNC-CH) –Database (USC) –Inventories (DMCC) Sensors/DM Assets/Data Resources EXAMPLE: SECOORA and RENCI –Joint evaluation of a SECOORA data model (Xenia) –Strong regional partner w/ substantial resources –Potential to build relationship (modeling/testing)

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Data Integration Activities – Xenia DB Data Portal OpenLayers Mapping Applications Xenia Relation Database Table Schema Main tables used for storing: organization->platform->sensor->observation data

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Data Integration Activities – netCDF Being Submitted for National-Level Standards Approval SECOORA netCDF Convention and Data Dictionary

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Near Real-Time (NRT) Data Feeds Data Portal OpenLayers Mapping Applications

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) NRT Data – Interactive Mapping OpenLayers Mapping Applications

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) NRT Applications - New Developments ObsKML-Based Mapping Applications

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Static Observational Data Resources Data Portal Pre-Formatted Files

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Archived Data Products/Resources Existing Archives and “Timed-Out” Data Streams

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Operational Components - Inventories Sensor Resources Inventory Benefits of Inventories: Being reported daily/weekly/annually Reporting on Stability/Reliability Resource for Proposal Writing Resource for Data Requests Recommended Manufacturer Enables Notification Mechanisms Improves Transparency Improves Visibility/Marketability Proposed Inventories: Sensors / Platforms DM Infrastructure / Software Data / Information Resources Budgets / Other Resources

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Operational Components - Status On-Line (Beta) Sensor Status Monitoring/Reporting

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Operational Components - Hubs Three DM Hubs: FL: USF- IMaRS/CMS;FWRI NC: UNC-CH SC: USC-Columbia Ideal Instance Described: Hardware Software Services Redundancy Efficiency

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Google Analytics Web and File Access Reports Status Monitoring/Reporting On-Line Sensor Status

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Example Link to DM Partners: National Regionally Relevant Observations from NERRS-CDMO

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Example Link to DM Partners: Regional Regionally Relevant Observations from CaroCOOPS

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Example User-Defined Applications Marine Weather Portal (UNC-W) –Broker/Partner: National Weather Service – Harbor View (GLOS) –Broker/Partner: Wisconsin Sea Grant – Hawaii Beach Safety (UHI) –Broker/Partner: HiOOS, HI Tourism Authority, HI Dept. of Health, Lifeguards – Define for each Project: broker, costs, data needs/sources, interface design, key partners, relevant societal goal, feedback from users, outcomes, stakeholders, value.

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) User-Defined Application: Radar/S&R Integration Broker: SECOORA Costs: ? Data Needs/Sources: Radar coverage; USCG incident locations Interface Design: OpenLayers Key Partners: Radar operators/USCG Relevant Societal Goal: Hazard mitigation and safe marine operations Feedback Mechanism: ? Outcomes: Web mapping application; help determine placement of systems Stakeholders: Radar operators; regional decision makers Value: Help determine radar placement and promote use of HF radar network Applications are a critical mechanism to publicizing the value of IOOS and DMAC

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Ocean Data Partnership

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Ocean Data Partnership (ODP) Status Evolution and Approach (M. Fletcher, ODP Chair) Example ODP Opportunities (S. Walker) AOML – Water quality; Expanded drifters; RS data FWRI – MARVIN and GAME data sets FAU – Ocean energy sensors GCRC – Water quality measurements Long Bay Focus Group – Water quality; model output COSEE-SE BOB/FLO Participants – TBD IMaRS – Remote Sensing NERRS – MET/WQ data and QA/QC protocols

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) National Review and Status

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) National RA Review/Status Workshop (Summary) DM/IM was a dominant and consistent theme User-defined applications are increasing Budget conditions remain unstable Quantifiable metrics are increasingly important Collaborations were often keys to success Google Earth and Google Analytics NOAA-IOOS DIF Implementation

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) Remaining Challenges for DMAC Operations Addressing Property / Data Ownership Concerns Reconciling/Aligning Fractional Time Allocations Balancing Regional Realities with National Progress/Expectations Acquiring Long-Term Funding Maintaining Operational Transparency Promote Use of Web Site for Activities/Exchanges –(e.g., don’t send attachments) User-Defined Project Identification/Design Scalability and Performance Testing (Ongoing Evaluation) Increased Support of Modeling and Proposal-Writing Activities Diverse Regional User/Sector Requirements

GCOOS DMAC Meeting Orlando, FL (23-24 Feb 2009) The Biggest Challenge: “Vembued” (Again)