OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

1 IOOS Status of Planning & Implementation Background –Milestones Implementation Plan, Part I –Governance of the IOOS Implementation Plan, Part II –The.

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

Progress Towards a Regional Coastal Ocean Observing System for the Southeast (SEACOOS) Harvey Seim / University of North Carolina at Chapel Hill University.

System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.

Ocean Observatories Initiative OOI Cyberinfrastructure Life Cycle Objectives Review January 8-9, 2013 Analysis and Synthesis (AS): Modeling 1 Designer:

Data Interoperability and Access Activities Prepared for the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald, TPIO/GEO-IDE Jeff.

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Observing System Monitoring Center Integrating data and information across observing system networks.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Concepts of Operations John Graybeal Life Cycle Architecture Review La Jolla, CA.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Instrument and Platform Agent Architecture (IPAA) Steve Foley Life Cycle Architecture Review.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Common Execution Environment Kate Keahey, Tim Freeman, Alex Clemesha, John Bresnahan, David.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew

OOI-CI & IOOS-DMAC Intersection Project FY2010. OOI Overview.

Glider data (*.*bd files) via Iridium or rsync from WHOI, Umaine or UMaryland Disk NetCDF/Acquire WMO ID IOOS Glider DAC ERDDAP OPeNDAP sequence or download.geoJson,.json.nc,.ncCF,.ncCFMA.csv,.tsv,

Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Instrument and Platform Agent Architecture (IPAA) Steve Foley, David Everett Life Cycle Architecture.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Instrument and Platform Agent Architecture (IPAA) Steve Foley, David Everett Life Cycle Objective.

Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Construction Plan John Graybeal Life Cycle Architecture Review La Jolla, CA.

OOI CI EOI LCA REVIEW December 13, 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller Life Cycle Architecture Review.

Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger September 29, 2009.

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.

IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Common Operating Infrastructure Subsystem Michael Meisinger Life Cycle.

Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.

OOI CyberInfrastructure Workshop: Ocean Observation Programs Preparation Phone Meeting May 5, 2008 Alan Chave, Michael Meisinger OOI CI System Engineering.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Assessment John Graybeal, Michael Meisinger Life Cycle.

OOI CyberInfrastructure: Data Management Architecture Specification Workshop June 30-July 1, 2008 Matthew Arrott, Ingolf Krueger, Claudiu Farcas, Emilia.

Ocean Observatories Initiative OOI Cyberinfrastructure Overview Matthew Arrott VMware Presentation March 5, 2010.

Bob Keeley Marine Environmental Data Service Dept. of Fisheries and Oceans Ottawa, Canada Jun, 2006 SeaDataNet Meeting.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Common Operating Infrastructure Subsystem Michael Meisinger, Brian.

User Working Group 2013 Data Access Mechanisms – Status 12 March 2013

OOI CI A&S (modeling) Yi Chao )

Ocean Observatories Initiative OOI Cyberinfrastructure Data Management Michael Meisinger & David Stuebe OOI Cyberinfrastructure Life Cycle Objectives Milestone.

IOOS Regional Data Management Workshop April 27 & 28, 2011 Silver Spring, MD COLLABORATION TO DATE Charles Alexander 1, Jeff de La Beaujardière 1, Arthur.

1 of 37 Next Steps SOS DescribeSensor implementation (SensorML) Testing/evaluation/refinement of existing work Build or borrow needed components … Reference.

Jeff de La Beaujardière, PhD NOAA Sr System Architect, IOOS Program Office DAARWG Meeting Silver Spring, Integrated Ocean Observing System (IOOS)

NSF ANNUAL REVIEW June 2010 Ocean Observatories Initiative Matthew Arrott August Release 1 Life Cycle Architecture Review CI Project Status.

Ocean Observatories Initiative Risk Management & Interface Management Jack Kleinert OOI Cyberinfrastructure Life Cycle Objectives Milestone Review, Release.

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

OOI Cyberinfrastructure and Semantics OOI CI Architecture & Design Team UCSD/Calit2 Ocean Observing Systems Semantic Interoperability Workshop, November.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative Sensing and Acquisition Subsystem Arjuna Balasuriya Life Cycle Architecture Review La Jolla,

End-to-End Data Services A Few Personal Thoughts Unidata Staff Meeting 2 September 2009.

Ocean Observatories Initiative Serving Ocean Model Data on the Cloud M. Meisinger, C. Farcas, E. Farcas, C. Alexander, M. Arrott, J. de La Beaujardière,

Ocean Observatories Initiative OOI Cyberinfrastructure Overview Matthew Arrott VMware Presentation March 5, 2010.

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Ocean Observatories Initiative OOI Cyberinfrastructure Life Cycle Objectives Review January 8-9, 2013 Scientific Workflows for OOI Ilkay Altintas Charles.

Ocean Observatories Initiative OOI Cyberinfrastructure Common Execution Infrastructure Michael Meisinger OOI Cyberinfrastructure Life Cycle Objectives.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration: Christopher Mueller Life Cycle Objectives Review La Jolla,

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative User Experience Susanne Jul, Carolanne Fisher, Tom Auer, Chris Quintana Life Cycle Architecture.

Ocean Observatories Initiative Integrating Marine Observatories into a System-of-Systems: Messaging in the US Ocean Observatories Initiative M. Arrott,

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.

NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.

R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.

DataNet Collaboration

OOI Cyberinfrastructure Integrated Elaboration Demo

Presentation transcript:

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle Objectives Review La Jolla, CA

OOI CI LCA REVIEW August 2010 Agenda Life Cycle Objectives Review Strategy Subsystem Purpose Release 1 Product Description Use Case Overview Architectural Overview Status of Progress Use Cases Address, Use Cases Demonstrated Technology Challenges and Achievements Plan for Elaboration Significant Risks 2

OOI CI LCA REVIEW August 2010 OOI-CI – IOOS DMAC Strategy OOI Cyberinfrastructure (CI): a transformational integrated observing infrastructure, providing a link between ocean research and discovery Integrated Ocean Observing System: a federal, regional, and private-sector partnership working to enhance our ability to collect, deliver, and use ocean information IOOS Data Management and Communications (DMAC) Subsystem : a subsystem capable of delivering real-time, delayed-mode, and historical data for in-situ and remotely-sensed physical, chemical and biological observations, as well as, model-generated outputs, including forecasts, to IOOS® users and of delivering all forms of information to and from secure archive facilities. ( What is our strategy for aligning OOI and IOOS? "OOI is NSF's contribution to IOOS” (then) (now) “One cyberinfrastructure (implementation) shared between two organizations” (now) 3

OOI CI LCA REVIEW August 2010 External Observatory Integration Subsystem: Purpose 1. Integrates external observatories (IOOS in R1) with the OOI Integrated Observatory 2. Facilitates inclusion of external data 3. Delivers data in community specific forms 4. Allows immediate full scale testing of the OOI-CI System 5. Introduces OOI to a community of early adopters 4

OOI CI LCA REVIEW August 2010 EOI R1 Product Description Use Case Overview IDTitleDescription UC.R1.21 Derive Data Product Externally (Merge Data) Provide data unified from many sources Responsible For IDTitleDescription UC.R1.04Ingest and Describe DataExternally Provided Data read and distributed UC.R1.22Present as CatalogPresent organized set of resources externally Supports IDTitleDescription UC.R1.03Hello Data SourceData source is registered and connected UC.R1.06Distribute Data ProductData made available to many consumers UC.R1.07Subscribe to DataUser finds data, asks for update notifications UC.R1.13Transform DataData process produces new data from old UC.R1.24Version a ResourceResource is supplanted by changed version UC.R1.33Assert Access PolicyDefine access policy for a given resource Uses 5

OOI CI LCA REVIEW August 2010 Architectural Overview – Client View Researcher’s Process OOI-CI Process Apply CF conventions LDM THREDDS Catalog CDM IDD GTS NOAA Port NetCDF Java Library Model Analysis NDBC: Observing System Monitoring Center (OSMC) PULL Unidata Or NDBC NCO & User Scripts PULL DAP & CF Matlab (test CDM) 5 Navy/NASA/Other Model output 1A 2A CI-DMAC_project_ doc OOI-CI & IOOS-DMAC Intersection Development Project- FY2010 *Improve the process by which researchers get data to drive models 6

OOI CI LCA REVIEW August 2010 Rutgers Modeling Process 7

OOI CI LCA REVIEW August OV2 CI Architectural Overview – OOI-CI View Application Services Infrastructure Services 8 IOOS

OOI CI LCA REVIEW August 2010 User Interfaces Core Infrastructure Services Architectural Overview – OOI-CI View Common Operating Infrastructure Data Distribution and Preservation Infrastructure Common Execution Infrastructure Data Management Application Level Services Externalization and Integration Instrument Agents External Observatory Integration Sensing & Acquisition 9 IOOS

OOI CI LCA REVIEW August 2010 Status of Progress Established the Rutgers modeling team (John Wilkin) as the initial scientific user group Started developing interaction patterns between OOI-CI, IOOS, & Rutgers modeling team Compiled lists of data sources, outputs and workflows required by the Rutgers modeling team 10

OOI CI LCA REVIEW August 2010 Status of Progress – List of Rutgers Data Sources Providers: PFEG, Rutgers, NAVY, USGS, RADS, NCEP, AOML Acquisition Protocols: OPeNDAP, curl, wget, urlread Prospective CDM Types: Grid, Station, Trajectory, Profile Data Variables: Sea Surface Height, Currents, Winds, Salinity, Temperature, River Discharge, … Acquisition Forms: NetCDF, ASCII 11

OOI CI LCA REVIEW August 2010 Status of Progress – List of Rutgers Data Products Names: ROMS, 4DVAR Observational Files Distribution Protocol: OPeNDAP Prospective CDM Types: Grid, Station Collection Data Variables: Currents, Temperature, Salinity, Sea Surface Height, & Many More… Output Forms: NetCDF 12

OOI CI LCA REVIEW August 2010 EOI Technology List IDD/LDM Matlab NetCDF Java 13

OOI CI LCA REVIEW August 2010 Technology Challenges and Achievements Achievements: Functional prototypes of NetCDF  DAP translation in both JAVA & Python Challenges: Potential structural differences between DAP objects generated by pyDAP and Java OPeNDAP libraries 14

OOI CI LCA REVIEW August 2010 Plan for Elaboration: Derive Data Product Externally 15 Acquire data from OOI

OOI CI LCA REVIEW August 2010 Plan for Elaboration: Derive Data Product Externally 16 Apply algorithm externally to generate new data

OOI CI LCA REVIEW August 2010 Plan for Elaboration: Derive Data Product Externally 17 Make new data available to OOI

OOI CI LCA REVIEW August 2010 Plan for Elaboration Continue to work with selected scientific modeling groups and Register each data source as a Provider in the OOI-CI System Translation/transformation to achieve CDM/CF compliance Leverage IOOS data sources wherever possible Work with scientists to utilize the OOI-CI System for acquiring data Develop client-side tool that receives OOI-CI syndication notifications to fetch data and start a science user process locally Register observational files and model output as products in OOI- CI 18

OOI CI LCA REVIEW August 2010 Risk Assessment – EOI Use Case IDNameDelivery RiskMaturity LevelTarget Use UC.R1.21Derive Data Product Externally (Merge Data)LowRequiredUser 19

OOI CI LCA REVIEW August 2010 EOI Technologies at Risk for Release 1 None at this time! 20

OOI CI LCA REVIEW August 2010 Thanks ! Questions ? 21