RICO DATA MANAGEMENT Steve Williams and Scot Loehrer UCAR/Joint Office for Science Support (JOSS) Boulder, Colorado RICO Workshop Boulder, CO 25 - 27 February.

Slides:



Advertisements
Similar presentations
José Meitín NOAA Office of Global Programs Steve Williams UCAR Joint Office for Science Support José Meitín NOAA Office of.
Advertisements

Peter Griffith and Megan McGroddy 4 th NACP All Investigators Meeting February 3, 2013 Expectations and Opportunities for NACP Investigators to Share and.
1 6th GOES Users' Conference, Madison, Wisconsin, Nov 3-5 WMO Activities and Plans for Geostationary and Highly Elliptical Orbit Satellites Jérôme Lafeuille.
The Utility of GOES-R and LEO Soundings for Hurricane Data Assimilation and Forecasting Jun Timothy J. Schmit #, Hui Liu &, Jinlong and Jing.
1 GOES Users’ Conference October 1, 2002 GOES Users’ Conference October 1, 2002 John (Jack) J. Kelly, Jr. National Weather Service Infusion of Satellite.
Support Considerations for the Houston Environmental Aerosol Thunderstorm (HEAT) Project Richard Dirks, Jim Moore, Steve Williams UCAR/Joint Office for.
Rapid Update Cycle Model William Sachman and Steven Earle ESC452 - Spring 2006.
2.2 Data Group Membership: Reeves (chair), Lloyd, Morse. Reports to SSC. This group will be responsible for preparation of the AMMA-UK Data Protocol, which.
Atmospheric Sciences 370 Observing Systems January 2007.
RAINEX Real time Communications Overview NCAR, NOAA, Rest of the World Operational Products Satellite Imagery Model Products Surface Observations RECON.
Recent Progress on High Impact Weather Forecast with GOES ‐ R and Advanced IR Soundings Jun Li 1, Jinlong Li 1, Jing Zheng 1, Tim Schmit 2, and Hui Liu.
Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
VAMOS PROGRAMS PROJECT OFFICE C. B. Emmanuel, Director José Meitín, Deputy Director C. B.
Details for Today: DATE:18 th November 2004 BY:Mark Cresswell FOLLOWED BY:Literature exercise Model Assimilation 69EG3137 – Impacts & Models of Climate.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 Long-Term Upper Air Temperature.
AON Data Questionnaire Results 21 Respondents Last Updated 27 March 2007 First AON PI Meeting Scot Loehrer, Jim Moore.
The U.S. Inter-agency Arctic Research Policy Committee (IARPC) 5-year Research Plan, FY13-FY17 1.Understand sea-ice dynamics, ecosystem processes, ecosystem.
Collaborative Research: Toward reanalysis of the Arctic Climate System—sea ice and ocean reconstruction with data assimilation Synthesis of Arctic System.
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
Summary of MAP D-PHASE Strategy and Requirements MAP D-PHASE / Olympics Project Meeting 6 February 2006 Prepared by: Ron McTaggart-Cowan.
RICO: Satellite Instruments Larry Di Girolamo, Eric Snodgrass University of Illinois at Urbana-Champaign Greg Stossmeister, Jim Moore UCAR Joint Office.
Slide: 1 Osamu Ochiai Water SBA Coordinator The GEO Water Strategy Report – The CEOS Contribution Presentation to the 26 th CEOS Plenary at Bengaluru,
T-PARC Operations Plan Outline Chapter 1. T-PARC Overview Chapter 2 Scientific Mission Planning Organization and Intensive Observing Period Definition.
DRAFT POES-GOES-GPS Blended TPW Products July ??, 2008 Preliminary Design Review.
START-08/pre-HIPPO FIELD CATALOG AND DATA MANAGEMENT Steve Williams NCAR Earth Observing Laboratory (EOL) Boulder, Colorado START-08/pre-HIPPO Planning.
Chapter 9: Weather Forecasting Surface weather maps 500mb weather maps Satellite Images Radar Images.
Meteorology What is it? How does it work? Meteorology in action!!
RAINEX Data Management UCAR Joint Office for Science Support José Meitín Jim Moore Dick Dirks UCAR Joint Office for Science Support José Meitín Jim Moore.
Hyperspectral Infrared Alone Cloudy Sounding Algorithm Development Objective and Summary To prepare for the synergistic use of data from the high-temporal.
IHOP_2002 DATA MANAGEMENT UPDATE Steve Williams UCAR/Joint Office for Science Support (JOSS) Boulder, Colorado 2 nd International IHOP_2002 Science Workshop.
IHOP-2002 Data Archive and Development of Composite Data Sets Steven F. Williams, Scot M. Loehrer, Linda E. Cully, Darren R. Gallant, Janine Goldstein,
NAME 2004 Field Operations and Procedures NAME Special Session Field Operations Center Concept: Define requirements for, and conduct the day-to-day operations,
High impact weather studies with advanced IR sounder data Jun Li Cooperative Institute for Meteorological Satellite Studies (CIMSS),
Weather Forecasting & Maps -Meteorologists make forecasts based on models that are produced by supercomputers which perform a large amount of calculations.
Data Management Plan for KORUS-AQ Airborne Field Study Dr. Jeong-Hoo Park National Institute of Environmental Research Dr. Gao Chen NASA Langley Research.
Space Observations Ocean Observations Land Surface Observations Atmospheric Observations Environmental Data at NOAA.
Robert Grumbine National Weather Service RA-IV WIGOS Implementation Workshop (English), December, Willemstad Curaçao United.
RICO DATA MANAGEMENT STATUS UPDATE Steve Williams and Scot Loehrer UCAR/Joint Office for Science Support (JOSS) Boulder, Colorado RICO Planning Workshop.
DATA MANAGEMENT UPDATE Steve Williams, Linda Cully, and Scot Loehrer NCAR/Earth Observing Laboratory (EOL) NAME SWG (7.5) Meeting 28 October 2005.
ASAP In-Flight Icing Research at NCAR J. Haggerty, F. McDonough, J. Black, S. Landolt, C. Wolff, and S. Mueller In collaboration with: P. Minnis and W.
2015 HS3 Science Team Meeting Ames Research Center, Moffett Field, CA.
Update on the NADP Atmospheric Mercury Initiative Developing a new coordinated and collaborative approach to atmospheric mercury monitoring A Briefing.
Weather Forecasting Subtitle.
Atmospheric Sciences 370 Observing Systems January 2012.
UCAR Office of Programs University Corporation for Atmospheric Research Overview of NAME Field Catalog NAME Special Session José Meitín NAME Project Office.
Where/how could we change the overall process of field project implementation to improve in our mission of answering key science questions? Are we open.
Review of Field Catalog and Data Archive Chin-Tzu Fong 馮欽賜.
Instruments. In Situ In situ instruments measure what is occurring in their immediate proximity. E.g., a thermometer or a wind vane. Remote sensing uses.
Overview of Climate Observational Requirements for GOES-R Herbert Jacobowitz Short & Associates, Inc.
High impact weather nowcasting and short-range forecasting using advanced IR soundings Jun Li Cooperative Institute for Meteorological.
The National Weather Service Goes Geospatial – Serving Weather Data on the Web Ken Waters Regional Scientist National Weather Service Pacific Region HQ.
Atmospheric Sciences 370 Observing Systems Winter 2016.
NASA, CGMS-43, May 2015 Coordination Group for Meteorological Satellites - CGMS Update of the NASA GPM and Precipitation Products and their Availability.
START08 DATA MANAGEMENT AND ARCHIVING UPDATE Janine Goldstein, Steve Williams NCAR Earth Observing Laboratory Boulder, Colorado
The Course of Synoptic Meteorology
Announcements Sign-up Class list Official registration Course Syllabus.
Upper Air Data The Atmosphere is 3D and can not be understood or forecast by using surface data alone.
RICO Ops Plan – Satellite Section
Meteorology Tools 5.02 Evaluate meteorological observing, analysis, and prediction: Worldwide observing systems. Meteorological data depiction Analyze.
EG2234 Earth Observation Weather Forecasting.
José Meitín Overview of NAME Field Catalog NAME Project Office
Application of GI to weather forecasting
José Meitín Overview of JOSS Field Catalog UCAR/JOSS Boulder, Colorado
GOES Sounder Meteorology 415 Fall 2007.
RICO DATA MANAGEMENT STATUS UPDATE
Upper Air Observations The atmosphere is 3D and can not be understood or forecast by using surface data alone ATM 101W2019.
Weather Forecasting.
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

RICO DATA MANAGEMENT Steve Williams and Scot Loehrer UCAR/Joint Office for Science Support (JOSS) Boulder, Colorado RICO Workshop Boulder, CO February 2004

RICO DRAFT DATA POLICY (20 February 2004) All investigators participating in RICO must agree to promptly submit their data to the RICO Data Archive Center (RDAC) to facilitate intercomparison of results, quality control checks and inter-calibrations, as well as an integrated interpretation of the combined data set. All data shall be promptly provided to other RICO investigators upon request. A list of RICO investigators will be maintained by the RICO Project Office and will include the Principle Investigators (PIs) directly participating in the field experiment as well as collaborating scientists who have provided guidance in the planning and analysis of RICO data. During the initial data analysis period (one year following the end of the field phase; 25 January 2005), if data are provided to a third party (journal articles, presentations, research proposals, other investigators) the investigator who collected the data must be notified first. This initial analysis period is designed to provide an opportunity to quality control the combined data set as well as to provide the investigators ample time to publish their results. All data will be considered public domain not more than one year following the end of the RICO field phase. Data can be opened to the public domain earlier depending on the discretion of the data provider. There will be exceptions where extensive data processing is required. Any use of the data will include acknowledgment (i.e., citation). Co-authorship during the one year analysis phase will be at the discretion of the investigator(s) who collected the data.

RICO DATA MANAGEMENT PLAN OUTLINE 1.0 Introduction/Background4.0 RICO Data Sets 1.1 Scientific Objectives4.1 Data Collection/Processing 1.2 Data Management Philosophy4.2 Status Update Procedures 4.3 In-field Data Display and 2.0 Data Management Policy Analysis Requirements 2.1 Data Protocol4.4 Coordination with other Programs 2.2 Data Processing/Quality Control 2.3 Data Availability 2.4 Data Attribution 2.5 Community Access to Data APPENDICES 3.0 Data Management Functional Strategy/Description A. Research Data Sets 3.1 Data Archive and Analysis CentersB. Operational Data Sets 3.2 Investigator RequirementsC. List of Acronymns Data Format Conventions Data Submission Requirements 3.3 Data Collection Schedule On-line Field Catalog 3.4 Data Processing following the Field Phase 3.5 Data Integration 3.6 Data Archival and Long-term Access

MAPS OF METEOROLOGICAL NETWORKS IN THE RICO REGION

MAPS OF METEOROLOGICAL NETWORKS IN THE RICO REGION (Cont.)

GOES Data SetReal Time NeedArchive NeedOther Information GOES Imager40%70% GOES Sounder10%30% CAPE10%30% Lifted Index10%30% Precipitable Water30%50% Cloud Top Pressure30%50% Surface Skin Temperature30%40% Cloud Drift Winds20%30% Other GOES Sectors or Products needed: No discussion of Rapid Scan Operations in Data Management Questionnaire POES Data SetReal Time NeedArchive Need AVHRR LAC/HRPT Imager30%50% AVHRR GAC Imager10%20% TOVS/ATOVS20% Surface Skin Temperature20%40% Precipitable Water20%50% Cloud LWP/IWP20%50% RICO Data Questionnaire Satellite Response Summary (10) Other POES products needed: ICE-Sat, Seawinds on Quikscat, TMI

Other POES DatasetsReal-timeArchiveOther Information DMSP OLS Imager DataN/A10% TRMM DataN/A30% SeaWifs Imager Data10%40% MODIS DataN/A70% MISR DataN/A40% RICO Data Questionnaire Satellite Response Summary (10) RICO Data Questionnaire Radar Response Summary (10) Radar Data SetsReal-timeArchiveOther Information WSR-88D10%50% Other Radar data/products needed: W-Band cloud radar; S-Pol

Upper Air Data SetsReal-timeArchiveOther Information Mandatory/significant levels50%60% High Vertical ResolutionN/A80% Interpolated (e.g. 5mb)N/A40% ACARS/WVSS20%40% GPS10%20% RICO Data Questionnaire Upper Air Response Summary (10) RICO Data Questionnaire Surface Response Summary (10) Surface Data SetsReal-timeArchiveOther Information ASOS (1 and 5-min)N/A40% ASOS (60-min)30%60% Hourly METAR Observations10%20% Synoptic Observations30%50% Buoy Observations20%40% Ship Observations20%40% Other Surface data/products needed: Surface maps made available and archived Other Upper Air data/products needed: 500mb charts made available and archived

Model OutputReal-timeArchiveProducts Specified NOAA/NCEP ETA30%40% RICO Data Questionnaire Model Response Summary (10) Meteorological variables on pressure levels: None specified Model OutputReal-timeArchiveProducts Specified NOAA/NCEP GFS20% Meteorological variables on pressure levels: None specified Model OutputReal-timeArchiveProducts Specified Navy NOGAPS10% Model OutputReal-timeArchiveProducts Specified ECMWF30%50% Meteorological variables on pressure levels: None specified

UCAR Office of Programs University Corporation for Atmospheric Research Field Documentation Operations Summary Instrument / Fac. Status Forecast Briefing Mission Summary Scientist Summary Field Documentation Operations Summary Instrument / Fac. Status Forecast Briefing Mission Summary Scientist Summary Field Data Catalog

UCAR Office of Programs University Corporation for Atmospheric Research

Operational Products Display Satellite Surface Model Analysis Upper-Air Soundings Buoy Data Marine Products Operational Products Display Satellite Surface Model Analysis Upper-Air Soundings Buoy Data Marine Products Field Data Catalog

UCAR Office of Programs University Corporation for Atmospheric Research

Intensive Observing Periods Special Analysis Products Science, Operations and Mission Summaries Flight Tracks, Ship Position Preliminary Products Quick-Look Data Analyses Intensive Observing Periods Special Analysis Products Science, Operations and Mission Summaries Flight Tracks, Ship Position Preliminary Products Quick-Look Data Analyses Field Data Catalog

UCAR Office of Programs University Corporation for Atmospheric Research

FIELD CATALOG SAMPLE PRODUCTS

RICO Data Management Timeline Finalize Operations Plan Data Management Questionnaire Sent Complete Operations Summary (WWW) Operational Data Staged to CODIAC On-line Catalog Operational (CODIAC) Final Specs from PIs Field Ops and Data Collection QC’d data from PIs Final Data Staged Sample Datasets from PIs Finalize Data Management Plan OPS Planning Meeting Planning Meeting Preliminary data stagedIntegrated Data Staged Data Analysis Workshop Draft DM Plan

RICO DATA MANAGEMENT ISSUES Finalize Data Policy Submit Data Questionnaire Responses Access to ECMWF High Resolution Supplemental Fields? Data Format Standards? Need for Data “Composites” (e.g. Upper Air)? Other Data Integration Needs?