GES DISC Experience with HDF Formats for MeaSUREs Projects by James Johnson NASA/GES DISC (Wyle Inc.) April 17, 2012.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

The Water Cycle Water is continually moving from the surface of Earth through the atmosphere in the three states of matter: solid liquid gas.

THE WATER CYCLE Water moves from the oceans to the atmosphere, from the atmosphere to the land, and from the land back to the oceans.

Gregory Leptoukh, David Lary, Suhung Shen, Christopher Lynnes What’s in a day?

Best Practices to Promote Data Interoperability Chris Lynnes Joe Glassy Technology Infusion Working Group.

Data Quality Screening Service Christopher Lynnes, Richard Strub, Thomas Hearty, Bruce Vollmer Goddard Earth Sciences Data and Information Sciences Center.

ENERGY FROM THE SUN Chapter 14.3 Pages Energy in the Atmosphere The sun is the source of ALL energy in our atmosphere. Three things that can.

The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Access of NASA HDF data via OPeNDAP Kent Yang and Joe Lee The HDF Group September 28,2010.

MODIS Atmosphere Team Webinar Series #12: Resources for Finding and Using MODIS Products 1 Richard Kleidman (SSAI/613) and Lots and lots and lots of other.

ACC-VC Status and Issues Richard Eckman, NASA SIT-30 Agenda Item #8 CEOS Action / Work Plan Reference 30 th CEOS SIT Meeting CNES Headquarters, Paris,

Meteorological Observatory Lindenberg – Richard Assmann Observatory The GCOS Reference Upper Air Network.

Visualization, Exploration, and Model Comparison of NASA Air Quality Remote Sensing data via Giovanni Ana I. Prados, Gregory Leptoukh, Arun Gopalan, and.

The HDF Group ESIP Summer Meeting HDF OPeNDAP update Kent Yang The HDF Group 1 July 8 – 11, 2014.

Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.

DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.

Liguang Wu, Jianchun Qin, A.K.Sharma, Sunmi Cho* and Carrie Phelps Goddard Earth Sciences DISC DAAC NASA Goddard Space Flight Center, Code 902 Greenbelt,

MODIS Land and HDF-EOS HDF-EOS Workshop Presentation September 20, 2000 Robert Wolfe NASA GSFC Code 922, Raytheon ITSS MODIS Land Science Team Support.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.

Community Based Initiatives GES DISC UWG 2011 Meeting.

Giovanni for AQ Gregory Leptoukh NASA Goddard Space Flight Center Goddard Earth Sciences Data and Information Services Center (GES DISC)

Getting Ready for the Future Woody Turner Earth Science Division NASA Headquarters May 7, 2014 Biodiversity and Ecological Forecasting Team Meeting Sheraton.

EARTH SCIENCE MARKUP LANGUAGE Why do you need it? How can it help you? INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 GOES Solar Radiation Products in Support of Renewable Energy Istvan Laszlo.

The HDF Group November 3-5, 2009 HDF-OPeNDAP Project Update HDF/HDF-EOS Workshop XIII1 Joe Lee and Kent Yang The HDF Group James Gallagher.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII10/17/2008.

Global Climate Observing System Ozone Research Managers’ Meeting David Goodrich Director, GCOS Secretariat World Meteorological Organization.

MEaSUREs Projects Data Support GES DISC User Working Group May 10-11, 2011 Bruce Vollmer

GES DISC Lines of Business May 10-11, The GES DISC Lines of Business allow us to categorize our efforts into specific focus areas They help us in.

, Key Components of a Successful Earth Science Subsetter Architecture ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

NASA Earth Science UAS Mission Requirements Don Sullivan NASA Ames Research Center

HDF OPeNDAP Project Update MuQun Yang and Hyo-Kyung Lee The HDF Group March 31, Annual briefing to ESDIS10/31/2015.

ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.

Development and Preliminary Results of Image Processing Tools for Meteorology and Air Quality Modeling Limei Ran Center for Environmental Modeling for.

NIST Data Science SymposiumMarch 4, 2014 NIST Data Science SymposiumMarch 4, Climate Archives in NOAA: Challenges and Opportunities March 4, 2014.

GES DISC DAAC February 28, 2002HDF-EOS Workshop V1 The Goddard DAAC The Goddard DAAC Presented by:

Sun Controls Earth’s Climate System Earth has a global climate system that includes air, land, liquid water, ice, and living things.climate system The.

HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.

This model shows the ocean with salinity around. The researchers analyst each location with percent.

Mr. Fleming. The trapping of heat from the sun by gases in the Earth’s atmosphere. The major gas contributing to this process is Carbon dioxide gas.

12/2/2015Fall 2002 AGU Meeting1 Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools Larry Klein, Ray Milburn, Cid Praderas and.

Chemistry-Climate Working Group Meeting (March 22-24, 2006) Background –SSC expectations and the next IPCC (Bill Collins) Summarize where we are now Discuss.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1 HDF and HDF-EOS Workshop XII10/17/2008.

Using a Friendly OPeNDAP Client Library to Access HDF5 Data MuQun Yang and Hyo-Kyung Lee (The HDF Group) 1 25th IIPS Conference01/14/2009.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII, Aurora,

The HDF Group Data Interoperability The HDF Group Staff Sep , 2010HDF/HDF-EOS Workshop XIV1.

GLAS Standard Data Products for Distribution by NSIDC Polar DAAC User Working Group PoDAG Meeting XVI February 2000 Presenters H. Jay Zwally, NASA/GSFC.

The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.

Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,

VIIRS Product Evaluation at the Ocean PEATE Frederick S. Patt Gene C. Feldman IGARSS 2010 July 27, 2010.

The Global Learning and Observation to Benefit the Environment (GLOBE) program is a worldwide hands-on, primary and secondary school-based science and.

Aura HDF-EOS File Format Guidelines: Overview and Status Cheryl Craig.

10/16/2012Annual HDF briefing1 HDF OPeNDAP support Kent Yang, Joe Lee, Mike Folk The HDF Group Oct. 16, 2012.

Data File Formats: netCDF by Tom Whittaker University of Wisconsin-Madison SSEC/CIMSS 2009 MUG Meeting June, 2009.

Satellite Observation Information Service for Data Assimilation Applications M. Lee 1, R. Weidner 1, C. Lynnes 2, I. Gerasimov 2 1 : Jet Propulsion Laboratory.

By: Kate Naumann And Colleen Simpkins. Aqua is a major international Earth Science satellite mission centered at NASA. It was launched on May 4, 2002.

Atmosphere Earth’s albedo. AtmosphereEarth’s albedo “Describe and explain the energy exchanges that result in the Earth’s surface receiving only 56% of.

Goddard Earth Sciences Data and Information Services Center, NASA/GSFC, Code 902, Greenbelt, Maryland 20771, USA INTRODUCTION  NASA Goddard Earth Sciences.

CF 2.0 Coming Soon? (Climate and Forecast Conventions for netCDF) Ethan Davis ESO Developing Standards - ESIP Summer Mtg 14 July 2015.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Consistent Earth System Data Records for Climate Research: Focus on Shortwave and Longwave Radiative Fluxes Rachel T. Pinker, Yingtao Ma and Eric Nussbaumer.

NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.

Land, Water, and Air Resources Chapter Global Changes in the Atmosphere.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII, Aurora,

NASA HDF and HDF-EOS Status Use in EOSDIS

Users Requirements The inconsistencies between the UR and GCOS-2006 identified in some of the URDs will be reduced with the new iteration of the GCOS.

NSIDC DAAC UWG Meeting August 9-10 Boulder, CO

Atmosphere and climate

Using STK for Engineering Technology Education By Andrew G. Bell

ExPLORE Complex Oceanographic Data

Presentation transcript:

GES DISC Experience with HDF Formats for MeaSUREs Projects by James Johnson NASA/GES DISC (Wyle Inc.) April 17, 2012

What is MEaSUREs? Making Earth Science Data Records for Use in Research Environments (MEaSUREs) ROSES-2006 Proposal with 29 projects Create Earth Science Data Records (ESDRs): long-term, consistent, and calibrated data and products that are valid across multiple missions and satellite sensors GES DISC supports 7 MEaSUREs projects

GES DISC MEaSUREs Projects ProjectPI NameType of DataFile Format Reprocessing and Goddard Satellite-based Surface Turbulent Fluxes (GSSTF) Data Set for Global Water and Energy Cycle Research Chung-Lin ShieL3: 1.0°×1.0° GridsHDF-EOS5 Creating a Long Term Multi-Sensor Ozone Data Record Richard McPetersL3: 5° Zonal Means L2 Nadir ProfilesHDF5 Consistent Long-Term Aerosol Data Records over Land and Ocean from SeaWIFS Christina HsuL3: 0.5°×0.5° Grids L3: 1.0°×1.0° Grids L2: Orbit Swaths HDF5 GOZCARDS: Global Ozone Chemistry and Related trace gas Data Records for the Stratosphere Lucien FroidevauxL3: 10° Zonal MeansnetCDF4 Earth Surface and Atmosphere Reflectivity Since 1979 from Multiple Satellites Jay HermanL3: 2.0°×5.0° Grid L3: 5° Zonal Means HDF-EOS5 A Multi-Sensor Water Vapor Climate Data Record Using Cloud Classification Eric FetzerL2: Co-located (AIRS and Cloudsat) netCDF4 Developing Consistent Earth System Data Records for the global terrestrial water cycle Eric WoodL3: 0.5°×0.5° GridsHDF-EOS5

GES DISC Recommendations GES DISC proposed recommendations for file names, formats (HDF5, HDF-EOS5, netCDF4), and metadata (CF-1 and S4PA) Work with data teams to reach ‘recommended’ requirements Goal to get consistency among the various MEaSUREs data projects Why? Primarily for benefit of users and also for interoperability software such as OPeNDAP Harness full power of 'self-describing' file formats

Problems and Issues Ad-hoc HDF5 implementations cause problems with OPeNDAP handler and other generic tools (particularly if no CF-1 conventions used). HDF-EOS5 has a well described data model for a generic handler. Recommend CF-1/udunits conventions for attributes. netCDF4 implementations have not been tested yet, except classic netCDF implementations using CF-1 conventions. GES DISC would like to remove the HDF5 recommendation to prevent future problems.

GES DISC MEaSUREs Page For further information about these projects: OPeNDAP access to available data at: