CDIAC AmeriFlux Data Management Tom Boden (Bai Yang) Carbon Dioxide Information Analysis Center (CDIAC) Oak Ridge National Laboratory (ORNL) Presented.

Slides:



Advertisements
Similar presentations
Regional trends in the land carbon cycle and the underlying mechanisms over the period, S. Sitch, P. Friedlingstein, G. Bonan, P. Canadell, P.
Advertisements

Responses of terrestrial ecosystems to drought
CMIP5: Overview of the Coupled Model Intercomparison Project Phase 5
Critical needs for new understanding of nutrient dynamics in Earth System Models Peter Thornton Oak Ridge National Laboratory Collaborators: Gautam Bisht,
New FLUXDATA collection Aim of the presentation: get feedbacks and suggestions from you in the next days.
O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Global Climate Modeling Research John Drake Computational Climate Dynamics Group Computer.
Land Surface Fluxes in Coupled Land/Atmosphere Analysis Systems Michael Bosilovich, NASA GSFC And Collaborators.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
Deborah Agarwal BWC technical team 16 July Applications of eddy covariance measurements, Part 1: Lecture on Analyzing and Interpreting CO2 Flux.
O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY 1 Carbon Cycle Modeling Terrestrial Ecosystem Models W.M. Post, ORNL Atmospheric Measurements.
Raw data Hz HH data submitted for synthesis Flux calculation, raw data filtering Additional filtering for footprint or instrument malfunctioning.
Trends in Terrestrial Carbon Sinks Driven by Hydroclimatic Change since 1948: Data-Driven Analysis using FLUXNET Trends in Terrestrial Carbon Sinks Driven.
Fluxdata.org FLUXNET Dataset Synthesis Support Deb Agarwal (LBNL) Catharine van Ingen (Microsoft) Fluxdata Team: Marty Humphrey (UVa), Norm Beekwilder.
Bridging the Gap in Scales between Flux Towers, Ecosystem Models and Remote Sensing R.J. Olson 1, R.B. Cook 1, L.M. Olsen 1, T. A. Boden 1, J.T. Morisette.
1 CDIAC Data Support for SPRUCE and NGEE Les A. Hook and Ranjeet Devarakonda Environmental Sciences Division Oak Ridge National Laboratory CDIAC User Working.
Remote Sensing Data Assimilation for a Prognostic Phenology Model How to define global-scale empirical parameters? Reto Stöckli 1,2
Paul R. Moorcroft David Medvigy, Stephen Wofsy, J. William Munger, M. Dietze Harvard University Developing a predictive science of the biosphere.
Field Measurement Networks D. Hollinger, E. LaPoint, R. Birdsey, L. Heath U.S. North American Carbon Program (NACP) Investigators Meeting, January 22-24,
New FLUXDATA collection Aim of the presentation: get feedbacks and suggestions from you in the next days.
Workshop on QC in Derived Data Products, Las Cruces, NM, 31 January 2007 ClimDB/HydroDB Objectives Don Henshaw Improve access to long-term collections.
Mid-Continent Intensive Campaign Synthesis Stephen M. Ogle Natural Resources Ecology Laboratory Colorado State University Co-Investigators: K. Davis, A.
1Managed by UT-Battelle for the Department of Energy ORNL DAAC Overview for ESIP Carbon Cluster Environmental Data Science & Systems Objective:
Abstract Carbon Fluxes Across Four Land Use Types in New Hampshire Sean Z. Fogarty, Lucie C. Lepine, Andrew P. Ouimette — University of New Hampshire,
O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY 1 Vegetation/Ecosystem Modeling and Analysis Project (VEMAP) Lessons Learned or How to Do.
Translation to the New TCO Panel Beverly Law Prof. Global Change Forest Science Science Chair, AmeriFlux Network Oregon State University.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Deb Agarwal (UCB and LBNL) Catharine van Ingen (MSFT) Berkeley Water Center Microsoft TCI IndoFlux Meeting, Chennai, India, July.
How Do Forests, Agriculture and Residential Neighborhoods Interact with Climate? Andrew Ouimette, Lucie Lepine, Mary Martin, Scott Ollinger Earth Systems.
Model Intercomparisons and Validation: Terrestrial Carbon, an Arctic Emphasis Andrew Slater.
LeafWeb (leafweb.ornl.gov) Objectives - Provide plant physiologists and photosynthesis researchers a reliable tool for analyzing leaf gas exchange measurements.
Using FLUXNET data to evaluate land surface models Ray Leuning and Gab Abramowitz 4 – 6 June 2008.
Spatial Model-Data Comparison Project Conclusions Forward models are very different and do not agree on timing or spatial distribution of C sources/sinks.
Evaluation of land model simulations across multiple sites and multiple models: Results from the NACP site-level synthesis effort Peter Thornton 1, Gautam.
Presented by Global Coupled Climate and Carbon Cycle Modeling Forrest M. Hoffman Computational Earth Sciences Group Computer Science and Mathematics Division.
Investigating the Carbon Cycle in Terrestrial Ecosystems (ICCTE) Scott Ollinger * -PI, Jana Albrecktova †, Bobby Braswell *, Rita Freuder *, Mary Martin.
AmeriFlux and FLUXNET Report Dennis Baldocchi Bev Law AsiaFlux Workshop, 2008, Seoul, Korea.
Activities of the GEWEX Hydrometeorology Panel GHP: LBA as component of GHP J. A. Marengo CPTEC/INPE São Paulo, Brazil J. Roads Scripps Institution of.
Free-Air Carbon Dioxide Enrichment – FACE BERAC review of DOE-funded experiments (’07) –ORNL FACE –Duke Forest FACE (FACTS I) –Rhinelander Aspen FACE (FACTS.
The PILPS-C1 experiment Results of the first phase of the project Complementary simulation to be done Proposition for the future.
Terrestrial Carbon Observations TCO Previous Strategy 1- better identify the potential end users, and their requirements 2- organize and coordinate reliable.
Global Terrestrial Observing System linking the world’s terrestrial monitoring systems to provide a global vision of the Earth we share.
ESG Observational Data Integration Presented by Feiyi Wang Technology Integration Group National Center of Computational Sciences.
Site-Level Model-Data Comparison A Proposed NACP Interim Synthesis Project Ken Davis, Peter Thornton, Kevin Schaefer, Dan Riciutto Coordinators.
Variations in Continental Terrestrial Primary Production, Evapotranspiration and Disturbance Faith Ann Heinsch, Maosheng Zhao, Qiaozhen Mu, David Mildrexler,
NACP A High-Resolution Daily Surface Weather Database for NACP Investigations Peter E. Thornton 1, Robert B. Cook 2, W. Mac Post 2, Bruce E. Wilson 2,
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
Data access systems Misha Krassovski CDIAC User Working Group September 2010.
Flux Measurements and Systematic Terrestrial Measurements 1.discuss gaps and opportunities What are gaps? 2. brainstorm ideas about collaborative projects.
Presented by Global Coupled Climate and Carbon Cycle Modeling Forrest M. Hoffman Computational Earth Sciences Group Computer Science and Mathematics Division.
ORNL DAAC: Introduction Bob Cook ORNL DAAC Environmental Sciences Division Oak Ridge National Laboratory.
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
Goal: to understand carbon dynamics in montane forest regions by developing new methods for estimating carbon exchange at local to regional scales. Activities:
Recursive Calibration of Ecosystem Models Using Sequential Data Assimilation Mingshi Chen¹, Shuguang Liu¹, Larry L. Tieszen², and David Y. Hollinger 3.
Evapotranspiration Estimates over Canada based on Observed, GR2 and NARR forcings Korolevich, V., Fernandes, R., Wang, S., Simic, A., Gong, F. Natural.
Terra MODIS Collection 4 / 4.5 and Aqua MODIS Collection 4; Sinusoidal Projection Data from 2000 to present; 8-day, 16-day, or annual composites Sites.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Dipl.-Geogr. Markus TumD Wessling Deutsches Zentrum für Luft- und RaumfahrtGermany Deutsches FernerkundungsdatenzentrumTel LandoberflächeFax.
Diurnal Water and Energy Cycles over the Continental United States from three Reanalyses Alex Ruane John Roads Scripps Institution of Oceanography / UCSD.
Towards a robust, generalizable non-linear regression gap filling algorithm (NLR_EM) Ankur R Desai – National Center for Atmospheric Research (NCAR) Boulder,
Wanda R. Ferrell, Ph.D. Acting Director Climate and Environmental Sciences Division February 24, 2010 BERAC Meeting Atmospheric System Research Science.
Success and Failure of Implementing Data-driven Upscaling Using Flux Networks and Remote Sensing Jingfeng Xiao Complex Systems Research Center, University.
Topic 7: Flux and remote sensing, merging data products, future directions 1. Databases (new-generation flux maps) (1) Make them available (online or offline)
Presented by LCF Climate Science Computational End Station James B. White III (Trey) Scientific Computing National Center for Computational Sciences Oak.
The CarboeuropeIP Ecosystem Component Database: data processing and availability Dario Papale, Markus Reichstein.
ORNL DAAC MODIS Land Product Subsets 1 Suresh K. Santhana Vannan, Robert B. Cook, Bruce E. Wilson, Lisa M. Olsen Environmental Sciences Division, Oak Ridge.
A Data Access and Comparison Tool for Biogeochemical Data from Diverse Sources Jerry Pan 1, Robert B. Cook 1, Suresh K. Santhana Vannan 1, Bruce E. Wilson.
Figure 10. Improvement in landscape resolution that the new 250-meter MODIS (Moderate Resolution Imaging Spectroradiometer) measurement of gross primary.
Field Data & Instrumentation
Global Terrestrial Observing System
NACP Site MDC “Are the various measurement and modeling estimates of carbon fluxes consistent with each other - and if not, why?” Simulated vs. observed.
Presentation transcript:

CDIAC AmeriFlux Data Management Tom Boden (Bai Yang) Carbon Dioxide Information Analysis Center (CDIAC) Oak Ridge National Laboratory (ORNL) Presented September 27, 2010 at the CDIAC User Working Group Meeting Oak Ridge National Laboratory OAK RIDGE NATIONAL LABORATORY U. S. DEPARTMENT OF ENERGY

2 AmeriFlux Network ~140 sites in 5 countries; 92 active sites, 48 inactive sites Participation Requirements Make year-round core measurements using the eddy- covariance technique Submit data to CDIAC within 1 year of collection Participate in AmeriFlux Science Meetings and synthesis/modeling activities DOE supports the AmeriFlux infrastructure including the chairperson, calibration laboratory, and a permanent data archive (CDIAC since 1997).

Architecture of Global / Regional Flux Networks Tower Sites Regional Networks CARBOEURO - FLUX Americas Europe AmeriFlux Canadian CP AmeriFlux Canadian CP AsiaFlux OzNet Asia - Japan Oceania Non- network sites Global Network F L U X N E T - a network of networks F L U X N E T - a network of networks

Primary FY2010 CDIAC AmeriFlux Team Misha Krassovski – data system - (0.9 FTE) Bai Yang – micrometeorologist [QA/QC] - (0.8 FTE) Barbara Jackson – SAS programming - (0.7 FTE) Ben Norton – web & DB maintenance - (0.5 FTE) Tom Boden – coordination - (0.3 FTE) Lianhong Gu – A-Ci analysis – (0.04 FTE)

Flux/Met Data Biological Data 30 min Averages BADM Quality Flags Gap-filled NEP/Re AmeriFlux Data Processing & Products Level 0Level 1Level 2Level 3 & 4 Site Investigator & Team CDIACFLUXNET CADM Network-wide Database Standard Files QA/QC Site Proc. Site Proc.

6 Level 1 data received from AmeriFlux site PIs Perform QA/QC Flux, Meteorological, and Ecological Data Files Stored “as received” from investigator File format, parameter names, and units unchanged Flux, Meteorological, and Ecological Data Files Stored “as received” from investigator File format, parameter names, and units unchanged Calculate additional parameters, add to network database Incorporate into Web data interface & produce standardized data files & metadata reports Incorporate into network-wide database Convert into standard AmeriFlux units, reporting intervals, and naming conventions Generate core parameters (e.g., VPD) where needed Incorporate into network-wide database Convert into standard AmeriFlux units, reporting intervals, and naming conventions Generate core parameters (e.g., VPD) where needed Web access to network-wide database Querying capabilities – time, measurement parameter, and site Graphics generation and data retrieval capabilities FTP access to standard files Standard files with 40 core variables (csv, NetCDF, tar) Metadata files (html & txt formats) Web access to network-wide database Querying capabilities – time, measurement parameter, and site Graphics generation and data retrieval capabilities FTP access to standard files Standard files with 40 core variables (csv, NetCDF, tar) Metadata files (html & txt formats) Add value through automated QA/QC Range checks, missing values, check solar elevation and time stamp Basic Statistics (mean, variance, range) Gap Analysis: determine frequency and duration of gaps in record Spike detection, stationarity, diurnal and seasonal pattern Cross checks/correlations (Rg vs. PAR) Graphical Analysis: time series, property vs property, frequency Add value through automated QA/QC Range checks, missing values, check solar elevation and time stamp Basic Statistics (mean, variance, range) Gap Analysis: determine frequency and duration of gaps in record Spike detection, stationarity, diurnal and seasonal pattern Cross checks/correlations (Rg vs. PAR) Graphical Analysis: time series, property vs property, frequency Level 1 to Level 2 Data Processing Scheme L1 files available from FTP area L2 data products available via Web interface and from FTP area | 5 days |

Progress in gap-filling meteorological data  Completed. We have completed a prototype data set of gap-filled meteorological data for the majority of active AmeriFlux sites.  Ongoing. This data set has been evaluated against other data sets filled by different techniques. The evaluation will continue if necessary and the sensitivity of ecosystem models to the gap-filled data sets will be estimated.  Ongoing. We are improving our gap-filling methods by including reanalysis data sets (NARR, DayMet, etc) and radar precipitation data. Present focus on filling long gaps and improving data reliability for precipitation, radiation, soil moisture and soil temperature.  Goal. We hope to finalize the gap-filled met-data sets before the next AmeriFlux annual meeting (Feb. 2011).

8 AmeriFlux Data System Site & PI Information, Pubs, & Instruments 12/2008 Reported Variables Flux & Met/Bio 1/2009 3/2009 Flux & Meteorological Data Commenced 8/2009 Leaf Ac i 3/2010 Biological Data BADM 11/2009 Metadata (e.g., Fc corrections, instrument calibrations FY 2011 Users Worldwide PHP Interface ORNL AmeriFlux & FLUXNET Data Team PHP Interface CDIAC MS SQL 2005 RDBMS Gu EDO methodology & code Web interface/Sharepoint for data submission and dissemination of results FY2010 Priorities Data extraction/ notification Load remaining L2 data, begin loading L4 data Web migration Inclusion of L2 & L4 data in the Earth System Grid Biological data editing functionality

Examples of CDIAC AmeriFlux Contributions to Synthesis & Modeling Activities  La Thuile, Italy workshop and resulting data sets  NACP Interim Site Synthesis  C-LAMP

La Thuile, Italy FLUXNET Workshop February 18-22, 2007  Participation and data response –~60 participants, good representation from regional networks and major programs (LBA, TCOS) –921 site yrs of data from 240 sites worldwide (33 countries) –318 site yrs of data from 77 AmeriFlux sites  Resulted in ~60 proposed papers –  Workshop highlighted the importance of biological/ecological data and consistent ancillary information (ecosystem classifications) Mandatory data: NEE/FC CO 2 /SFC U*/TAU Rg/PAR Ta H 2 O/RH/VPD

C-LAMP The Carbon-Land Model Intercomparison Project (C-LAMP) consists of an experimental protocol, model evaluation metrics, a prototype diagnostics package, model output standards, and a database of model simulation results on the Earth System Grid (ESG). See In the first set of runs, over 16ky of simulation and 50TB of output were generated using the Climate Science End Station INCITE allocation at ORNL. CLM3.1 (Community Land Model) combined with CASA´ (Carnegie-Ames-Stanford Approach) and CN (carbon & nitrogen) biogeochemistry modules were evaluated against best-available satellite- and ground-based measurements, and new runs are being used to evaluate CLM4 performance. C-LAMP will serve as a benchmarking prototype for Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) in conjunction with ESG. Randerson, J. T., F. M. Hoffman, P. E. Thornton, N. M. Mahowald, K. Lindsay, Y. H. Lee, C. D. Nevison, S. C. Doney, G. B. Bonan, R. Stöckli, C. C. Covey, S. W. Running, and I. Y. Fung. “Systematic Assessment of Terrestrial Biogeochemistry in Coupled Climate-Carbon Models.” Global Change Biology, in press.

AmeriFlux Data Are An Important Component of C-LAMP C-LAMP diagnostics include model comparisons with MODIS (Moderate Resolution Imaging Spectroradiometer) leaf area index (LAI) and net primary production (NPP), Globalview amplitude and phase, AmeriFlux Level 4 energy and carbon fluxes, Free Air CO 2 Enrichment (FACE) site measurements, and various estimates of carbon stocks and transient dynamics. Shown at right is a time series comparison of net ecosystem exchange (NEE), incoming shortwave, latent and sensible heat, gross primary production (GPP), and ecosystem respiration from CLM3.1-CN against measurements from the Morgan Monroe site. C-LAMP diagnostics must be run before any model changes to the CLM biogeophysics or biogeochemistry can be made.

13 Future Directions & Emphasis? Gap-filling meteorological data Biological data  QA/QC of existing submissions  Improved parameterizations for models  Expanding LeafWeb  Amassing key measurements (e.g., soil respiration) Flux re-analysis product within the ORNL SFA framework FY 2011 DOE BER “AmeriFlux Center” solicitation Collaborations with NEON