Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.

Slides:



Advertisements
Similar presentations
ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
Advertisements

WTF-CEOP JAXA Prototype Demo (Coordinated Energy and water cycle Observation Project) May 23, 2007 Satoko Horiyama MIURA – JAXA Ben Burford - RESTEC.
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Coordinated Enhanced Observing Period (CEOP) CEOP HP : EOP-1 EOP-2 EOP-3 EOP-4.
Coordinated Enhanced Observing Period (CEOP) an Element of WCRPinitiated by GEWEX EOP1: Jul.-Sep EOP3: Oct Sep
CEOP Centralized Data System and integrated analysis tools Kenji Taniguchi 1), Toshihiro Nemoto 2), Eiji Ikoma 3), Masaki Yasukawa 2), Toshio Koike 1)
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
SMOS SAG, Villafranca November 2-3, 2006 Development of a Global In-Situ Soil Moisture Network: A SMOS Project Contribution P.J. van Oevelen.
CEOS/WGISS # 21 、 Budapest, May 8-12, WTF-CEOP Project status May 11, 2006 Osamu Ochiai - JAXA Ben Burford - JAXA/RESTEC.
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.
CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.
1 Closing Report on WTF-CEOP Project Team Satoko Horiyama MIURA/JAXA.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
CEOS WGISS May 2006 NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.
CEOP Coordinated Energy and water cycle Observation Project May 14, 2007 Ryousuke Shibasaki – UT Ben Burford - RESTEC.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
Pakorn Apaphant, Ph.D. May 18, 2010 WGISS 29, Bonn, Germany Data Democracy.
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
Anticipated Outcomes from CEOS WGs in 2010 Strategic Discussion on what the WGs should seek to achieve 1 23 rd CEOS Plenary I Phuket, Thailand I 3-5 November.
Architecture Renovation Yoshiyuki Kudo (JAXA) WGISS-37.
Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.
Coordinated Enhanced Observing Period (CEOP) an Element of WCRPinitiated by GEWEX EOP1: Jul.-Sep EOP3: Oct Sep
WTF-CEOP Project Task Team JAXA Prototype status May 21, 2007 Satoko Horiyama MIURA - JAXA.
Tsukuba, Japan, May 11 – May 15, 2015 CEOS Water Portal Overview and Status Update WGISS-39 Tsukuba, Japan JAXA Shinichi SEKIOKA RESTEC Kaori.
CEOS/WGISS # 20 、 SG#19, Kiev – Sep 12-16, WTF-CEOP Project Status Sep. 12th, 2005 Osamu Ochiai, Ben Burford / JAXA Ken McDonald, Yonsook Enloe.
ICOADS: Update Status and Data Distribution Steven J. Worley Scott D. Woodruff Sandra J. Lubker Ziahua Ji J. Eric Freeman NCAR, NOAA/ESRL, NOAA/NCDC CLIMAR-III,
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
2010 WGISS Expected Outcomes Matha Maiden and Pakorn Apaphant Oct 2, 2009 WGISS 28 Pretoria, South Africa.
Global Model NWPCs/ACs NCEP,JMA ECPC,BoM UKMO,CMC ECMWF CPTEC NCMWF EPSON MET GMAO GLDAS Regional Model Land Surface Model/LDAS HAPHAP extreme webs aerosol.
What is CWIC? Authors: Doug Newman Andrew Mitchell
WGISS-40, Sep 28 – Oct 2, 2015 CEOS Water Portal Project Satoko Horiyama MIURA Space Applications and Operations Center (SAOC) JAXA 0.
APEC Climate Center Data Service System Chi-Yung Francis Tam APCC.
CEOS WGISS Status: Report to Plenary Martha E. Maiden, Chair Pakorn Apaphant, Vice-Chair Phuket, Thailand November 3 - 4, 2009.
NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.
WA-06-05:  Title: Initiate the creation of a coordination mechanism within GEO for global in-situ water observations, including ocean observations, and.
WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
GEOSS ADC GEO Task DA Data Integration and Analysis System Ken McDonald NOAA/NESDIS for: T. Koike, R. Lawford, S. Miura….
G S F C E a r t h S c i e n c e s D i v i s i o n S e p t e m b e r 7, David Herring Presentation.
Coordinated Enhanced Observing Period (CEOP) an Element of WCRPinitiated by GEWEX EOP1: Jul.-Sep EOP3: Oct Sep
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
Satellite & Model Product Evaluation Center (SPEC): A Software System Providing Ready Access To Co-located Data Subsets From Satellite, In-situ, and Model.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
1 Final Report on WTF-CEOP JAXA Prototype system Satoko Horiyama MIURA JAXA/Earth Observation Research Center.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.
AIRS/AMSU-A/HSB Data Subsetting and Visualization Services at GES DAAC Sunmi Cho, Jason Li, Donglian Sun, Jianchun Qin and Carrie Phelps, Code 902, NASA.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
1 WTF-CEOP Project Table of Contents 1. Overall Status : Satoko Miura [15 min] 2. JAXA Prototype System [30min] (1) Status: Satoko Miura (2) Demonstration:
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
1. Overview and Status Update (Satoko) : 10min 2. Demonstration (Yoshi) : 20min 3. New Architecture (Yoshi): 15min 4. Q&A, Discussion (All) : 15min 1.
The NOAA Operational Model Archive and Distribution System NOMADS CEOS-Grid Application Status Report Glenn K. Rutledge NOAA NCDC CEOS WGISS-19 Cordoba,
TOWARD CONVERGENCE DA-07-P6: Data Integration and Analysis System It is expected that there will be a large increase in the volume of Earth Observation.
A41I-0105 Supporting Decadal and Regional Climate Prediction through NCAR’s EaSM Data Portal Doug Schuster and Steve Worley National Center for Atmospheric.
OGC’s role in GEO: Results from the Architectural Implementation Pilot (AIP) George Percivall Open Geospatial Consortium GEO Task IN-05 Coordinator
PROJECTS & APPLICATIONS SUBGROUP
Global Precipitation Data Access, Value-added Services and Scientific Exploration Tools at NASA GES DISC Zhong Liu1,4, D. Ostrenga1,2, G. Leptoukh4, S.
MERRA Data Access and Services
DA Task Report Data Integration and Analysis System
CEOP/IGWCO Joint Meeting, Feb.28  March 4, University of Tokyo, Japan
AIP-6 Water Services CEOS Water Portal integrating with GEO DAB
WTF-CEOP Task Team Table of Contents
Presentation transcript:

Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo and JAXA of Japan Model Output Data Archiving Center at the World Data Center for Climate, Max-Planck Institute for Meteorology of Germany In-Situ Data Archiving Center at NCAR (National Center for Atmospheric Research) of USA Unique Capabilities

CEOP Reference Site Map

Coordinated Energy and water-cycle Observations Project Data Management Distributed- and Centralized- Data Integration Functions In-situ satellite model UCAR MPI UT/JAXA In-situ Computing Power Computing Power Distributed Integration Services GrADS/ DODS for Subsets GrADS/ DODS for Subsets GrADS/ DDDS for Subsets Centralized Integration Services

projects/ceop/dm/ INTEGRATED IN-SITU SATELLITE MODEL

Based on ISO Metadata Standards Design for Finding and Integrating data CEOP Metadata Design Meeting University of Tokyo, 1-2 November 2004

http//:earthobservations.org

Upload Meta Data Data Integration and Analysis System (DA-09-02a) Quality Control Data Provider (Observer) User Meta Data Registration Search with Metadata Data Download Document Generation from Meta Data Data Visualization ・・ Observation Data Meta Data Data Upload + (part of )Meta Data Observation Data Meta Data Data Quality Control Process Meta Data Post-QC Observation Data Input Meta Data Data DownloadSearch IFDocument GeneratorVisualization System Data Archiving Data Integration Web-based Data Archiving & Integration System Basic Information Observation Point Inf., Contact Person Inf., ……

Coordinated Energy and water-cycle Observations Project Data Management Distributed- and Centralized- Data Integration Functions In-situ satellite model UCAR MPI UT/JAXA In-situ Computing Power Computing Power Distributed Integration Services GrADS/ DODS for Subsets GrADS/ DODS for Subsets GrADS/ DDDS for Subsets Centralized Integration Services

17 WTF-CEOP Distributed Data Integration Services Spatial and Temporal Data Integration - In-situ, MOLTS, Satellite, Model Output Data location  Standalone physical location  Distributed sites reference by links Data types  Model output data  Insitu data  Satellite data Data sources Services  Metadata keyword search  Data value search  File format translation  Reprojection  Regridding  Data Interpolation Integrated datasets Multiple files from individual member datasets Spatial Temporal rectificati on Spatial Subsettin g Intercomparison Of Integrated Datasets

18 JAXA Prototype: “Distributed Data Integration Prototype System for CEOP ” Live Access Server (LAS) Ferret Web Browser NCAR Archive [In-situ] (U.S.) MPI Archive [MOLTS, Model Output] (Germany) CSDIC Archive [Satellite] (Japan) CEOP Data Archives WCS Server (satellite data) NASA Bridge WTF-CEOP: Phase 1 Prototype Users can access; (1)The data located in distributed archive centers (2)The data which is temporally and geospatially coordinated NASA Prototype: A bridge between DODS formatted data requests and OGC WCS servers OPeNDAP Interface Custom Interface

19 (i) Satellite Data 250 km x 250 km subset scenes, regridded to Lat/Lon grid, centered over the 35 in-situ data sites Band selection, period selection and download multiple scenes available (ii) In situ Data Four types of CEOP in-situ data from 35 Reference Sites Surface (19 variables), Tower (9 variables), Soil (temperature, moisture), Flux (Sensible Heat, Latent Heat, CO2, Soil Heat Flux) Download of QC flags available (iii) Model Output Data NWP – Numerical Weather Prediction data MOLTS – Model Output Location Time Series (time series at model grid point nearest center of in-situ data sites) Gridded Model Output – 2D/3D time series. JAXA Prototype: Phase 1 Status = Available Data =

20 AccessAccess data from distributed archive sites SelectSelect data type location (Reference Site, Station name) variable name height or depth time range (start time / stop time) See the data“See the data” plot view values on the screen Download NetCDF Ascii Spreadsheet format Registration (to satisfy CEOP data policy) JAXA Prototype: Phase 1 Status = Main Functions =

21 JAXA Prototype: Phase 1 Status =Examples= MOLTS data plot in time series Model Output data plot in 2D view Top Page Satellite data plot in 2D view In-situ data in NetCDF format with QC flags QC flags Observed Data Please visit and use our system at: Tutorial DVD

23 rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009 WGISS Way Forward – 2010 and beyond New CEOP for “Coordinated Energy and water cycle Observations Project” leveraging WTF-CEOP (successfully completed WGISS-26) – Supports Data Integration &Analysis System (DIAS) [DA-09-02a] – JAXA Lead, Prof Koike represents the user community – Leverage WTF-CEOP and identify additional data/datasets and services – Propose to develop Water Community of Practice Portal Contribution to Data Democracy to be enhanced with software packages and training, working closely with WEdu WGISS Report at CEOS Plenary in Phuket, November 3 - 4, 2009