Brian Johnson and Doug Young

Slides:



Advertisements
Similar presentations
MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
Advertisements

Page 1GlobColour CDR Meeting – July 10-11, 2006, ESRIN All rights reserved © 2006, ACRI-ST Resulting Technical Specification.
Landsat Downloads & MODIS Downloads Data Sources for GIS in Water Resources by Ayse Kilic, David R. Maidment, and David G. Tarboton GIS in Water Resources.
LP DAAC Status MODIS Science Team Meeting April , 2014 Chris Doescher, PMP LP DAAC Project Manager Dr. David Meyer.
Harlan Shannon Meteorologist U.S. Department of Agriculture Office of the Chief Economist World Agricultural Outlook Board Washington D.C., U.S.A. An Overview.
2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.
Christine White, Esri Growing OPeNDAP Support: Current ArcGIS Workflows and Future Directions Christine White, Esri
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
Satellite Cross comparisonMorisette 1 Satellite LAI Cross Comparison Jeff Morisette, Jeff Privette – MODLAND Validation Eric Vermote – MODIS Surface Reflectance.
C. Mattmann 1, C. Goodale 1, J. Kim 2, D.E. Waliser 1,2, D. Crichton 1, A. Hart 1, P. Zimdars 1 and Peter Lean* The International Workshop on CORDEX-East.
An HDF-EOS DataBlade using Informix’s Object- Relational Database Renu ChaudhryECOlogicwww.ecologic.net.
ORNL DAAC Spatial Data Access Tool (SDAT): Internet tools to access and visualize land-based data National Aeronautics and Space Administration
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
2007 EOSDIS User Survey Carol Boquist ESDIS Outreach Manager Science Operations Office 11/7/2007 Carol Boquist ESDIS Outreach Manager Science Operations.
MODIS Data at NSIDC MODIS Science Team Meeting – Jan 27, 2010.
Global map layers Additional global data sets such as Hydrology data (Hydrosheds), new and updated Landcover data (Globcover), demographic data and others.
MODIS Land Product Subsets Suresh K. Santhana Vannan, Robert B. Cook, Bruce E. Wilson, Lisa M. Olsen HDF and HDF-EOS Workshop XII October 15 – October.
HDF & HDF-EOS Workshop VIII 2004 October Aurora, CO Bruce Beaumont, Matt Smith, Helen Conover, Sara Graves Subsetting at UAH.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
An Adaptive Management Model for the Red River Basin of the North.
ORNL DAAC MODIS Subsetting and Visualization tools Tools and services to access subsets of MODIS data Suresh K. Santhana Vannan National Aeronautics and.
ESDIS Project Status 11/29/2006 Dan Marinelli, Science Systems Development Office.
Soil and Water Conservation Modeling: MODELING SUMMIT SUMMARY COMMENTS Dennis Ojima Natural Resource Ecology Laboratory COLORADO STATE UNIVERSITY 31 MARCH.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
LDOPE QA Tools Sadashiva Devadiga (SSAI) MODIS LDOPE January 18, 2007.
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
CEOS Data Cube Open Source Software Status Brian Killough CEOS Systems Engineering Office (SEO) WGISS-40 Harwell, Oxfordshire, UK September 30, 2015 (remote.
ORNL DAAC: Introduction Bob Cook ORNL DAAC Environmental Sciences Division Oak Ridge National Laboratory.
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
TerraPop Mission Enabling research, learning, and policy analysis by providing integrated spatiotemporal data describing people and their environment.
AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC June 2011.
Metadata Framework for a Statistical Data Warehouse
A WEB-ENABLED APPROACH FOR GENERATING DATA PROCESSORS University of Nevada Reno Department of Computer Science & Engineering Jigar Patel Sergiu M. Dascalu.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
ORNL DAAC MODIS Land Product Subsets 1 Suresh K. Santhana Vannan, Robert B. Cook, Bruce E. Wilson, Lisa M. Olsen Environmental Sciences Division, Oak Ridge.
A WEB-ENABLED APPROACH FOR GENERATING DATA PROCESSORS University of Nevada Reno Department of Computer Science & Engineering Jigar Patel Sohei Okamoto.
Earth Science Data and Information System (ESDIS) Project Update Jeanne Behnke, Deputy Project Manager for Operations NASA Earth Science Data & Information.
REMOTE SENSING FOR VEGETATION AND LAND DEGRADATION MONITORING AND MAPPING Maurizio Sciortino, Luigi De Cecco, Matteo De Felice, Flavio Borfecchia ENEA.
U.S. Department of the Interior U.S. Geological Survey July 2014 OPeNDAP Services – Present and Future at LP DAAC Brian Davis 1, Rob Quenzer 1, Jason Werpy.
Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.
Big Data Analytics and HPC Platforms
Product Designer Hub – Taking HPD to the Web
Microwave Radiometer Processing for Carbon in the Arctic Reservoirs Experiment (CARVE) Nick Steiner1 1 - Advanced Science Research Center, City University.
Delivery of Science Components to NRCS Business Applications
OVirt Data Warehouse 02/11/11 Yaniv Dary BI Software Engineer, Red Hat.
NASA JPL Drought Project Kickoff Meeting
Standardization Promotes Biogeochemical Data Management and Use in Multidisciplinary Environmental Research Yaxing Wei, Suresh Vannan, Robert B. Cook,
EOS ClearingHOuse Robin Pfister Code 423, NASA/GSFC
NASA NSIDC DAAC Metrics
VegDRI History, Current Status, and Related Activities
Improving Data Access, Discovery, and Usability
Getting to and Using our Data
Efficiently serving HDF5 via OPeNDAP
Amanda Leon ESIP Summer 2017
A Web-enabled Approach for generating data processors
NSIDC DAAC UWG Meeting August 9-10 Boulder, CO
CyberGIS: Reston, VA, September 22, 2018
“Operation IceBridge, CryoSat-2, ICESat”
NASA Earthdata Login Andrew Mitchell - NASA WGISS-44 Beijing, China
DECISION SUPPORT TOOLS Draft For Discussion Purposes
NASA NSIDC DAAC Metrics
Using the Microsoft AI Platform for next generation applications
Quoting and Billing: Commercialization of Big Data Analytics
VIFI : Virtual Information Fabric for Data-Driven Discovery from Distributed Fragmented Repositories PI: Dr. Ashit Talukder Bank of America Endowed Chair.
Open Data Cube Demo and FDA Interfaces
Roadmap and short term activities on interoperability of Data Cubes
Presentation transcript:

Brian Johnson and Doug Young NSIDC Jupyter Hub prototyping Part of the Cross-DAAC Cloud Analysis Toolkit to Enable Earth Science (CATEES) Brian Johnson and Doug Young

CATEES Overview – cloud prototyping activity Objectives Provide easy-to-use tools for working with EOSDIS data Provide tools in a convenient package to users Show users how to access EOSDIS API via scripts Show users how use analytics optimized cloud storage for analysis Demonstrate cross-EOSDIS development Approach Python Software + Other Materials Library routines (open-source and DAAC-contrib) Interdisciplinary Use Case examples Data (links + local) Sample IPython Notebooks Deploy to cloud for usage Develop Process for joint development

CATEES Roadmap

Status – NSIDC example in GHRC Jupyter Hub Sample Code: Visualize the digital SAR mosaic and elevation map of the Greenland icesheet (Bruce Raup, Paul Madden, Doug Young; NSIDC)

Cross-DAAC example Goal: Provides a “science” analytics” example that integrated data sets from more than on DAAC and extensible to other data sets, analyses and larger domains (i.e. analytics at scale) Approach: Build a Jupyter notebook that contains 5 fundamental “building blocks” (or functional elements) that address a common science workflow, e.g. Get data from 3 differnet sources (“connectors”) Access the data (“extract”) Prepare the data (subset, regrid, bin, …) Run a simple correlation analysis Display the results

Science use case How do different vegetation communities respond to long-term changes in water availability in Colorado? Expect vegetation productivity (growth) to respond to long-term trends in soil moisture Want to evaluate spatial and temporal relationships between: Soil moisture Vegetation greenness Ecoregions

Data products SMAP soil moisture (SPL2SMP) NSDIC DAAC: HDF 5, OPeNDAP access MODIS Veg. Indices (MOD13A2) LP DAAC: HDF-EOS, OPeNDAP Precipitation (Daymet) ORNL DAAC: netCDF-4, HTTP or THREDDS Ecoregion map for Colorado SMAP 36-km soil moisture MODIS NDVI composite DAYMET daily precip map

Data prep • Re-gridded the four data sets; user specified projection • Extract Same extent (state of Colorado) • Integrated data with different resolution

Analysis

Benefits for users