Paul Stackhouse, NASA LaRC

Slides:



Advertisements
Similar presentations
Conversion of CPC Monitoring and Forecast Products to GIS Format Viviane Silva Lloyd Thomas, Mike Halpert and Wayne Higgins.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Connecticut State Data Center at the Map and Geographic Information Center - MAGIC Connecticut State Data Center Data Collaborator for Planning, Analysis,
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
NASA Derived and Validated Climate Data For RETScreen Use: Description and Access Paul Stackhouse NASA Langley Research Center Charles Whitlock, Bill Chandler,
Christine White, Esri Growing OPeNDAP Support: Current ArcGIS Workflows and Future Directions Christine White, Esri
U.S. Department of the Interior U.S. Geological Survey NWIS Web Services Snapshot for ArcGIS Sally Holl and David Maltby Based on work by David McCulloch.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
Sharing imagery and raster data in ArcGIS
National Park Service U.S. Department of the Interior Resource Information Management Division National Information Services Center Office of the Chief.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.
, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
CEOS WGISS May 2006 NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
material assembled from the web pages at
Achieving Interoperability using the ArcGIS Platform
Enabling High-Quality Printing in Web Applications
Enhanced Parcel Queries in Kansas Kristen Jordan.
DELIVERING ENVIRONMENTAL WEB SERVICES (DEWS) Partners: UK Met Office (Lead Partner), British Atmospheric Data Centre (BADC), British Maritime Technology.
Integrated Grid workflow for mesoscale weather modeling and visualization Zhizhin, M., A. Polyakov, D. Medvedev, A. Poyda, S. Berezin Space Research Institute.
Expanding NASA’s Surface meteorology and Solar Energy (SSE) Data Access and Analysis Capabilities GEO XII – AIP-8 Results 09 November 2015 Paul W. Stackhouse,
ESIP Meeting, Winter 2016 Jan 6-8
What’s new at ArcGIS for INSPIRE Roberto Lucchi Guenther Pichler.
Google Analytics Graham Triggs Head of Repository Systems, Symplectic.
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
Interactive Geospatial Analysis with SAS Portal Falko Schulz Senior Technology Presales Consultant SAS Institute Australia.
COINAtlantic Expanding OBIS Canada partnerships and Visualizing OBIS Canada IPT Resources SG-OBIS-V May 25 – 27, 2016 UNESCO/IOC Project Office for IODE.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 STAR Enterprise Synthesis.
ECoastal Training USACE Coastal CoP Meeting and Workshop eCoastal in a Nutshell: An Introduction to the eCoastal Program & Custom Applications Rose Dopsovic.
Intermountain West Data Warehouse - Western Air Quality Study
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Product Designer Hub – Taking HPD to the Web
Data Browsing/Mining/Metadata
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Zhong Liu George Mason University and NASA GES DISC
Data Are from Mars, Tools Are from Venus
Climate Monitoring Tools High Plains Regional Climate Center
ArcGIS Workflow Manager: Advanced Workflows and Concepts
of Analytics, WiFi and Experiences for Retailers
Standardization Promotes Biogeochemical Data Management and Use in Multidisciplinary Environmental Research Yaxing Wei, Suresh Vannan, Robert B. Cook,
Amazon Storage- S3 and Glacier
MERRA Data Access and Services
Network Analysis with ArcGIS Online
CUAHSI HIS Sharing hydrologic data
Improving Data Access, Discovery, and Usability
Modernization of Navigation Statistics Publishing
Power BI – Exploring New Frontiers
Nimble Streamer Helps Media Content Providers Create Streaming Networks Cost-Effectively and Easily by Utilizing Azure’s Worldwide Scalability MICROSOFT.
Accessing Spatial Information from MaineDOT
HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.
KISTERS TimeSeries HUB
Future Data Architecture Cloud Hosting at USGS
Power BI – Exploring New Frontiers
Yellowfin: An Azure-Compatible Business Intelligence Platform That Connects People with Their Data for Better Decision Making MICROSOFT AZURE APP BUILDER.
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Future Data Architectures Big Data Workshop – April 2018
NWS GIS/Geospatial Project Lead
EnMS Polska Builds energyBIS on Microsoft Azure to Ensure a Scalable and Secure Energy Efficiency Monitoring and Management System MICROSOFT AZURE ISV.
CEE 6440 GIS in Water Resources Fall 2004 Term Paper Presentation
Keep Your Digital Media Assets Safe and Save Time by Choosing ImageVault to be Your Digital Asset Management Solution, Hosted in Microsoft Azure Partner.
Abiquo’s Hybrid Cloud Management Solution Helps Enterprises Maximise the Full Potential of the Microsoft Azure Platform MICROSOFT AZURE ISV PROFILE: ABIQUO.
Web AppBuilder for ArcGIS
School Districts Can Analyze and Report on Data Across Multiple Systems with EdWire, a Powerful Integration Solution that Utilizes Microsoft Azure MICROSOFT.
Tile layers, map image layers, and on-premises Web GIS
Power BI – Exploring New Frontiers
ArcGIS Online – The Road Ahead
Publishing image services in ArcGIS
Introduction to Portal for ArcGIS
ArcGIS Pro: An Introduction Overview
Presentation transcript:

Making NASA Data Sets Available with GIS-based Web-Applications for Energy: POWER/SSE v8 Paul Stackhouse, NASA LaRC Jason Barnett and Tyler Bristow, Booz-Allen-Hamilton at NASA LaRC William Chandler*, James Hoell, and David Westberg, SSAI at NASA LaRC And the Atmospheric Science Data Center * In memoriam to William S. Chandler, principle web developer for early versions SSE/POWER

POWER Overview Objectives: Improve the Nation’s public/private capability for integrating environmental data from NASA research to support increased renewable energy development, building energy efficiency and agricultural modeling. Goals: Through partnerships, derive/validate/provide parameters relevant to industry needs, link to decision support, and transition capabilities when possible. Website: http://power.larc.nasa.gov 10/10/17 ASES Solar 2017

Current POWER/SSE Renewable Energy Data Products Old POWER (SSE v6) Achievements: 22 Years (1ox1o, climatology) Over 200 parameters, many on the fly, customized for renewable energy Daily time series via Sustainable Buildings and Agroclimatology Data quality information Direct connection to 2 energy DSS tools SSE usage: >27 Million data requests fulfilled for v 6.0 Approx: 275K hits, 200K downloads, 4-6 GB and 15K users per month Data requests from 215 nations, islands and territories in 2017 alone Issues: Data sets becoming outdated Data served only in ASCII format Data backend production not scalable; requires a complete rewrite to reprocess Original graphics no longer supportable due to software and security issues http://eosweb.larc.nasa.gov/sse 10/10/17 ASES Solar 2017

New POWER/SSE (v8, GIS) Expands Accessibility with Web Services POWER Applied Science project aims to make NASA data more accessible Website is a Responsive Platform for Desktop, Tablet, and Smartphone New POWER Website serves as a platform for discovery of multiple data access points Updated data sets with future updates more easily implemented, documented and validated POWER web site now in beta: power.larc.nasa.gov/new 10/10/17 ASES Solar 2017

POWER (v8, GIS): From Data Source to User MERRA 2 Native meteorological model data is ingested and processed on a recurring cycle and stored. A A GEOS 5.12.4 1 Native solar model data is ingested on a recurring cycle and averages greater than daily are processed and stored. B 1 3 Data is served to users via Custom Python API utilizing OPeNDAP and Esri ArcGIS Server (Image Services). 2 2 SRB 3.0 3 Users can access the data in commercial and custom applications via Desktop, Tablet and smartphone technologies. B CERES FLASHFlux 2H-3C Native Gridded Model Data Data Not Distributed* Data Distributed Data Stored Recurring Python Scripts Server with Enterprise GeoDatabase Web Server Users Access On Responsive Platform * Data may become available in future depending on resources and user requirements. Icons Source: http://www.flaticon.com (Creative Commons 3.0)

POWER (v8 GIS): Two Main Data Accessibility Options 10/10/17 ASES Solar 2017

POWER (v8, GIS): Interactive Data Access Viewer Graphical Data Access - ½ x ½ deg; within 5-7 days of obs - multiple parameters from FLASHFlux, GMAO, etc. available - parameters arranged by application community (i.e., renewable energy, buildings, agroclimatology) - Multiple data output formats Three Applications (initial version): - Time series at a single point (daily, monthly, up to 30 years*) - Regional times series (limited area) - Global climatology (30 year*) (* initially 30 years for surface meteorology; 22 years for solar) 10/10/17 ASES Solar 2017

POWER (v8, GIS): Interactive Data Access Viewer Single Point Time series Select community Select daily, monthly or climatology Select location Select time period Select output format Select parameter 10/10/17 ASES Solar 2017

POWER (v8, GIS): Interactive Data Access Viewer Regional Data Access Select community Select daily, monthly or climatology Select region (limited to 2.5ox2.5o) Select time period Select output format Select parameter Global Climatology Select community Select output format Select parameter (Currently 30 year average for met/22 for solar) 10/10/17 ASES Solar 2017

POWER (v8, GIS): ArcGIS Image Services (future) Future Image Services Plan to migrate current SSE-GIS capabilities (see https://asdc-arcgis.larc.nasa.gov/sse/ OGC compliant (opensource) Includes all available parameters for climatological values Background maps with support for image tools Time series slider and swiping tools, etc. 10/10/17 ASES Solar 2017

POWER (v8, GIS): Accessing Data with API Service Complete instructions to setup up URL based data access (API using OPeNDAP) Provide immediate access to the data parameters and time periods required Returned file formatted for general software (Excel, GRaDs, MatLab) or customized script/coding for Decision Support Tools (RETScreen, HOMER) 10/10/17 ASES Solar 2017

POWER (v8, GIS): Usage tracking with Google Analytics and Log file analysis 10/10/17 ASES Solar 2017

POWER (v8, GIS): Enabling Data Usage Applications Visualization & Analysis Panoply (Image display) NetCDF, OPeNDAP Esri ArcGIS Suite (GIS applications) NetCDF, OPeNDAP, ArcGIS Image Services, ArcGIS GP Services, ArcGIS Toolbox, GeoTIFF, Shapefile MatLab/GRaDS (analysis & graphics) Netcdf, OPeNDAP, GeoTiff QGIS/MapBox/Leaflet (GIS and mapping) OGC Web Map Service, OGC Web Process Service, GeoTIFF DSSAT (crop modeling standards) ICASA format Microsoft Office CSV, ASCII R Statistics NetCDF, CSV ERDAS Imagine NetCDf, GeoTiff Supported Programming Python Esri ArcGIS for Python API, ArcGIS Image Service REST Endpoint, ArcGIS Toolbox Functions, OPeNDAP, ArcGIS GP Services, JSON, CSV, Shapefile, GeoTIFF, NetCDF JavaScript Esri ArcGIS For JavaScript API, ArcGIS Image Services, ArcGIS GP Services, JSON, CSV Microsoft .NET ArcGIS Runtime SDK for .NET, ArcGIS Image Services, ArcGIS GP Services, JSON, CSV 10/10/17 ASES Solar 2017

POWER (v8, GIS): Continued Solar Irradiance Parameter Improvement & Validation POWER (v8): Uses SRB Rel 3 with CERES FLASHFlux (replicated to ½o x ½o) Supersede FLASHFlux with CERES SYN1Deg Supersede Direct/Diffuse using improved DirIndex POWER (v9): First hourly data set 30+ years: Supersedes SRB Rel 3, 1o x 1o with Rel 4 at true ½ o x ½ o (late 2018) 10+ year: CERES SYN1Deg only 1ox1o data set with MERRA-2 (hourly, early 2019) 10/10/17 ASES Solar 2017

POWER (v8, GIS): Continued Meteorological Improvement and Validation Using NOAA GSOD Sites Source data NASA GMAO MERRA-2 compared to NOAA GSOD (Sites: 1981-2014, every 3rd year) GMAO data sets updated as new versions become available Tmean Tmin Tmax Tdpt 10/10/17 ASES Solar 2017

Summary and Conclusions Data Access Viewer: Point, regional and global data access Multiple solar related and meteorological parameters available Output formats including: ASCII, CSV, netCDF, GeoJSON, and GeoTiff Specialized formats including ICASA for crop modeling Support now provided for multiple propriety and Opensource GIS, web mapping and data analysis tools through OGC compliance POWER (v8) web site represents a complete revitalization of old SSE web site (now in Beta): New data set from NASA GMAO MERRA-2 Climatological and time series available using CERES data Data accessible through: Data Access Viewer: GIS based web applications Web data services: provision through API and GeoJSON queries Try it in Beta at: https://power.larc.nasa.gov/new 10/10/17 ASES Solar 2017

Extras 10/10/17 ASES Solar 2017

Historical SSE User Statistics by Version Data Requests Web Hits Data Volume (GB) Unique Users 10/10/17 ASES Solar 2017