AgMIP Data Aggregator: Leveraging Globus Online and HUBzero To Make Global Spatial Data Accessible Lan Zhao, Carol X. Song, Nelson B. Villoria, Hongjun.

Slides:

Advertisements

Similar presentations

© 2006 Open Grid Forum GGF18, 13th September 2006 OGSA Data Architecture Scenarios Dave Berry & Stephen Davey.

Advertisements

Regional Impact Assessment AgMIP SSA Kickoff Workshop John Antle AgMIP Regional Econ Team Leader 1 Accra, Ghana Sept

INSPIRE - how to use? Spatial data from diverse data sources INSPIRE and reporting data flows Example: spatial data sets related to MSFD, water and INSPIRE.

AgMIP SSA Meeting Accra, Ghana 12 September, 2012 Importing and translating crop model data.

Unveiling ProjectWise V8 XM Edition. ProjectWise V8 XM Edition An integrated system of collaboration servers that enable your AEC project teams, your.

Southern Africa Agricultural Model Intercomparison and Improvement Project (SAAMIIP)

GEOSHARE: Thoughts on Institutional Design David I Gustafson, Ph.D. Director, CIMSANS ILSI Research Foundation 10 September.

Planetary Orthomorphic Projection & Dimensional Representation A 3 dimensional orthomorphic projection for easy navigation.

International Model for Policy Analysis of Agricultural Commodities and Trade (IMPACT Model) IMPACT Development Team.

1 Lightning Products and Services at NOAA’s National Climatic Data Center Steve Ansari, Stephen Del Greco, Neal Lott (NOAA / NCDC)

Venkatesh Merwade, Purdue University

1 Introducing IMPACT 3: Modeling Philosophy and Environment Sherman Robinson Daniel Mason-D’Croz Shahnila Islam.

Climate Change Impacts on Food Security in 2050: An application of the GEOSHARE AgMIP Tool Uris Baldos Purdue University September 2014.

Modeling and Forecasting Climate Change, Biophysical Impacts, and Ecological and Economic Implications: Discussion John Antle Agricultural and Resource.

AGRO II MODEL AUTOMATIC TOOL FOR LIBERALISATION SCENARIOS SIMULATION Marseille, 4-6 December, 2003.

Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.

Project Implementation for COSC 5050 Distributed Database Applications Lab1.

Global Futures and Strategic Foresight and the IMPACT Model Keith Wiebe International Food Policy Research Institute Workshop on Integrating Biodiversity.

Minerva Infrastructure Meeting – October 04, 2011.

Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.

Enterprise Object Framework. What is EOF? Enterprise Objects Framework is a set of tools and resources that help you create applications that work with.

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

Cyberinfrastructure for an Open, Collaborative GEOSHARE Community Carol Song, Ph.D. Rosen Center for Advanced Computing Purdue University GEOSHARE Post-Pilot.

CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:

Cyber-Infrastructure for Agro-Threats Steve Goddard Computer Science & Engineering University of Nebraska-Lincoln.

Implementation of HUBzero as a Knowledge Management System in a Large Organization HUBBUB Conference 2012 September 24 th, 2012 Gaurav Nanda, Jonathan.

Tradeoff Analysis: From Science to Policy John M. Antle Department of Ag Econ & Econ Montana State University.

Enabling computational modeling and geospatial data analysis through HUBzero Venkatesh Merwade, Lan Zhao, Carol Song Purdue University Hubbub2013, September.

WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.

SeLeNe - Architecture George Samaras Kyriakos Karenos Larnaca – April 2003 THE UNIVERSITY OF CYPRUS.

CropScape Demo Innovations to Minimize Crop Loss in a Changing Climate Rick Mueller National Agricultural Statistics Service February 24, 2012.

National Earth Science Infrastructure Program AuScope Limited Headquarters School of Earth Sciences University of Melbourne Victoria 3010 Tel

Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.

ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.

Use of Hierarchical Keywords for Easy Data Management on HUBzero HUBbub Conference 2013 September 6 th, 2013 Gaurav Nanda, Jonathan Tan, Peter Auyeung,

Tradeoff Analysis and Minimum-Data Modeling John Antle Jetse Stoorvogel Workshop on Adaptation to Climate Change, Nairobi September

The New Zealand Institute for Plant & Food Research Limited Use of Cloud computing in impact assessment of climate change Kwang Soo Kim and Doug MacKenzie.

Federated Database Set Up Greg Magsamen ITK478 SIA.

06/21/2012 Aggregations of spatial information for data dissemination.

Leveraging Globus Services to Support Climate Model Data Access Through the Earth System Grid Federation (ESGF) Brian Knosp 1, Luca Cinquini 1, Lukasz.

Jian Gui WANG New Implementation of Agriculture Models APAN19---Jan New Implementations of Agriculture Models Using Mediate Architecture.

GIS data sources; catalogs of data and services. USGS: National Mapping.

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs (SEEK), EAR (GEON), DOE DE-FC02-01ER25486.

Prices and Prospects for Global Food Security Keith Wiebe International Food Policy Research Institute USDA Agricultural Outlook Forum Arlington, VA February.

Geoshare Workshop Purdue, 11 Sep 2014 What Geoshare may do for us Hermann Lotze-Campen.

Geospatial, Open-Source Hosting of Agriculture, Resources and Environmental Data Pilot Project Overview & Lessons Learned Presented by Thomas Hertel Purdue.

Upcoming ESPON Tools ESPON Seminar November 2010.

GEOSS Benefit Assessment M. GEOBENE team(2006-9) PEOIC - Assessing the Impact of Satellite EO on Society and Policy 9 th November 2015.

Research & Development Building a science foundation for sound environmental decisions Remote Sensing Information Gateway (RSIG)

Broadening Access to Geospatial Capabilities Carol Song, Larry Biehl, Rosen Center for Advanced Computing Venkatesh Merwade, School of Civil Engineering.

FRErator – the Bridge between FRE and Curator DB.

U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.

ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.

IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.

FDSN WG III Coordination of Products, Tools and Services Tuesday 13 January :00-18:30.

Prepare for the Possibility: Response and Recovery Steve Goddard Computer Science & Engineering University of Nebraska-Lincoln.

5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.

The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.

GAEZ Data Portal Background AEZ methodology and tools GAEZ Data Portal Features Next Steps Content.

1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.

Parag Mhashilkar (Fermi National Accelerator Laboratory)

CLIMATE CHANGE KNOWLEDGE PRODUCTS Climate Change Team - Environment Department.

2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)

SLCP Benefits Toolkit:

Case Study – Swiss Manufacturing Giant in robotics based power and automation Background: ABB is a multinational corporation headquartered in Zurich, Switzerland,

Coordination of Products, Tools and Services

Emulators of Irrigated Crop Yields Provide an Efficient Approach for Understanding Multisectoral Water-Energy-Land Dynamics Objective: Develop statistical.

Presentation transcript:

AgMIP Data Aggregator: Leveraging Globus Online and HUBzero To Make Global Spatial Data Accessible Lan Zhao, Carol X. Song, Nelson B. Villoria, Hongjun Choi, Steve M. Clark Purdue University

What is GeoShare? Geospatial Open Source Hosting of Agriculture, Resource & Environmental Data for Discovery and Decision Making Develop and maintain a freely available, global, spatially explicit database on agriculture, natural resources, and the environment accompanied by analysis tools and training programs for scientists, decision makers, and development practitioners

The AgMIP Data Initiative Agricultural Modeling Intercomparison and Improvement Project To improve models used for analysis of climate impacts on agriculture Fast-track multi-model multi-sector climate impact assessment (part of ISI-MIP/AgMIP):  7 Crop Models  5 Global General Circulation Models  5 Representative Climate Pathways (RCPs)  CO2 Fertilization and irrigation  12 Crops  All the combinations ran from 1971 to , x0.5 0 grids with crop yields isimipgo#us-archive

The Challenges

lpj-guess_hadgem2-es_hist_ssp2_co2_noirr_aet_mai_annual_1971_1980.nc4 Total Number of Pixels = 259, Channels 360 lines, 720 columns 10 ascii files aggregated to country level

The Challenges Data discovery ▫Difficult to navigate and locate data Data download ▫Globus Connect Data processing ▫Netcdf4 format, 5-10 year slices Data storage

AgMIP Data Aggregator Integrate Globus Online into HUBzero ▫Globus connect end point on the web server ▫Service wrapper to globus client commands $ submit isimiptransfer –help Usage: isimiptransfer.py [huboptions] Options: -h, --help show this help message and exit -l DIRREQUESTS, --ls=DIRREQUESTS --lsroot -g GETREQUESTS, --get=GETREQUESTS ▫Can be extended to connect to other end points

AgMIP Data Aggregator

Easy to use user interface to select data to download Integrate with HUBzero GO service at the backend R script to aggregate the AgMIP output to any user defined levels using different functions Map Visualization Metadata

Use Case Climate change impacts on food security in 2050 by Uris Baldos ▫Climate impact on yield scenarios:  Crop model: PEGASUS  GCMs: MIROC-ESM-CHEM, GFDL-ESM2M  No CO2 fert./RCP8p5 pessimist vs. CO2 fert./RCP2p6 optimist ▫SIMPLE: an economic model of agriculture ▫Change in crop prices, caloric consumption, caloric malnutrition headcount in 2050 Courtesy of Uris Baldos, Purdue University

Use Case All done in less than an hour! Food Consumption Malnutrition Count “Optimist”: Lowest RCP (2.6) + CO2 fertilization “Pessimist”: Highest RCP (8.5) + no CO2 fertilization Courtesy of Uris Baldos, Purdue University

Future Work Work with the GABBS project to develop geospatial building blocks ▫GlobusOnline data transfer ▫Geospatial data aggregation ▫Publish/share model output ▫Geospatial data driven modeling workflows

GeoShare hub: AgMIP tool: gmip gmip AgMIP: