MODELING CLIMATE CHANGE EFFECTS ON LAKES USING DISTRIBUTED COMPUTING

Slides:



Advertisements
Similar presentations
Holdings Management Overview
Advertisements

Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
GLEON Data Management Luke Winslow PASEO 3/18/09.
Bar|Scan ® Asset Inventory System The leader in asset and inventory management.
Linux Operations and Administration
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.
Operating Systems Operating System
Creating a Web Site to Gather Data and Conduct Research.
9 Chapter Nine Compiled Web Server Programs. 9 Chapter Objectives Learn about Common Gateway Interface (CGI) Create CGI programs that generate dynamic.
Overview of WEAP. Water Evaluation and Planning System WEAP A generic, object-oriented, programmable, integrated water resources management modelling.
CS 390 Unix Programming Summer Unix Programming - CS 3902 Course Details Online Information Please check.
How Do Forests, Agriculture and Residential Neighborhoods Interact with Climate? Andrew Ouimette, Lucie Lepine, Mary Martin, Scott Ollinger Earth Systems.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Project EDDIE: Lake Mixing Carey, C.C., J.L. Klug, and R.L. Fuller. 1 August Project EDDIE: Lake Mixing Module. Project EDDIE Module 3, Version 1.
240-Current Research Easily Extensible Systems, Octave, Input Formats, SOA.
COST 723 WORKSHOP – SOFIA, BULGARIA MAY 2006 USE OF RADIOSONDE DATA FOR VALIDATION OF REGIONAL CLIMATE MODELLING SIMULATIONS OVER CYPRUS Panos Hadjinicolaou.
How Do Forests, Agriculture and Residential Neighborhoods Interact with Climate? Andrew Ouimette, Lucie Lepine, Mary Martin, Scott Ollinger Earth Systems.
Part 4 Processing and saving data with CGI/Perl Psychological Science on the Internet: Designing Web-Based Experiments From the Ground Up R. Chris Fraley.
Application Software System Software.
L.T.E :: Learning Through Experimenting Using google-svn for MtM Docs Development Denis Thibault Version 3.2 Mar 12 th, 2009.
Linux Operations and Administration
Technical lssues for the Knowledge Engineering Competition Stefan Edelkamp Jeremy Frank.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
Advances in Support of the CMAQ Bidirectional Science Option for the Estimation of Ammonia Flux from Agricultural cropland Ellen Cooter U.S. EPA, National.
Wednesday NI Vision Sessions
Chapter 7: Using Network Clients The Complete Guide To Linux System Administration.
Take Your Data Analysis and Reporting to the Next Level by Combining SAS Office Analytics, SAS Visual Analytics, and SAS Studio David Bailey Tim Beese.
Emulating Volunteer Computing Scheduling Policies Dr. David P. Anderson University of California, Berkeley May 20, 2011.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
MIKADO – Generation of ISO – SeaDataNet metadata files
Hydromet Cloud Presentation
Macrosystems EDDIE: Climate change effects on lake temperatures
Ch 1 A Geographer’s World
Section 2.1 Section 2.2 Identify hardware
Development Environment
Andrew White, Brian Freitag, Udaysankar Nair, and Arastoo Pour Biazar
Processes and threads.
Working in the Forms Developer Environment
SPMS ACCOMMODATION MODULE
Automating Entering Data in WEAP and Scenario Analysis
Differentially Private Verification of Regression Model Results
Jeffery S. Horsburgh Utah State University
Getting Started with R.
A Simple, Fast Tropical Cyclone Intensity Algorithm for Risk Models
Spark Presentation.
Expanding and Scaling Lifemapper Computations Using CCTools
Module development was supported by NSF DEB and ACI
Make Links from your Baan System
T_C_N_L_G_ E D I D I E O Y O H I E B J I R E A A W.
PHP / MySQL Introduction
Computer Basics Section 2.1 YOU WILL LEARN TO… Identify hardware
Macrosystems EDDIE: Climate change effects on lake temperatures
Project EDDIE: Lake Mixing
NADSS Overview An Application of Geo-Spatial Decision Support to Agriculture Risk Management.
Macrosystems EDDIE: Getting Started + Troubleshooting Tips
Google Classroom Setting Up Your Class
Macrosystems EDDIE: Cross-Scale Interactions
Hydrologic Simulation Models
GeoFEST tutorial What is GeoFEST?
Hydromet Cloud Presentation
Chapter 2: The Linux System Part 1
Staying afloat in the sensor data deluge
Macrosystems EDDIE: Teleconnections
Macrosystems EDDIE: Climate change effects on lake temperatures
Environmental Monitoring: Coupling Function Calculator
Macrosystems EDDIE: Getting Started + Troubleshooting Tips
Leveraging ArcGIS Online Elevation and Hydrology Services
Macrosystems EDDIE: Getting Started + Troubleshooting Tips
Macrosystems EDDIE: Getting Started + Troubleshooting Tips
Web Application Development Using PHP
Presentation transcript:

MODELING CLIMATE CHANGE EFFECTS ON LAKES USING DISTRIBUTED COMPUTING This module was developed by Carey, C.C., S. Aditya, K. Subratie, and R. Figueiredo. 1 May 2016. Project EDDIE: Modeling Climate Change Effects on Lakes Using Distributed Computing. Project EDDIE Module 4, Version 1. http://cemast.illinoisstate.edu/data-for-students/modules/lake-modeling.shtml. Module development was supported by NSF DEB 1245707 and ACI 1234983. Names + background in experience in coding, computer science, modeling

Overview of today Short powerpoint overview of lake modeling and some background on the tools we will be working with Activity A: get a lake model to run! Activity B: develop a climate scenario, and see how your lake responds! Activity C: use distributed computing to run 100s of lake model simulations! ! To indicate enthusiasm for teaching

Lakes are changing worldwide… In response to altered climate, some regions are experiencing different temperature, precipitation, and wind conditions than in the past. Because of their position in the landscape and their thermal inertia, lakes can be powerful indicators of climate change.

How will climate change affect lake thermal structure? Overarching question: What is thermal structure?

What is lake thermal structure? Epilimnion Data from Lake Sunapee 2012 Thermocline Hypolimnion Lake Sunapee, NH, USA: data from Lake Sunapee Protective Association buoy, 2012

What are the drivers of thermal structure? Solar radiation Air temperature Wind Precipitation Inflow and outflow streams All of these factors will interact to control water temperature, thermocline depth, mixing, and more! Solar radiation, air temp, wind, precip, inflow and outflow streams Figure from Hipsey et al. (2014)

GLM: General Lake Model Authors: Matt Hipsey, Louise Bruce, and David Hamilton Location: http://aed.see.uwa.edu.au/research/models/GLM/ Overview: The General Lake Model (GLM) is an open-access model developed for simulating lake dynamics. It simulates vertical stratification and mixing and accounts for the effect of inflows/outflows, surface heating and cooling. GLM has been designed to be an open-source community model developed in collaboration with members of the Global Lake Ecological Observatory Network (GLEON) to integrate with lake sensor data. First developed in 2012

Figure from Hipsey et al. (2014)

Basic structure of the model You need to create a new folder (directory) on your computer. Within this folder, you will need: a meteorological CSV file (‘met file’) that forces the model: e.g., “met_hourly.csv” an ‘nml’ text file which acts as a ‘master’ script, any inflow/outflow CSV files that specify the temperature and flow rate of connected streams. For us, no inflows/outflows

Example met file

Example nml file

We will run this model in the R statistical environment R can run on different computer operating systems (PC, Mac, Linux) R is reproducible R is free(!) and easily downloadable R can run stats, make figures, and do a suite of different analyses in many disciplines Many packages for R to merge with other tools (such as GLM) The GLMr and glmtools packages allow you to run GLM directly from within R

GLM-associated R packages GLMr: holds the current version of the GLM model and allows you to run GLM on any operating system glmtools: has different functions for analyzing and plotting GLM output from GLMr Developed by Jordan Read and Luke Winslow Accessible at https://github.com/GLEON

Learning objectives of today’s module Set up and run the General Lake Model (GLM) in the R statistical environment to simulate lake thermal structure. Understand the structure and function of GLM configuration files, driver data, and output files. Modify the input meteorological data for one GLM model to simulate the effects of different climate scenarios on lake thermal structure. Interpret model output from GLM simulations to understand how changing climate will alter lake thermal characteristics. Use the GRAPLEr R package to set up hundreds of model simulations with varying input meteorological data, and run those simulations using distributed computing. Explore the application of distributed computing for modeling climate change effects on lakes.

Activity A With a partner: 1) Download the GLM files and R packages successfully onto your computer (work in pairs) 2) Migrate the GLM example files onto a new directory on your computer 3) Run the model and look at the thermal output 4) Examine how your model output compares to the observed field data for your lake

Activity B Develop a climate scenario for any region and explore how it will affect lake thermal structure Develop a hypothesis about how climate change may alter lake thermal structure Create a corresponding meteorological input file Run your model and examine the lake’s response: How does your scenario alter the temperature profile in your lake over time? How does the thermocline depth change? How does the timing of stratification and evaporation change? Compare the modeled output to the observed data Create a few figures to highlight your climate scenario and share with the class

Need ideas for a climate scenario? Check out climatedata.us Temperature & precipitation predictions for US across the year under different emission scenarios Check out maca.northwestknowledge.net Temperature, precipitation, wind, relative humidity, and shortwave radiation Go to “Get the Data”  “Design-Your-Own CSV point data”, then edit latitude/longitude coordinates and use drop down menus to choose scenarios and year of predictions

Activity C How do you run 100s of lake simulations quickly? Is there a more efficient way to submit and analyze lots of different simulations than editing met files manually? YES! = GRAPLEr An R package that allows you to create 100s of simulations, submit them to run via a suite of distributed computing tools, and then return the GLM output

GRAPLEr: a new R package Authors: K. Subratie, S. Aditya, S.S. Mahesula, R. Figueiredo, C.C. Carey, and P.C. Hanson Creates offsets for GLM met file variables (e.g., add +2oC to all temperature values in a met file), submit the jobs via a Web service to run on other computers, and then analyze the output See: github.com/GRAPLE/GRAPLEr/wiki

What is distributed computing? A model of computing where multiple networked computers work together towards a single problem, dividing the problem into many parts that are solved by different computers. The GRAPLEr Web service divides the problem into many parts, HTCondor dispatches them to be solved by different computers, and IPOP provides the network.

GLM in your computer nml, csv You Output.nc files (keyboard) file get variables, plot configure nml, csv files You (keyboard) Output.nc file R GLM run

GRAPLEr Enter distributed computing: Objective: to run 100s to 1000s of GLM jobs Take each GLM run and dispatch to a different computer across the Internet Shorten execution times for large numbers of runs (e.g., climate change offsets) Distributed computing is not easy - but GRAPLEr makes it easy for you Can submit jobs directly from R user interface

GRAPLEr under the hood You, R, plus IPOP keyboard GRAPLEr overlay receive Web service HTCondor send Internet You, keyboard R, plus GRAPLEr library IPOP overlay network UF VT GRAPLEr UW Other sites

GRAPLEr under the hood Web service: A server takes requests from you through R IPOP network overlay Aggregates computers across the Internet as if they belong to the same domain HTCondor Distributes GLM jobs to the computers connected by IPOP so they can run concurrently and finish faster

Activity C Go through the GRAPLEr demo in the R script Once you have finished the demonstration, design your own simulation "experiment" with your partner and use the GRAPLEr to examine the offsets of a meteorological variable and magnitude of your choice. Create some figures from your simulation and share them with the class.