Presentation is loading. Please wait.

Presentation is loading. Please wait.

Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented.

Similar presentations


Presentation on theme: "Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented."— Presentation transcript:

1 Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented by Joshua Vote March 2013 CSIRO | MINERALS DOWN UNDER FLAGSHIP

2 Rough Computational Science Workflow Data + Virtual Geophysics Laboratory | Joshua Vote 2 | Methods +Resources

3 The current state of the data problem... Common Platform MarineEnvironment, Water Groundwater Geology Geophysics Virtual Geophysics Laboratory | Joshua Vote 3 |

4 Virtual Geophysics Laboratory | Joshua Vote 4 | Chemical Reactions Coupled Processes Rock Mechanics Fluid dynamics Deformation Surface Processes Fluid Flow Societal Need Numerical Basis Modelling Codes Modelling Services Base Scientific Concepts Finite Volumes Inundation Natural Hazards Resources & Mining Sustainable Energy Geodynamics Tsunami Storm Surge Finite Element Solver (Fastflo) Reactive Transport Predictive ore deposition Mine Waste Disposal Finite Element Solver ( Finley) Scripting environment for Finite element simulations (E-Script) Mine design Earth quake Mantle Convection Finite Elements Chemistry (Log K) Geodynamics Modelling code Underworld Finite Element Solver (StGFEM) ESys Crustal Coupled Mechanics & Reactive Transport Particle in Cell Slab subduction Mantle Convection Code (CitcomS) Finite Difference Visual- isation (gLucifer) Surface Modeling Package (SPModel) Chemistry (Gibbs) Particle Vulnerability Modelling Inter polation Mesh Recipes for solving a problem

5 Processing Virtual Geophysics Laboratory | Joshua Vote 5 |

6 Virtual Geophysics Laboratory | Joshua Vote 6 | Introducing The Virtual Geophysics Laboratory

7 Data discovery Virtual Geophysics Laboratory | Joshua Vote 7 | Layers discovered via remote registries Layers consist of numerous remote data services

8 Data discovery Virtual Geophysics Laboratory | Joshua Vote 8 | Some data services support subsetting Some data services support reformatting e.g. CSV, NetCDF, GeoTIFF

9 Data discovery Virtual Geophysics Laboratory | Joshua Vote 9 | Some data is only registered with flat files

10 What just happened? Virtual Geophysics Laboratory | Joshua Vote 10 |

11 Data processing Virtual Geophysics Laboratory | Joshua Vote 11 | A variety of different scientific codes are already available in the form of “Toolboxes” Flexibility in what computing resources to utilise

12 Data processing Virtual Geophysics Laboratory | Joshua Vote 12 | Further input files can be uploaded. Input files are passed directly into the cloud

13 Data processing Virtual Geophysics Laboratory | Joshua Vote 13 | The steps so far have been building an environment to run a processing script...or build from existing templates Either write your own...

14 What just happened? Virtual Geophysics Laboratory | Joshua Vote 14 | Processing script/ small input files uploaded Start processing Download big data sets Perform data processing Download Job Script/user input files Upload processing results

15 Managing results - provenance Presentation title | Presenter name 15 | All of a job’s outputs are also accessible Each job has a lifecycle that can be managed Virtual Geophysics Laboratory | Joshua Vote 15 | A job’s console log can be inspected

16 Managing results - provenance Virtual Geophysics Laboratory | Joshua Vote 16 | Successful jobs can have their entire process captured in a ISO 19115 ‘provenance record’ Each provenance record tracks all inputs, outputs, processing scripts and other metadata.... Spatial bounds... Input/output data...

17 What just happened? Virtual Geophysics Laboratory | Joshua Vote 17 | What’s the processing status? What are the job input/outputs? Publish the job’s process and results Cloud storage will persist the final artefacts

18 Still under construction Virtual Geophysics Laboratory | Joshua Vote 18 | Courtesy - www.textfiles.com

19 What’s left? A Common Processing Services Platform Analytical Spatial Information Services Stack (ASISSt) Virtual Laboratory client toolkit VGL Improvements More data and models HPC Integration Your code here! Virtual Geophysics Laboratory | Joshua Vote 19 | Analytical ASISSt +

20 Thank you Joshua Vote Software Developer eJosh.Vote@csiro.au wvgl.auscope.org VGL is Powered by: VGL acknowledges funding from the NeCTAR project http://www.nectar.org.au NeCTAR is an Australian Government project conducted as part of the Super Science initiative and financed by the Education Investment Fund. http://www.nectar.org.au VGL is a collaboration between: VGL is supported by: University of Queensland, Monash University and the Australian National University


Download ppt "Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented."

Similar presentations


Ads by Google