Download presentation
Presentation is loading. Please wait.
Published byRachel Haynes Modified over 9 years ago
1
Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented by Joshua Vote March 2013 CSIRO | MINERALS DOWN UNDER FLAGSHIP
2
Rough Computational Science Workflow Data + Virtual Geophysics Laboratory | Joshua Vote 2 | Methods +Resources
3
The current state of the data problem... Common Platform MarineEnvironment, Water Groundwater Geology Geophysics Virtual Geophysics Laboratory | Joshua Vote 3 |
4
Virtual Geophysics Laboratory | Joshua Vote 4 | Chemical Reactions Coupled Processes Rock Mechanics Fluid dynamics Deformation Surface Processes Fluid Flow Societal Need Numerical Basis Modelling Codes Modelling Services Base Scientific Concepts Finite Volumes Inundation Natural Hazards Resources & Mining Sustainable Energy Geodynamics Tsunami Storm Surge Finite Element Solver (Fastflo) Reactive Transport Predictive ore deposition Mine Waste Disposal Finite Element Solver ( Finley) Scripting environment for Finite element simulations (E-Script) Mine design Earth quake Mantle Convection Finite Elements Chemistry (Log K) Geodynamics Modelling code Underworld Finite Element Solver (StGFEM) ESys Crustal Coupled Mechanics & Reactive Transport Particle in Cell Slab subduction Mantle Convection Code (CitcomS) Finite Difference Visual- isation (gLucifer) Surface Modeling Package (SPModel) Chemistry (Gibbs) Particle Vulnerability Modelling Inter polation Mesh Recipes for solving a problem
5
Processing Virtual Geophysics Laboratory | Joshua Vote 5 |
6
Virtual Geophysics Laboratory | Joshua Vote 6 | Introducing The Virtual Geophysics Laboratory
7
Data discovery Virtual Geophysics Laboratory | Joshua Vote 7 | Layers discovered via remote registries Layers consist of numerous remote data services
8
Data discovery Virtual Geophysics Laboratory | Joshua Vote 8 | Some data services support subsetting Some data services support reformatting e.g. CSV, NetCDF, GeoTIFF
9
Data discovery Virtual Geophysics Laboratory | Joshua Vote 9 | Some data is only registered with flat files
10
What just happened? Virtual Geophysics Laboratory | Joshua Vote 10 |
11
Data processing Virtual Geophysics Laboratory | Joshua Vote 11 | A variety of different scientific codes are already available in the form of “Toolboxes” Flexibility in what computing resources to utilise
12
Data processing Virtual Geophysics Laboratory | Joshua Vote 12 | Further input files can be uploaded. Input files are passed directly into the cloud
13
Data processing Virtual Geophysics Laboratory | Joshua Vote 13 | The steps so far have been building an environment to run a processing script...or build from existing templates Either write your own...
14
What just happened? Virtual Geophysics Laboratory | Joshua Vote 14 | Processing script/ small input files uploaded Start processing Download big data sets Perform data processing Download Job Script/user input files Upload processing results
15
Managing results - provenance Presentation title | Presenter name 15 | All of a job’s outputs are also accessible Each job has a lifecycle that can be managed Virtual Geophysics Laboratory | Joshua Vote 15 | A job’s console log can be inspected
16
Managing results - provenance Virtual Geophysics Laboratory | Joshua Vote 16 | Successful jobs can have their entire process captured in a ISO 19115 ‘provenance record’ Each provenance record tracks all inputs, outputs, processing scripts and other metadata.... Spatial bounds... Input/output data...
17
What just happened? Virtual Geophysics Laboratory | Joshua Vote 17 | What’s the processing status? What are the job input/outputs? Publish the job’s process and results Cloud storage will persist the final artefacts
18
Still under construction Virtual Geophysics Laboratory | Joshua Vote 18 | Courtesy - www.textfiles.com
19
What’s left? A Common Processing Services Platform Analytical Spatial Information Services Stack (ASISSt) Virtual Laboratory client toolkit VGL Improvements More data and models HPC Integration Your code here! Virtual Geophysics Laboratory | Joshua Vote 19 | Analytical ASISSt +
20
Thank you Joshua Vote Software Developer eJosh.Vote@csiro.au wvgl.auscope.org VGL is Powered by: VGL acknowledges funding from the NeCTAR project http://www.nectar.org.au NeCTAR is an Australian Government project conducted as part of the Super Science initiative and financed by the Education Investment Fund. http://www.nectar.org.au VGL is a collaboration between: VGL is supported by: University of Queensland, Monash University and the Australian National University
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.