Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented.

Slides:

Advertisements

Similar presentations

About ANDS One of the chief goals of ANDS is to build the Australian Research Data Commons, a cohesive collection of research data outputs from all Australian.

Advertisements

ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.

MINERALS DOWN UNDER Using Spatial Data Infrastructure (SDI) to: enable interoperable data exchange & usage to deliver corporate decisions Ryan Fraser 19.

APAC Grid Geosciences Project: Linking Academia, Industry and Government to HPC Robert Woodcock, CSIRO and pmd*CRC Ryan Fraser, IVEC and Curtin.

Ryan Fraser (CSIRO), Lesley Wyborn (GA), Richard Chopping (GA), Terry Rankine (CSIRO), Robert Woodcock (CSIRO) MINERALS DOWN UNDER Virtual Geophysics Laboratory.

UNIVERSITY OF BUCHAREST Faculty of Geology and Geophysics Doctoral school of GEOLOGY Promoter team of Doctoral School of Geology has, enrolled in the doctoral.

Current Progress on the CCA Groundwater Modeling Framework Bruce Palmer, Yilin Fang, Vidhya Gurumoorthi, Computational Sciences and Mathematics Division.

GeoFramework: Example of using frameworks in geophysics CIG/IRIS Computational Seismology Workshop June, 2005 Mike Gurnis Caltech.

Standa Vaněček The potential of Integrated Modelling and the OpenMI Standa Vaněček DHI, Chairman of the OATC.

SWSA: Domain-Specific Software Architecture for Workflow-Based Science Data Systems David Woollard § ✚ Neno Medvidovic § University of Southern California.

Integrated Scientific Workflow Management for the Emulab Network Testbed Eric Eide, Leigh Stoller, Tim Stack, Juliana Freire, and Jay Lepreau and Jay Lepreau.

© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.

Large-Scale Data Collection Metadata Management at the National Computational Infrastructure (NCI) Jingbo Wang 1, Irina Bastrakova.

Virtual Geophysics Laboratory (VGL) VGL v1.1 Launch Ryan Fraser, Terry Rankine, Joshua Vote, Lesley Wyborn, Ben Evans, Robert Woodcock February 2013 CSIRO.

Virtual Geophysics Laboratory (VGL) VGL v1.2 NeCTAR Project Close R.Fraser, T.Rankine, J.Vote, L.Wyborn, B.Evans, R.Woodcock, C.Kemp July 2013 CSIRO |

V. Chandrasekar (CSU), Mike Daniels (NCAR), Sara Graves (UAH), Branko Kerkez (Michigan), Frank Vernon (USCD) Integrating Real-time Data into the EarthCube.

Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: –Quickly estimate certain aspects.

Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.

CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:

An Extensible Python User Environment Jeff Daily Karen Schuchardt, PI Todd Elsethagen Jared Chase H41G-0956 Website Acknowledgements.

Cactus Computational Frameowork Freely available, modular, environment for collaboratively developing parallel, high- performance multi-dimensional simulations.

Ryan Fraser, Nicholas Carr Connecting RDSI, NeCTAR and ANDS via Provenance - VHIRL.

Linking AuScope to the broader minerals industry value chain Jonathan Law, Robert Woodcock, Ryan Fraser, Terry Rankine, Guillaume Duclaux.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM The Spatial Information Services Stack – infrastructure for the AuScope Community Earth.

The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International.

Virtual Geophysics Laboratory Scientific workflows exploiting the cloud Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans... Presented.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.

National Spatial Data Infrastructure The Spatial Information Services Stack Dr Robert Woodcock.

IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.

Virtual Laboratories VGL and Friends R.Fraser, T.Rankine, J.Vote, R.Woodcock AuScope Grid Roadshow 2014 CSIRO | MINERAL RESOURCES FLAGSHIP.

| nectar.org.au NECTAR TRAINING Module 3 Common use cases.

Future Directions MINERALS DOWN UNDER SISS – Spatial Information Services Stack Ryan Fraser| Project Lead 20 th March 2012.

The really useful geologist. By the end of this talk I hope you will: appreciate why geologists are useful; recognise why geology is an excellent career.

Technical Session Virtual Geophysics Laboratory MINERAL RESOURCES Josh Vote | Software Developer September 2014.

A Web Laboratory for Visual Interactive Simulation of Epitaxial Growth Feng Liu University of Utah Recently, we have developed a prototype of web laboratory.

GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.

Update on the CCA Groundwater Simulation Framework: the BOCCA Experience Bruce Palmer, Yilin Fang, Vidhya Gurumoorthi, James Fort, Tim Scheibe Computational.

Interactive Computational Sciences Laboratory Clarence O. E. Burg Assistant Professor of Mathematics University of Central Arkansas Science Museum of Minnesota.

GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma

OGC and Grid in AU Dr Robert Woodcock Executive Manager, e-Science Stream Leader, Exploration and Mining.

New tools for facilitating the integration of models into teaching David F. Boutt Umass-Amherst.

Computational Modeling of Carbon Dioxide in Saline Reservoirs Caitlin M. Augustin Peter K. Swart Timothy H. Dixon Augustin et al., 2010.

Virtual Geophysics Laboratory (VGL) VGL v1.2 NeCTAR Project Close Ryan Fraser, Terry Rankine, Joshua Vote, Lesley Wyborn, Ben Evans, Robert Woodcock July.

Geodynamics-based Core the University of Minnesota (UMN) - Twin Cities Martin O. Saar Donna L. Whitney 2)Overview.

Computational Science & Engineering meeting national needs Steven F. Ashby SIAG-CSE Chair March 24, 2003.

UNIVERSITY OF BUCHAREST Faculty of Geology and Geophysics Doctoral school of GEOLOGY Promoter team of Doctoral School of Geology has, enrolled in the doctoral.

Lijun Liu Seismo Lab, Caltech Dec. 18, 2006 Inferring Mantle Structure in the Past ---Adjoint method in mantle convection.

Mineral Exploration Tel: (07) Fax: (07)

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM The NCRIS AuScope Community Earth Model Bruce Simons.

| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.

Taming the Big Data in Computational Chemistry #euroCRIS2015 Barcelona 9-11-XI-2015 Carles Bo ICIQ (BIST) -

CSIRO’s Data Access Portal Sue Cook | Research Data Services Support 18 March 2014.

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM “Building Clients for the AuScope Spatial Information Services Stack (SiSS)” AuScope.

| nectar.org.au NECTAR TRAINING Module 3 Common use cases.

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.

Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University

The Global Scene Wouter Los University of Amsterdam The Netherlands.

Nci.org.au © National Computational Infrastructure 2016 Virtual Laboratories in Australia Lesley Wyborn (NCI) With contributions from:

Enabling Digital Earth by focussing on ‘accessibility’ rather than ‘delivery’. Ryan Fraser CSIRO.

Enhancements to Galaxy for delivering on NIH Commons

MIRACLE Cloud-based reproducible data analysis and visualization for outputs of agent-based models Xiongbing Jin, Kirsten Robinson, Allen Lee, Gary Polhill,

Recap: introduction to e-science

GeoFramework: Example of using frameworks in geophysics

University of Technology

Uses of Modeling A model is designed to represent reality in such a way that the modeler can do one of several things: Quickly estimate certain aspects.

VHIRL: Virtual Hazard Impact and Risk Laboratory – “A reuse story”

Virtual Geophysics Laboratory (VGL): Exploiting the Cloud and HPC

Lecture One: Automata Theory Amjad Ali

Presentation transcript:

Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented by Joshua Vote March 2013 CSIRO | MINERALS DOWN UNDER FLAGSHIP

Rough Computational Science Workflow Data + Virtual Geophysics Laboratory | Joshua Vote 2 | Methods +Resources

The current state of the data problem... Common Platform MarineEnvironment, Water Groundwater Geology Geophysics Virtual Geophysics Laboratory | Joshua Vote 3 |

Virtual Geophysics Laboratory | Joshua Vote 4 | Chemical Reactions Coupled Processes Rock Mechanics Fluid dynamics Deformation Surface Processes Fluid Flow Societal Need Numerical Basis Modelling Codes Modelling Services Base Scientific Concepts Finite Volumes Inundation Natural Hazards Resources & Mining Sustainable Energy Geodynamics Tsunami Storm Surge Finite Element Solver (Fastflo) Reactive Transport Predictive ore deposition Mine Waste Disposal Finite Element Solver ( Finley) Scripting environment for Finite element simulations (E-Script) Mine design Earth quake Mantle Convection Finite Elements Chemistry (Log K) Geodynamics Modelling code Underworld Finite Element Solver (StGFEM) ESys Crustal Coupled Mechanics & Reactive Transport Particle in Cell Slab subduction Mantle Convection Code (CitcomS) Finite Difference Visual- isation (gLucifer) Surface Modeling Package (SPModel) Chemistry (Gibbs) Particle Vulnerability Modelling Inter polation Mesh Recipes for solving a problem

Processing Virtual Geophysics Laboratory | Joshua Vote 5 |

Virtual Geophysics Laboratory | Joshua Vote 6 | Introducing The Virtual Geophysics Laboratory

Data discovery Virtual Geophysics Laboratory | Joshua Vote 7 | Layers discovered via remote registries Layers consist of numerous remote data services

Data discovery Virtual Geophysics Laboratory | Joshua Vote 8 | Some data services support subsetting Some data services support reformatting e.g. CSV, NetCDF, GeoTIFF

Data discovery Virtual Geophysics Laboratory | Joshua Vote 9 | Some data is only registered with flat files

What just happened? Virtual Geophysics Laboratory | Joshua Vote 10 |

Data processing Virtual Geophysics Laboratory | Joshua Vote 11 | A variety of different scientific codes are already available in the form of “Toolboxes” Flexibility in what computing resources to utilise

Data processing Virtual Geophysics Laboratory | Joshua Vote 12 | Further input files can be uploaded. Input files are passed directly into the cloud

Data processing Virtual Geophysics Laboratory | Joshua Vote 13 | The steps so far have been building an environment to run a processing script...or build from existing templates Either write your own...

What just happened? Virtual Geophysics Laboratory | Joshua Vote 14 | Processing script/ small input files uploaded Start processing Download big data sets Perform data processing Download Job Script/user input files Upload processing results

Managing results - provenance Presentation title | Presenter name 15 | All of a job’s outputs are also accessible Each job has a lifecycle that can be managed Virtual Geophysics Laboratory | Joshua Vote 15 | A job’s console log can be inspected

Managing results - provenance Virtual Geophysics Laboratory | Joshua Vote 16 | Successful jobs can have their entire process captured in a ISO ‘provenance record’ Each provenance record tracks all inputs, outputs, processing scripts and other metadata.... Spatial bounds... Input/output data...

What just happened? Virtual Geophysics Laboratory | Joshua Vote 17 | What’s the processing status? What are the job input/outputs? Publish the job’s process and results Cloud storage will persist the final artefacts

Still under construction Virtual Geophysics Laboratory | Joshua Vote 18 | Courtesy -

What’s left? A Common Processing Services Platform Analytical Spatial Information Services Stack (ASISSt) Virtual Laboratory client toolkit VGL Improvements More data and models HPC Integration Your code here! Virtual Geophysics Laboratory | Joshua Vote 19 | Analytical ASISSt +

Thank you Joshua Vote Software Developer wvgl.auscope.org VGL is Powered by: VGL acknowledges funding from the NeCTAR project NeCTAR is an Australian Government project conducted as part of the Super Science initiative and financed by the Education Investment Fund. VGL is a collaboration between: VGL is supported by: University of Queensland, Monash University and the Australian National University