VHIRL: Virtual Hazard Impact and Risk Laboratory – “A reuse story”

Slides:

Advertisements

Similar presentations

NG-CHC Northern Gulf Coastal Hazards Collaboratory Simulation Experiment Integration Sandra Harper 1, Manil Maskey 1, Sara Graves 1, Sabin Basyal 1, Jian.

Advertisements

MINERALS DOWN UNDER Using Spatial Data Infrastructure (SDI) to: enable interoperable data exchange & usage to deliver corporate decisions Ryan Fraser 19.

Ryan Fraser (CSIRO), Lesley Wyborn (GA), Richard Chopping (GA), Terry Rankine (CSIRO), Robert Woodcock (CSIRO) MINERALS DOWN UNDER Virtual Geophysics Laboratory.

Web Accessible Virtual Research Environment for Ecosystem Science Community Presentation by Siddeswara Guru.

SCIDIP-ES Components Oct ,Brussels. Basic Preservation Strategies Often stated as: “Emulate or Migrate” OAIS concepts change these to: Add Representation.

1 Richard White Design decisions: architecture 1 July 2005 BiodiversityWorld Grid Workshop NeSC, Edinburgh, 30 June - 1 July 2005 Design decisions: architecture.

The Data Curation Profile IASSIST 2010 Jake Carlson Data Research Scientist Purdue University Libraries.

A PPARC funded project AstroGrid’s Common Execution Architecture Guy Rixon, reporting on behalf of Paul Harrison and the other AstroGrid developers SC4DEVO-1,

Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.

The Mind Map of a Data Scientist Rebecca Perry and Carlota Valdivieso, Work Experience Students July 2013 What qualifies Data Science? Many things qualify.

Virtual Geophysics Laboratory (VGL) VGL v1.1 Launch Ryan Fraser, Terry Rankine, Joshua Vote, Lesley Wyborn, Ben Evans, Robert Woodcock February 2013 CSIRO.

Virtual Geophysics Laboratory (VGL) VGL v1.2 NeCTAR Project Close R.Fraser, T.Rankine, J.Vote, L.Wyborn, B.Evans, R.Woodcock, C.Kemp July 2013 CSIRO |

Massimiliano Assante – Leonardo Candela – Donatella Castelli – Pasquale Pagano Fourteenth International Conference on Grey Literature An Environment Supporting.

Sage Bionetworks Mission Sage Bionetworks is a non-profit organization with a vision to create a “commons” where integrative bionetworks are evolved by.

Virtual Geophysics Laboratory Exploiting the Cloud and Empowering Geophysicists Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans. Presented.

Integrated e-Infrastructure for Scientific Facilities Kerstin Kleese van Dam STFC- e-Science Centre Daresbury Laboratory

Ryan Fraser, Nicholas Carr Connecting RDSI, NeCTAR and ANDS via Provenance - VHIRL.

Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM The Spatial Information Services Stack – infrastructure for the AuScope Community Earth.

Virtual Geophysics Laboratory Scientific workflows exploiting the cloud Ryan Fraser, Terry Rankine, Lesley Wyborn, Joshua Vote, Ben Evans... Presented.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.

National Spatial Data Infrastructure The Spatial Information Services Stack Dr Robert Woodcock.

Virtual Laboratories VGL and Friends R.Fraser, T.Rankine, J.Vote, R.Woodcock AuScope Grid Roadshow 2014 CSIRO | MINERAL RESOURCES FLAGSHIP.

Supporting Research in an Era of Data Deluge Developing a new service portfolio within Information Services at the University of Western Australia Toby.

Future Directions MINERALS DOWN UNDER SISS – Spatial Information Services Stack Ryan Fraser| Project Lead 20 th March 2012.

AuScope Spatial Data Infrastructure Supporting Earth Science Dr Robert Woodcock CSIRO.

Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.

SEEK Welcome Malcolm Atkinson Director 12 th May 2004.

Infrastructures for Social Simulation Rob Procter National e-Infrastructure for Social Simulation ISGC 2010 Social Simulation Tutorial.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York.

OGC and Grid in AU Dr Robert Woodcock Executive Manager, e-Science Stream Leader, Exploration and Mining.

Some international collaborations in geoscience informatics: IUGS GeoSciML testbed, & AUKEGGS forum Simon Cox CSIRO Exploration and Mining.

Virtual Geophysics Laboratory (VGL) VGL v1.2 NeCTAR Project Close Ryan Fraser, Terry Rankine, Joshua Vote, Lesley Wyborn, Ben Evans, Robert Woodcock July.

Datalayer Notebook Allows Data Scientists to Play with Big Data, Build Innovative Models, and Share Results Easily on Microsoft Azure MICROSOFT AZURE ISV.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.

| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.

Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing

© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.

Mike Hildreth DASPOS Update Mike Hildreth representing the DASPOS project 1.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM “Building Clients for the AuScope Spatial Information Services Stack (SiSS)” AuScope.

Co-funded by European Commission eContentplus Sharing Practices and Experiences on the Authoring and Adaptation of Open Educational Resources Alexander.

Workflow-Driven Science using Kepler Ilkay Altintas, PhD San Diego Supercomputer Center, UCSD words.sdsc.edu.

Nci.org.au © National Computational Infrastructure 2016 Virtual Laboratories in Australia Lesley Wyborn (NCI) With contributions from:

Enabling Digital Earth by focussing on ‘accessibility’ rather than ‘delivery’. Ryan Fraser CSIRO.

”Smart Containers” Charles F. Vardeman II, Da Huo, Michelle Cheatham, James Sweet, and Jaroslaw Nabrzyski

Research Objects Preserving scientific data and methods Stian Soiland-Reyes, Khalid Belhajjame School of Computer Science, Univ of Manchester myGrid NIHBI.

The Information Environment for Neuroscientists David R Newman

Enhancements to Galaxy for delivering on NIH Commons

Contract Management in electrical engineering

Ecological Niche Modelling in the EGI Cloud Federation

RDA US Science workshop Arlington VA, Aug 2014 Cees de Laat with many slides from Ed Seidel/Rob Pennington.

Tools and Services Workshop

Joslynn Lee – Data Science Educator

Pasquale Pagano CNR, Italy

Data Ingestion in ENES and collaboration with RDA

C2CAMP (A Working Title)

Workflows with ENVI and Esri Agriculture workflows for ICARDA

Future Data Architectures Big Data Workshop – April 2018

DIGITAL LIBRARY.

MATLAB – What Is It ? Name is from matrix laboratory Powerful tool for

MATLAB – What Is It ? Name is from matrix laboratory Powerful tool for

Virtual Geophysics Laboratory (VGL): Exploiting the Cloud and HPC

OGC GeoPackage Format A Container to support the integration of Statistical and Geospatial Data Marcus Blake Assistant Director, Geospatial Solutions Australian.

ANDS and why we care about provenance

Towards Unified Management

Moving from Data Aggregation to Decision-as-a-Service | US Hydro Conference | Wetherbee Dorshow & Guy Noll.

GEO Knowledge Hub: overview

EOSC-hub Contribution to the EOSC WGs

Australian and New Zealand Metadata Working Group

Presentation transcript:

VHIRL: Virtual Hazard Impact and Risk Laboratory – “A reuse story” Ryan Fraser eResearch 2014: VL Reusability CSIRO | digital productivity flagship

Components of a Virtual Laboratory Data Services Toolboxes Compute Services Enablers Virtual Laboratory VLs are like puzzles that you put together using bits..... You can even use the bits that Jess has just spoken about to construct a “workflow” or process. Essentially a WORKFLOW engine IDEA – EXPERIMENT – KNOWLEDGE bring together data, processing and compute services for the research community Extendable framework Allows the “publication”/sharing of workflows Leads to acquisition of new, timely knowledge From My Science to Sharing My Science to Sharing Knowledge No longer a ‘personal notebook’ -> reproducible science Communities beyond organisational boundaries

Components of the Virtual Geophysics Laboratory Data Services Toolboxes Compute Services Enablers (OGC, Provenance) Dynamic Virtual Geophysics Laboratories Org. Cloud Mag. Grav. VGL Portal Service Orchestration Petascale Compute Magnetics eScript eScript DEM Org. Cloud VGL Portal Scripting Tool Gravity Org. Cloud Underworld Mag. Grav. NeCTAR Cloud Provenance Metadata DEM VGL Portal Petascale Compute Underworld Amazon Cloud Desktop

Repurposing to a Virtual Hazards Laboratory (VHIRL) Data Services Toolboxes Compute Services Enablers (OGC, Provenance) Dynamic Virtual Hazards Laboratories Unchanged Petascale Mag. Grav. VHIRL Portal Service Orchestration Petascale Magnetics ANUGA eScript DEM Org. Cloud VHIRL Portal Scripting Tool Gravity Org. Cloud eScript Bathy DEM NeCTAR Cloud Provenance Metadata DEM VHIRL Portal VHIRL is a repurposing of VGL for Natural Hazard researchers Amazon Cloud Amazon Cloud Landsat ANUGA Bathymetry Desktop

VLs: lightweight frontend, powerful services VHIRL is a client for connecting researchers to: Data Scientific codes/algorithms Cloud compute and storage resources Each other VHIRL is focusing on answering these questions: What data is available? How do I get it? How may I process the data? Where can I perform the processing? Where can I store my results? How do I capture and then reproduce this process? Data is published using open standards to a registry. Some service support data format conversion, sub-setting, reprojection,... - Prefer OGC and similar standards but can be just flat files

<live demo of VHIRL!> http://portal.vhirl.net

VLs lead to Knowledge VHIRL, brings together data, processing and compute services for the natural hazards research community Extendable framework Allows the “publication” of process used to create results (Provenance) Allows sharing of scientists workflow (Scientific Code Marketplace) Leads to acquisition of new, timely knowledge

Ryan Fraser Research Manager t +61 8 6436 8760 e ryan.fraser@csiro.au w www.csiro.au CSIRO