New Communities: The Virtual Physiological Human Use Case Stefan Zasada University College London

Slides:



Advertisements
Similar presentations
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
Advertisements

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI AAI in EGI Status and Evolution Peter Solagna Senior Operations Manager
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
1 Ideas About the Future of HPC in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views of.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
VPH Overview and Data Requirements Peter Coveney University College London 1.
Developing Reusable Software Infrastructure – Middleware – for Multiscale Modeling Wilfred W. Li, Ph.D. National Biomedical Computation Resource Center.
SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
A Grid Environment for Medical Imaging A Grid Environment for Medical Imaging LRMN Sorina POP, Tristan GLATARD.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
RI User Support in DEISA/PRACE EEF meeting 2 November 2010, Geneva Jules Wolfrat/Axel Berg SARA.
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
WALSAIP Portal Automated Composition of Signal Processing Operators Mariana Mendoza Botero.
© 2006 STEP Consortium ICT Infrastructure Strand.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE08 conference, Istambul Biomed community meeting V. Breton, CNRS.
Supercomputing and Grid Joint Use Case Peter Kunszt ETH Zürich / Swiss National Supercomputing Centre CSCS.
Identity Management in DEISA/PRACE Vincent RIBAILLIER, Federated Identity Workshop, CERN, June 9 th, 2011.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
1 The Virtual Physiological Human ToolKit Jonathan Cooper University of Oxford On behalf of the ToolKit team  VPH NoE, 2009 All Hands Meeting 2009 Oxford.
Building an European Research Community through Interoperable Workflows and Data ER-flow project Gabor Terstyanszky, University of Westminster, UK EGI.
DIRAC 4 EGI: Report on the experience R.G. 1,3 & A.Tsaregorodtsev 2,3 1 Universitat de Barcelona 2 Centre de Physique des Particules de Marseille 3 DIRAC.
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT EGI interoperability.
European Grid Initiative AAI in EGI Status and Evolution Peter Solagna Senior Operations Manager
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
INDIGO – DataCloud WP5 introduction INFN-Bari CYFRONET RIA
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
RI EGI-InSPIRE RI Astronomy and Astrophysics Dr. Giuliano Taffoni Dr. Claudio Vuerli.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
Store and exchange data with colleagues and team Synchronize multiple versions of data Ensure automatic desktop synchronization of large files B2DROP is.
A worldwide e-Infrastructure and Virtual Research Community for NMR and structural biology Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for.
Exploiting Recent Developments in e-Infrastructure to Unlock New Science Peter V. Coveney Centre for Computational Science University College London
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Collaboration.
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI EGI and PRACE ecosystem.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
RI EGI-InSPIRE RI Pre-OMB meeting Preparation for the Workshop “EGI towards H2020” NGI_UK John Gordon and.
EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
EGI… …is a Federation of over 300 computing and data centres spread across 56 countries in Europe and worldwide …delivers advanced computing.
Bob Jones EGEE Technical Director
Accessing the VI-SEEM infrastructure
PIDs in EUDAT Webinar, 15 Februari 2013
AAI for a Collaborative Data Infrastructure
Grid Portal Services IeSE (the Integrated e-Science Environment)
EGI Webinar - Introduction -
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
Expand portfolio of EGI services
EOSC-hub Contribution to the EOSC WGs
Presentation transcript:

New Communities: The Virtual Physiological Human Use Case Stefan Zasada University College London

Federating Infrastructures Many applications are now workflows of operations that require compute resources of different scales + data Workflow components of different sizes should be allocated to appropriate resources: clusters or supercomputers We need to be able to transparently interoperate across EGI, PRACE, EUDAT & other infrastructures A working group has been established to interoperate across EUDAT, EGI and PRACE + We’re working to bring a use cases from VPH to help develop this collaboration

Core services are building blocks of EUDAT‘s Common Data Infrastructure mainly included on bottom layer of data services Community-oriented services Simple Data Acces and upload Long term preservation Shared workspaces Execution and workflow (data mining, etc.) Joint metadata and data visibility Enabling services (making use of existing services where possible Persistent identifier service (EPIC, DataCite) Federated AAI service Network Services Monitoring and accounting EUDAT 3

EGI-InSPIRE RI EGI European –Over 35 countries Grid –Secure sharing Infrastructure –Computers –Data –Instruments –…. and beyond!! Established to & successful in finding the Higgs Boson

PRACE The Partnership for Advanced Computing in Europe is the European HPC Research Infrastructure PRACE enables world-class science through large scale simulations PRACE provides HPC services on leading edge capability systems on a diverse set of architectures PRACE operates up to six Tier-0 systems as a single entity including user and application support PRACE offers its resources through a single pan-European peer review process

Virtual Physiological Human (VPH) €207M initiative in EU-FP7 Aims Enable collaborative investigation of the human body across all relevant scales. Introduce multiscale methodologies into medical and clinical research The VPH framework is: Descriptive Integrative Predictive Organism Organ Tissue Cell Organelle Interaction Protein Cell Signals Transcription Gene Molecule 6 VPH DEISA Virtual Community established in collaboration with Hermann Lederer, MPS RZG

Virtual Physiological Human 42 projects: 1 NoE + IPs, STREPS + CAs. New projects to be funded under Call 9 “a methodological and technological framework that, once established, will enable collaborative investigation of the human body as a single complex system...” Networking NoE 7

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 8 The Virtual Imaging Platform - VIP ● Multi-modality medical image simulators: MRI, US, CT, and PET. ● Simulators described as workflows. ● Geometric definition and physical parameters such as proton density, echogenicity, radioactivity, chemical composition. ● Ontologies (ongoing work by INRIA Rennes). ● European Grid Infrastructure (EGI). ● Biomed Virtual Organization.

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 9 Exemplar Project – VIP for VPH ● 250 registered users, from 25 countries. ● Most used portal certificate in EGI. ● Consummed 379 CPU years fromJanuary 2011 to August VIP for VPH System Architecture

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 10 Interface with the VPH Toolkit ● Generic Application Service Wrapper (GASW) enables to access several Distributed Computing Infrastructures. ● The GASW AHE plug-in enables GASW to access AHE resources. - Launch and monitor jobs. - Data transfer. MOTEUR r/ VIP for VPH - System Architecture

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 11 Interface with the VPH Toolkit ● Part of the VPH ToolKit, freely available to the VPH community. ● Interfaces to back-end middlewares (i.e. Globus 2/4, Unicore 6) ● Manages submission and monitoring of jobs as well as data transfer. The Application Hosting Environment E/ VIP for VPH - System Architecture

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 12 VIP for VPH in action Use Case Scenario ● A heavy MRI simulation Application Software SIMRI – 3D MRI simulator based on the Bloch equation. Website Main Algorithm Solution to linear differential equation. (ODE solver). VIP for VPH - System Architecture Each model is MB in size, and generates the same amount of output data

September 18th-20th, London, UK VIP for VPH - CNRS and UCL 13 Use case scenario – EP9: VIP for VPH ● Data transfer from the EGI data storage system to the PRACE HPC resource.

EUDAT/EGI/PRACE VIP4VPH already makes use of EGI and PRACE resources –Uses MOTEUR workflow engine + other infrastructure components –Application Hosting Environment provides bridge into PRACE We need to involve EUDAT: –Data should be moved from current VIP server to EUDAT when PRACE resources are used & resulting data ingested back –GridFTP interface a requirement to interoperated with existing infrastructure

Proposed architecture ● Authentication: 1 VO(MS) should be supported on EUDAT. Otherwise, application switches (VOMS) proxies (possible but not suitable). ● Application could merge 3.a and 3.b in a 3 rd -party transfer

Acknowledgements Tristan Glatard William Romero Giuseppe Fiameni Tiziana Ferrari Johannes Reetz Derek Groen + many others… 16