Virtual Laboratory for e-Science (VL-e) Henri Bal Department of Computer Science Vrije Universiteit Amsterdam vrije Universiteit.

Slides:



Advertisements
Similar presentations
Virtual Lab AMsterdam VLAM-G: A Grid-based Virtual Laboratory Presented by Cees de Laat VLAM-G developers team Computer Architecture and Parallel Systems.
Advertisements

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Grid.
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Experiences.
Science Park Amsterdam, October A World of Science in a City of Inspiration Johan A.A. Vos Director Science Park Amsterdam (WTCW N.V.)
Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor.
Medical Diagnosis and Imaging SP1.3 of the Virtual Lab for e-Science Robert Belleman
VL-e generic services: Scientific visualization techniques (volume rendering, surface extraction) Image processing algorithms (registration, segmentation)
R. Belleman, 22 juni 2004VL-e technical overview VL-e toolkit development cycle Robert Belleman
Opening Workshop DAS-2 (Distributed ASCI Supercomputer 2) Project vrije Universiteit.
CCGrid2013 Panel on Clouds Henri Bal Vrije Universiteit Amsterdam.
7 april SP3.1: High-Performance Distributed Computing The KOALA grid scheduler and the Ibis Java-centric grid middleware Dick Epema Catalin Dumitrescu,
The Distributed ASCI Supercomputer (DAS) project Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
Parallel Programming on Computational Grids. Outline Grids Application-level tools for grids Parallel programming on grids Case study: Ibis.
Distributed supercomputing on DAS, GridLab, and Grid’5000 Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
Virtual Laboratory for e-Science (VL-e) Henri Bal Department of Computer Science Vrije Universiteit Amsterdam vrije Universiteit.
Henri Bal Vrije Universiteit Amsterdam vrije Universiteit.
VL-e PoC Architecture and the VL-e Integration Team David Groep VL-e work shop, April 7 th, 2006.
The Distributed ASCI Supercomputer (DAS) project Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
June 3, 2015 Synthetic Grid Workloads with Ibis, K OALA, and GrenchMark CoreGRID Integration Workshop, Pisa A. Iosup, D.H.J. Epema Jason Maassen, Rob van.
VL-e PoC: What it is and what it isn’t Jan Just Keijser VL-e P4 Scaling and Validation Team TU Delft Grid Meeting, December 11th, 2008.
The Performance of Bags-Of-Tasks in Large-Scale Distributed Computing Systems Alexandru Iosup, Ozan Sonmez, Shanny Anoep, and Dick Epema ACM/IEEE Int’l.
The Ibis Project: Simplifying Grid Programming & Deployment Henri Bal, Jason Maassen, Rob van Nieuwpoort, Thilo Kielmann, Niels Drost, Ceriel Jacobs, Frank.
E-Science and Grid The VL-e approach L.O. (Bob) Hertzberger Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.
Computational Steering on the GRID Using a 3D model to Interact with a Large Scale Distributed Simulation in Real-Time Michael.
Virtual Laboratory for e-Science (VL-e) Henri Bal Department of Computer Science Vrije Universiteit Amsterdam vrije Universiteit.
Grid Adventures on DAS, GridLab and Grid'5000 Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
Ibis: a Java-centric Programming Environment for Computational Grids Henri Bal Vrije Universiteit Amsterdam vrije Universiteit.
The Distributed ASCI Supercomputer (DAS) project Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
4 december, The Distributed ASCI Supercomputer The third generation Dick Epema (TUD) (with many slides from Henri Bal) Parallel and Distributed.
NGNS Program Managers Richard Carlson Thomas Ndousse ASCAC meeting 11/21/2014 Next Generation Networking for Science Program Update.
Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.
ICP ICT and Company Practise College 1 Dinsdag 3 april 2007 Geleyn Meijer.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
This work was carried out in the context of the Virtual Laboratory for e-Science project. This project is supported by a BSIK grant from the Dutch Ministry.
Panel Abstractions for Large-Scale Distributed Systems Henri Bal Vrije Universiteit Amsterdam.
E-science in the Netherlands Maria Heijne TU Delft Library Director / Chair Consortium of University Libraries and National Library.
Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI.
Simulated vascular reconstruction in a virtual operating theatre Robert G. Belleman, Peter M.A. Sloot Section Computational Science, University of Amsterdam,
Dutch Tier Hardware Farm size –now: 150 dual nodes + scavenging 200 nodes –buildup to ~1500 up-to-date nodes in 2007 Network –now: 2 Gbit/s internatl.
Using the VL-E Proof of Concept Environment Connecting Users to the e-Science Infrastructure David Groep, NIKHEF.
August , Elsevier, Amsterdam Scientific Workflows in e-Science Dr Zhiming Zhao System and Network.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.
VL-e Workshop, 7 April Developments and Activities in VL-e Medical Sílvia D. Olabarriaga Informatics Institute, UvA
The DutchGrid Platform – An Overview – 1 DutchGrid today and tomorrow David Groep, NIKHEF The DutchGrid Platform Large-scale Distributed Computing.
A High Performance Middleware in Java with a Real Application Fabrice Huet*, Denis Caromel*, Henri Bal + * Inria-I3S-CNRS, Sophia-Antipolis, France + Vrije.
The Scaling and Validation Programme PoC David Groep & vle-pfour-team VL-e Workshop NIKHEF SARA LogicaCMG IBM.
ICT infrastructure for Science: e-Science developments Henri Bal Vrije Universiteit Amsterdam.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
DAME: A Distributed Diagnostics Environment for Maintenance Dr Tom Jackson University of York.
Virtual Lab for e-Science Towards a new Science Paradigm.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
An modular approach to fMRI metadata in a Virtual Laboratory - generic tools for specific problems M. Scott Marshall, Kasper van den Berg, Kamel Boulebiar,
Scaling and Validation Programme David Groep & vle-pfour-team VL-e SP Meeting NIKHEF SARA LogicaCMG IBM.
INFSO-RI Grupo de Redes y Computación de Altas Prestaciones Actividades del Grupo de Redes y Computación de Altas Prestaciones.
11/15/04PittGrid1 PittGrid: Campus-Wide Computing Environment Hassan Karimi School of Information Sciences Ralph Roskies Pittsburgh Supercomputing Center.
An Overview of Scientific Workflows: Domains & Applications Laboratoire Lorrain de Recherche en Informatique et ses Applications Presented by Khaled Gaaloul.
High Level Architecture (HLA)  used for building interactive simulations  connects geographically distributed nodes  time management (for time- and.
Wide-Area Parallel Computing in Java Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences vrije Universiteit.
Virtual Lab AMsterdam VLAMsterdam Abstract Machine Toolbox A.S.Z. Belloum, Z.W. Hendrikse, E.C. Kaletas, H. Afsarmanesh and L.O. Hertzberger Computer Architecture.
Nguyen Thi Thanh Nha HMCL by Roelof Kemp, Nicholas Palmer, Thilo Kielmann, and Henri Bal MOBICASE 2010, LNICST 2012 Cuckoo: A Computation Offloading Framework.
SCI-BUS Sílvia Delgado Olabarriaga e-BioScience Group Bioinformatics Laboratory Dept of Epidemiology, Biostatistics and Bioinformatics.
DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,
Fault tolerance, malleability and migration for divide-and-conquer applications on the Grid Gosia Wrzesińska, Rob V. van Nieuwpoort, Jason Maassen, Henri.
Virtual Laboratory Amsterdam L.O. (Bob) Hertzberger Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit van Amsterdam.
Clouds , Grids and Clusters
GRID COMPUTING PRESENTED BY : Richa Chaudhary.
VL-e PoC Architecture and the VL-e Integration Team
Tom Savel, MD Lead – Grid Technologies Medical Officer NCPHI, CDC
Presentation transcript:

Virtual Laboratory for e-Science (VL-e) Henri Bal Department of Computer Science Vrije Universiteit Amsterdam vrije Universiteit

e-Science Web is about exchanging information Grid is about sharing resources oComputers, data bases, instruments, services e-Science supports experimental science by providing a virtual laboratory on top of Grids

Management of comm. & computing Management of comm. & computing Management of comm. & computing Potential Generic part Potential Generic part Potential Generic part Application Specific Part Application Specific Part Application Specific Part Virtual Laboratory Application oriented services Grid Harness multi-domain distributed resources Virtual Laboratories Distributed computing Visualization & collaboration Knowledge Data & information

Optical Networking High-performance distributed computing Security & Generic AAA Virtual lab. & System integration Interactive PSE Collaborative information Management Adaptive information disclosure User Interfaces & Virtual reality based visualization Bio-diversity Bio-Informatics Telescience Data Intensive Science Food Informatics Medical diagnosis & imaging Virtual Laboratory for e-Science

The VL-e project 40 M€ (20 M€ BSIK funding) vrije Universiteit 20 partners Academic - Industrial

Grid Middleware Gigaport Network Service (lambda networking) Application specific service Application Potential Generic service & Virtual Lab. services Grid & Network Services Virtual Laboratory VL-E Experimental Environment VL-E Proof of concept Environment Telescience Medical Application Bio ASP Virtual Lab. rapid prototyping (interactive simulation) Additional Grid Services (OGSA services) VL-e environments

VL-e workshop Optical Networking High-performance distributed computing Security Virtual labi PSE CIM A.I.D. Visualization Bio-div Bio-Inf Telesc ience Data Intensie Food Medical imaging demo P4: Scaling up Jansen Belleman Marshall, Breit Konijnenburg Bouwhuis

MRI, PETMonolith, ClusterCave, Wall, PC, PDA From Medical Image Acquisition to Interactive Virtual Visualization… MD login and Grid Proxy creation Bypass creation LB mesh generation Job submission Job monitoring Virtual Node navigation Simulated Blood Flow Patient at MRI scanner MR image Segmentation Shear stress, velocities Simulated blood flow se (e.g., Leiden)ce (e.g., Valencia)ce (e.g., Bratislava) ui (VRE) P.M.A. Sloot, A.G. Hoekstra, R.G. Belleman, A. Tirado-Ramos, E.V. Zudilova, D.P. Shamonin, R.M. Shulakov, A.M. Artoli, L. Abrahamyan Interactive Problem Solving Environments

Visualization on the Grid

High-Performance Distributed Computing Ibis: a Java-centric grid programming environment oRemote Method Invocation (RMI), group communication, divide&conquer parallelism, object migration (ProActive) Written in pure Java, runs on heterogeneous grids o“Write once, run everywhere ” oUse bytecode rewriting for optimizations (e.g. serialization) oUse native code as special-case optimization (e.g. Myrinet)

Experiences with Ibis Distributed supercomputing applications oElectromagnetic simulation (Jem3D) oAutomated protein identification (AMOLF) oN-body simulations, SAT-solver, raytracer Successful grid experiments oOn DAS-2 (homogeneous Dutch grid) oOn GridLab (European grid) Need co-allocation mechanisms More info + distribution at

Optical networking Formally part of GigaPort-NG BSIK project Studies optical networking technology in a grid context (e.g., bandwidth-on-demand) Useful for many VL-e applications oData-intensive sciences, visualization, HPDC, etc. CPU’s R R R R R NOC

Workshop program 14: :45 Workflow and data integration in e-bioscience: Some user requirements (Scot Marshall) 14: :15 The Knowledge Grid and Adaptive Information Disclosure (Machiel Jansen) 15: :45 Data management in the Proof-of-Concept environment of VL-e (Maurice Bouwhuis) 15: :00 Presentation of the Demos 16: :30 Break & Demo at the LightHouse (SARA+UvA) 16: :00 Medical Application (Robert Belleman) 17: :30 Bioinformatics (Timo Breit) 17: :00 Dutch Tele-science Lab (Marco Konijnenburg)