Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Slides:



Advertisements
Similar presentations
Virtual Lab AMsterdam VLAM-G: A Grid-based Virtual Laboratory Presented by Cees de Laat VLAM-G developers team Computer Architecture and Parallel Systems.
Advertisements

Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
David Groep / Virtual Lab overview1 Virtual Laboratory Overview A collaborative analysis environment for applied experimental science Distributed.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Samford University Virtual Supercomputer (SUVS) Brian Toone 4/14/09.
DESIGN AND IMPLEMENTATION OF SOFTWARE COMPONENTS FOR A REMOTE LABORATORY J. Fernandez, J. Crespo, R. Barber, J. Carretero University Carlos III of Madrid.
WS-VLAM Introduction presentation WS-VLAM Workflow Engine System and Network Engineering group Institute of informatics University of Amsterdam.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
VL-e PoC Architecture and the VL-e Integration Team David Groep VL-e work shop, April 7 th, 2006.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
UvA, Amsterdam June 2007WS-VLAM Introduction presentation WS-VLAM Requirements list known as the WS-VLAM wishlist System and Network Engineering group.
Use of RCP for Instrument Control Tony Lam 2006 Eclipse SLAC.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Dagstuhl, February 16, 2009 Layers in Grids Uwe Schwiegelshohn 17. Februar 2009 Layers in Grids.
Asst.Prof.Dr.Ahmet Ünveren SPRING Computer Engineering Department Asst.Prof.Dr.Ahmet Ünveren SPRING Computer Engineering Department.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
GumTree Feature Overview Tony Lam Data Acquisition Team Bragg Institute eScience Workshop 2006.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
POSTECH DP & NM Lab. (1)(1) POWER Prototype (1)(1) POWER Prototype : Towards Integrated Policy-based Management Mi-Joung Choi
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Tools for collaboration How to share your duck tales…
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
RealityGrid Peter Coveney 1 and John Brooke 2 1. Centre for Computational Science, Department of Chemistry, Queen Mary, University of London 2. Manchester.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
XML-Based Grid Data System for Bioinformatics Development Noppadon Khiripet, Ph.D Wasinee Rungsarityotin, MS Chularat Tanprasert, Ph.D Royol Chitradon.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources) Tomasz Haupt Northeast Parallel Architectures.
Evaluating Meta-Scheduling Algorithms in VLAM-G Environment V.Korkhov, A.Belloum, L.O.Hertzberger FNWI, University of Amsterdam Key VLAM-G applications.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
Virtual Lab AMsterdam VLAMsterdam Abstract Machine Toolbox A.S.Z. Belloum, Z.W. Hendrikse, E.C. Kaletas, H. Afsarmanesh and L.O. Hertzberger Computer Architecture.
The ATLAS DAQ System Online Configurations Database Service Challenge J. Almeida, M. Dobson, A. Kazarov, G. Lehmann-Miotto, J.E. Sloper, I. Soloviev and.
CATI Pitié-Salpêtrière CATI: A national platform for advanced Neuroimaging In Alzheimer’s Disease Standardized MRI and PET acquisitions Across a wide network.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
December, 2006 ws-VLAM Workflow Management System a Re-factoring of VLAM Dmitry Vasyunin Adianto Wibisono Adam Belloum.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Virtual Laboratory Amsterdam L.O. (Bob) Hertzberger Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit van Amsterdam.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Integrating Scientific Tools and Web Portals
Clouds , Grids and Clusters
Tools and Services Workshop
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Grid Computing.
Chapter 18 MobileApp Design
CMPE419 Mobile Application Development
VL-e PoC Architecture and the VL-e Integration Team
CMPE419 Mobile Application Development
Calypso Service Architecture
The ViroLab Virtual Laboratory for Viral Diseases
Presentation transcript:

Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit van Amsterdam National Institute for Nuclear and High Energy Physics Institute for Atomic and Molecular Physics

Virtual Lab AMsterdam Outline Introduction Objectives VLAM-G Principles VLAM-G Architecture VLAM-G & DASII VLAM-G Application Examples Conclusions

Virtual Lab AMsterdam VLAM-G Virtual Laboratory AMsterdam A collaborative analysis environment for applied experimental science Grid and VLAM is about sharing resources: physical equipment (remote experimentation) Data & Information repositories

Virtual Lab AMsterdam Virtual Lab. Application Layer Grid Layer

Virtual Lab AMsterdam Objectives & realization Methods Enable VLAM-G users to define, execute, and monitor their experiments Provide to VLAM-G users: location independent experimentation, familiar experimentation environment assistance during their experiments Easy way to bring/port new/existing applications to the Grid Developing application prototypes to check ideas and to learn

Virtual Lab AMsterdam Application layer Case studies Provides VLAM-G modules Middle layer (Top) Hides the details of the Grid Offers an information management system Objectives & realization Methods

Virtual Lab AMsterdam

VLAM-G Architecture VLAM-G Client collaboration Assistant VIMCO Grid/Globus Services PFT DBRTS DB Resource A Resource B M1 M2 Mn RTS Module Repository SessionManager

Virtual Lab AMsterdam VLAM-G Run Time System on DAS-2 DAS-2 NIKHEF VU RTSM VL module 5 VL module 4 VL module 2 VL module 3 VL module 1 VLAM-G GUI RTSM VL module 1 - VLAM-G Run Time System Manager - VLAM-G experiment module VLAM-G GUI - VLAM-G Graphical User Interface

Virtual Lab AMsterdam Node 0 Job management on DAS-2 Node N Node 2 Node 3 Node 1... SM PBS over Globus Subcluster (e.g. at NIKHEF) node Other subclusters:... RTSM VL module 1 VL module 5 GUI PBS over Globus Subcluster (e.g. at NIKHEF) Other subclusters: VL module 2 VL module 4 VL module 3 VIMCO App. DBRTS DB

Virtual Lab AMsterdam Process Flow Template (PFT) Used as a blueprint for a specific type of experiments PFT is designed offline by the experts in each scientific domain It is the main interface used by the VLAM-G users to perform a specific experimentation in the VLAM-G environment. It Guides the user while performing the experiment.

Virtual Lab AMsterdam The PFT (cont.) PFT (GUI) VIMCORTS Expressive MACSEFC Application databases Resource A Compose the experiment (GUI) Define the context f the experiment (GUI) Experiment Editor

Virtual Lab AMsterdam Process Flow Template Owner Empty Literature Extraction Conversion Q. Ctrl DC Analys. Sample Treatment Treated sample Surface Scan Raw Data Data Cube Interpretation Photograph Settings Apparatus Data Cube Cerf. Tool Ana Tool

Virtual Lab AMsterdam Status of the VLAM-G Prototype The first Beta-release is almost ready This release will contain: A tool to load modules in the VLAM-G database A list of modules that can selected and used C/C++ API to write VLAM-G modules Support for the MACS and DNA array experiments It should be conform to the Globus security It is going to be running on DAS-2

Virtual Lab AMsterdam The histogram demo  This demo. is about running jobs on different Grid enabled machines using the VLAM-G environment.  Two modules:  Slider  Visualization

Virtual Lab AMsterdam Histogram demo

Virtual Lab AMsterdam Floating ball experiment  This experiment is about controlling remote external devices using the VLAM-G environment.  Two modules:  controller  Visualization

Virtual Lab AMsterdam Floating ball experiment

Virtual Lab AMsterdam The MRI scan experiment  This experiment is about running jobs on different Grid enabled machines using the VLAM-G environment.  Four modules:  MRI scanner  Converter to NetCDF  Visualization Modules: 2D and 3D

Virtual Lab AMsterdam RMI Scan experiment

Virtual Lab AMsterdam MACS (Material Analysis of Complex Surfaces) Remote experimentation (  -beam) Data storage Meta-data analysis (combine data from different sources)

Virtual Lab AMsterdam MACS lab Devices  -beam FTMS TOF-SIMS FTIR  scoop

Virtual Lab AMsterdam What is needed? High speed network Huge computing power Analytical Instruments / Data Micro-beam, FTIR, TOF-SIMS, … Capable database, generic data format Software (“The glue”)  The Virtual Laboratory env. “ VLAM-G”

Virtual Lab AMsterdam VL database Sample Meta-data analysis

Virtual Lab AMsterdam Experiment Process Flow Template Object Photo_ImageLiterature Owner Sample Sample_Extraction Treated_Sample Sample_Treatment Material_Analysis Physics_Device File_Conversion Conversion_Tool Data Cube DC_Analysis Analysis_Tool Results_Observations

Virtual Lab AMsterdam Demo3: MACSLab Exp

Virtual Lab AMsterdam Conclusions VLAM-G: a science portal for exp. analysis Workflow support for Bio-informatics, Materials Science and Biomedical Simulation & Visualisation Seamless access to distributed resources Resource Management: based on Globus Content Management: VLAM-G middleware Current status: preparing the beta-release of the VLAM-G toolkit.

Virtual Lab AMsterdam Where to find about the VLAM-G projects VLAM-G home page 