The GATE-LAB system Sorina Camarasu-Pop, Pierre Gueth, Tristan Glatard, Rafael Silva, David Sarrut VIP Workshop December 2012.

Slides:



Advertisements
Similar presentations
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Intermediate Course Module 3: Metadata Catalogs and Geospatial One.
Advertisements

1 February 8 th, 2006 February 8 th, Benefits of EF Benefits of EF Faster payment on electronic claims. Electronic transactions.
IS 6116 Introduction – 10 Jan Lecturer Details Aonghus Sugrue Website: aonghussugrue.wordpress.com
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
1 Note content copyright © 2004 Ian Sommerville. NU-specific content copyright © 2004 M. E. Kabay. All rights reserved. Software Testing IS301 – Software.
Remote Educational Programming Of Robots (REPOR) Tord Fauskanger Aurelie Aurilla Bechina Arntzen Dag Samuelsen Buskerud University College.
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
11 Application of CSF4 in Avian Flu Grid: Meta-scheduler CSF4. Lab of Grid Computing and Network Security Jilin University, Changchun, China Hongliang.
Digital Reference: Collaborations, Big and Small Alice K. Kawakami Kay Deeney Shirley David MLGSCA Program Meeting Scottsdale, AZ December 11, 2002.
Tom Sugden EPCC OGSA-DAI Future Directions OGSA-DAI User's Forum GridWorld 2006, Washington DC 14 September 2006.
1 Copyright © 2005, Oracle. All rights reserved. Introducing the Java and Oracle Platforms.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Why Grids Matter to Europe Bob Jones EGEE.
Using computer simulations to assess energy and carbon reductions in building CDM projects Joe Huang March 14, 2011.
Dynamic Pricing - Potential and Issues Joe Wharton and Ahmad Faruqui Kansas Corporation Commission Workshop on Energy Efficiency March 25, 2008.
0 - 0.
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
WP2: Data Management Gavin McCance University of Glasgow.
B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.
Making the System Operational
NGS computation services: API's,
© University of Reading IT Services ITS Support for e­ Research Stephen Gough Assistant Director of IT Services 18 June 2008.
© University of Reading School of Systems Engineering Matlab Assessment for Final Year Units Victor M. Becerra School of Systems.
Lecturer: Sebastian Coope Ashton Building, Room G.18 COMP 201 web-page: Lecture.
Arrays Dr. Jey Veerasamy July 31 st – August 23 rd 9:30 am to 12 noon 1.
Trap Diagnostic Facility Todays Software Diagnostic Tool with innovative features for the z/OS software developer Arney Computer Systems.
5.9 + = 10 a)3.6 b)4.1 c)5.3 Question 1: Good Answer!! Well Done!! = 10 Question 1:
HORIZONT TWS/WebAdmin TWS/WebAdmin for Distributed
?  Able to explain the 6 key functions of system software  Able to explain each using a suitable example  Identify three different system software.
British Library document Supply Service. 2 Building the future service Live November 2011 £6m project over 2 years Replace ALL of the current technology.
Processes Management.
Essentials for Design JavaScript Level One Michael Brooks
2/16/2004Sergei Sadilov PH/SFT 1 Bonsai in Integration Testing of Geant4 This presentation will probably involve audience discussion, which will create.
Harvard Medical School Massachusetts General Hospital.
Chapter 12 User Interface Design
Performance Considerations of Data Acquisition in Hadoop System
A pilot application 12/9/2008Microsoft eScience Workshop 2008 Robert Bukowski and Jarek Pillardy Computational Biology Service Unit Cornell University.
Kirov A S, MSKCC Overview of Geant4 Use and Issues in Imaging: Emission Tomography (PET and SPECT) Assen S. Kirov Department of Medical Physics Memorial.
JIM Deployment for the CDF Experiment M. Burgon-Lyon 1, A. Baranowski 2, V. Bartsch 3,S. Belforte 4, G. Garzoglio 2, R. Herber 2, R. Illingworth 2, R.
GRD - Collimation Simulation with SIXTRACK - MIB WG - October 2005 LHC COLLIMATION SYSTEM STUDIES USING SIXTRACK Ralph Assmann, Stefano Redaelli, Guillaume.
INFSO-RI Enabling Grids for E-sciencE Gilda experiences and tools in porting application Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
Alexandre A. P. Suaide VI DOSAR workshop, São Paulo, 2005 STAR grid activities and São Paulo experience.
A Grid Environment for Medical Imaging A Grid Environment for Medical Imaging LRMN Sorina POP, Tristan GLATARD.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Monte Carlo Instrument Simulation Activity at ISIS Dickon Champion, ISIS Facility.
Ian C. Smith 1 A portal-based system for quality assurance of radiotherapy treatment plans using Grid-enabled High Performance Computing clusters CR Baker.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.
Enabling Grids for E-sciencE Grid enabling ThIS CAVIAR Hugues BENOIT-CATTIN LRMN.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
Instrumentation of the SAM-Grid Gabriele Garzoglio CSC 426 Research Proposal.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
Improvement of the Monte Carlo Simulation Efficiency of a Proton Therapy Treatment Head Based on Proton Tracking Analysis and Geometry Simplifications.
Liverpool Experience of MDC 1 MAP (and in our belief any system which attempts to be scaleable to 1000s of nodes) broadcasts the code to all the nodes.
Comparison of MC and TP Dosimetry Simulations for Cancer Treatment Raymond Mumme May 12, 2014 Supervisor: Thiago Lima (PhD student) Head Supervisor: Dr.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 Parallelization of Monte Carlo simulations.
INFSO-RI Enabling Grids for E-sciencE Grid based telemedicine application for GATE Monte Carlo dosimetric studies using HOPE (Hospital Platform.
Flair development for the MC TPS Wioletta Kozłowska CERN / Medical University of Vienna.
GATE application example using SuperComputer 국립암센터 박 세 준 연구원.
Enabling Grids for E-sciencE LRMN ThIS on the Grid Sorina CAMARASU.
Chris Gavanas 31/08/2016 Summer Student Report.
Releases and developments
Opengate meeting 2017 – Marseille, France
Releases and developments
CNRS applications in medical imaging
Simulation use cases for T2 in ALICE
Simulation in a Distributed Computing Environment
Presentation transcript:

The GATE-LAB system Sorina Camarasu-Pop, Pierre Gueth, Tristan Glatard, Rafael Silva, David Sarrut VIP Workshop December 2012

1 GATE-LAB ? What is GATE-LAB ? It is one module in VIP, dedicated to GATE What is GATE ? A software for Monte-Carlo simulations in medical physics Particles tracking Both for imaging (PET, SPECT, X/proton-radiography, …) and radiation therapy (dose computation) Based on the Geant4 library fro particles physic (CERN) Open source Developed by the OpenGate collaboration Community of users (estimated to 1000 worldwide) First release of GATE in May 2004 ; 18 releases since 2 reference articles : [Phys Med Biol 2004 and 2011] (highly cited)

2 One example GATE simulation of proton cancer treatment Goal: study the dose distribution inside patient data Protontherapy treatment room CT patient data

3 One example Proton beam (complex) Track every particles inside biological material Store deposited energy Around 10 8 particles to track + secondaries About 7 days computing time brute-force, reference Proton beam intensity, energy position orientation

4 One example : results Example of dose distribution Overlaid on the CT data Computed with GATE More than 1 month comp time Done in few hours VIP/GateLab Speed up = 290

5 GATE-LAB specificities Why ? In general MC simulations can be very long (up to days) Access to grid or cluster need skills, not straightforward To provide easy and efficient access to Gate GATE-LAB started before VIP Started since 2008 Test version Open to public since Feb 2012 (beta) Tight integration between GATE and GATE-LAB GATE code has been modified to monitor the progress of the simulations to stop simulation on demand VIP-GATE-LAB has been adapted To manage all GATE output types Very high performance computer

6 What is the GateLab ? Design your simulations Click to load macro file in web browser Monitor simulation Click to download (merged) results Computing (x 10 3 jobs) Computing (x 10 3 jobs) GATE-LAB Upload all files Split simulation Handle errors Load balancing Merge results

7 One example From the GATE-LAB (VIP): Specific input parser Submission options: mode + GATE release Specific job monitoring Specific output merger

8 One example Specific input parser Load the main macro file Parse the macro file to find all needed files Archive and zip together all files Upload files on the GATE-LAB server

9 Launch simulation screen Simulation name Estimated time Gate release Type of submission Go !

10 Monitor simulation screen Total # of particles Current # of particles

11 One example Specific output merger GATE simulations can have multiple results Each result is split into several files (nb of jobs) The merger gather all files and merge them according to the file types One of the most critical point Could be long Incremental merger in development

12 N jobs, p particles. Two modes Static mode : Each job simulates p/N particles Dynamic mode : Jobs simulate particles until the system stops them Static vs Dynamic mode Static Dynamic Two times faster

13 Submission modes Which mode to use ? Dynamic : each job & events must be strictly equivalent If time is involved : use static mode For radiation therapy applications : dynamic For PET/SPECT, one run: static For PET/SPECT, multiple run : not (yet) possible Need to split according to time rather than Events, need refactoring

14 Limits of the GateLab No scripting possible (launch one simulation at a time) Difficult to manage large files Typically needed for phase-space Either as input or output Difficulty for simulation involving time (with jobs not equivalent, not interruptible)

15 Results - GateLab Currently, about 228 registered users About 25 active user/months Active user = launch at least 3 simulations About 200 simulations per months (except in summer...) Global average speedup around 50 (increasing !) Max speedup of 350 (taking queuing & merging time into account)

16 Conclusion GateLab allows easy and free high performance computation for Gate simulations Work in progress New splitting procedure for PET simulations New more robust merger Improved interface Feedback welcome ! Acknowledgments : Sorina Camarasu, Tristan Glatard, Rafael Ferreira da Silva, Pierre Gueth, David Sarrut