INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org A Grid Approach to Distributed Image Analysis for Early Diagnosis of Alzheimer Disease Livia.

Slides:



Advertisements
Similar presentations
Remote Visualisation System (RVS) By: Anil Chandra.
Advertisements

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
Integromics: a grid-enalbled platform for integration of advanced bioinformatics tools and data Luca Corradi Luca Corradi BIO-Lab,
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
NA4 Generic Applications Meeting January 2006 – Catania, Italy GRID node for biomedical applications: distributed image analysis for early diagnosis.
INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE The Medical Data Manager : the components Johan Montagnat, Romain Texier, Tristan.
INFSO-RI Enabling Grids for E-sciencE Project Gridification: the UNOSAT experience Patricia Méndez Lorenzo CERN (IT-PSS/ED) CERN,
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks AMGA PHP API Claudio Cherubino INFN - Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management and Interoperability Peter Kunszt (JRA1 DM Cluster) 2 nd EGEE Conference,
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
Introduction to The Storage Resource.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
EGEE-0 / LCG-2 middleware Practical.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GLite testing status and future Gianni Pucciani.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
EGEE-II INFSO-RI Enabling Grids for E-sciencE P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features)
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
INFSO-RI Enabling Grids for E-sciencE Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives, Sofia, South.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra GSAF Grid Storage Access Framework Salvatore Scifo INFN of Catania EGEE.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler.
The Institute of High Energy of Physics, Chinese Academy of Sciences Sharing LCG files across different platforms Cheng Yaodong, Wang Lu, Liu Aigui, Chen.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
1 Support for parameter study applications in the P-GRADE Portal Gergely Sipos MTA SZTAKI (Hungarian Academy of Sciences)
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
Enabling Grids for E-sciencE LRMN ThIS on the Grid Sorina CAMARASU.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
INFSO-RI Enabling Grids for E-sciencE ESR Database Access K. Ronneberger,DKRZ, Germany H. Schwichtenberg, SCAI, Germany S. Kindermann,
Practical using C++ WMProxy API advanced job submission
Grid2Win Porting of gLite middleware to Windows XP platform
gLite Basic APIs Christos Filippidis
Grid Computing: Running your Jobs around the World
Creating and running applications on the NGS
Roberto Barbera (a nome di Livia Torterolo)
AMGA Web Interface Salvatore Scifo INFN sez. Catania
Attività grid di Biomedicina in Italia e in Europa
AMGA Web Interface Vincenzo Milazzo
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE A Grid Approach to Distributed Image Analysis for Early Diagnosis of Alzheimer Disease Livia Torterolo University of Genoa / DIST EGEE User Forum CERN,

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Agenda Introduction to SPM analysis and to development of a web-based SPM service GRID implementation of SPM service Current Status and Plans

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Partners The first part of the work has been done during the Italian Neuroinformatics OCSE Node project in collaboration with –San Raffaele Hospital of Milano –University of Milano – Bicocca GRID implementation has been carried out by Bio-Lab at DIST, University of Genoa, during the Grid.it Italian project The application is a quite stable work in progress and served as a demostrator for the Grid.it project but further developments and extensions are in progress still inside the GILDA testbed

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Introduction to Alzheimer Disease AD is the most common form of dementia, accounting from 50% to 70% of all dementias in elderly people (around 3 million people in EU25) Clinically, AD is characterized by a progressive loss of cognitive abilities Memory loss is typically the earliest sign of AD

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Analysis of PET-SPECT images

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Results of a SPM analysis on a PET study of glucose metabolism in a patient with dementia. Ipometabolic pattern in the frontal cortex: design matrix (top right), statistically significant clusters on a glass brain in three orthogonal planes (top left) and on a 3D brain rendering (bottom) SPM Results

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Why a portal? The remote access to SPM analysis could provide doctors from peripheral hospitals with an invaluable tool to run the analysis remotely only using a standard browser web No particular HW resources or computer knowledge are required In order to avoid errors during the analysis, only selected users should access and use the servicehttp://

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, SPM: Why GRID? A large set of images of normal patients is required to be used for comparison PET and SPECT studies on normal subjects are very rare Images of patients are covered by privacy and security issues and for this reason they cannot be freely moved on the net or published by the centre that made the analysis

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Contribution to GILDA LCG Grid Environment v machines dedicated to LCG NODE: 1 CE, 1 SE, 3 WNs, 1 UI, 1 LCG install server ( 12 CPUs, 7Giga (RAM), ≈ 350Giga of storage)

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Data Management and File Access tools: to access data from User Interface using Logical File Names (LFN) LCG File Catalog (LFC): to register data into the catalog AMGA Metadata Catalog: to add related metadata to data LCG tools used

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Data Management and File Access

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, LCG File Catalog (LFC) Several functionalities: Use of lcg_utils Use of GFAL calls Use of GSI certification Access to grid file in SEs from “anywhere” Several replicas of files in different sites Copy of data from/to local file system to GRID

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, AMGA: ARDA Metadata Grid Application  Side-by-Side a File Catalogue (LFC): File Metadata  Access control to resources on the Grid is done via VOMS  Different front-end: –mdcli & mdclient and C++ API –Java Client API and command line mdjavaclient.sh & –mdjavacli.sh (also under Windows !!) –Python Client API  Strong security requirements: –patient data is sensitive –metadata access must be restricted to authorized users

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, GRID-Design of the application With reference to different LCG tools mentioned above, application code has been modified in the following way: –Registration and storage of data files (PET/SPECT images) on SEs available using lcg_utils interacting with LFC and AMGA. –Development of a C program with GFAL C API in order to access distributed images using their LFNs and to extract some information necessary to SPM analysis without copying them locally. –Job Submission: creation of a JDL file to submit the executable (and not the images) with GFAL call to the GRID. –Statistical Analysis: running of SPM analysis from results obtained from job submission. Statistical analysis is performed outside GRID environment.

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Final GRID structure

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Application Running: Setting Parameters Setting SPM parameters Selection of normal subjects QUERIES to AMGA !

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Application running: JOB SUBMISSION SPM Analysis RESULTS

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Issues & Problems Pros: –Data distribution over different SEs accessed with GFAL APIs. –Integration of a Grid application into an existing environment with hard constraints and several integration problems to solve –Application behaviour to the user unchanged Cons: –GFAL API not well documented & Compatibility issues and conflicts on libraries (but good support from GILDA staff) –Too much components (Zope + Plone, Python, shell scripts, Matlab, C/C++ compiled code, …& Grid!) –Software maintenance is hard

Enabling Grids for E-sciencE INFSO-RI EGEE User Forum, CERN, Current Status and Plans Application –pre-processing parallelization (further functions to port on Grid) Interface –move to Genius 3.1 Overall framework –improve performance and scalability –A Grid environment devoted to the analysis of microarrays, derived from this project, will be tested in the frame of European Project BioinfoGRID (Bioinformatics Application for Life Science) –A bioinformatics data storage and analysis platform with metadata support will be developed under Italian MIUR-FIRB project LITBIO (Laboratory for Interdisciplinary Technologies in Bioinformatics) Thanks for your attention!