FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Development of test suites for the certification of EGEE-II Grid middleware Task 2: The development of testing procedures focused on special details of.
P-GRADE and WS-PGRADE portals supporting desktop grids and clouds Peter Kacsuk MTA SZTAKI
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
INAF - National Institute for Astrophysics The National Institute for Astrophysics coordinates and participates in the Astronomy and Astrophysics (A&A)
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
The EDGeS project receives Community research funding 1 SG-DG Bridges Zoltán Farkas, MTA SZTAKI.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
WS-PGRADE portal and its usage in the CancerGrid project M. Kozlovszky, P. Kacsuk Computer and Automation Research Institute of the Hungarian Academy of.
NOVA Networked Object-based EnVironment for Analysis P. Nevski, A. Vaniachine, T. Wenaus NOVA is a project to develop distributed object oriented physics.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Migrating Desktop Marcin Płóciennik Marcin Płóciennik Kick-off Meeting, Santander, Graphical.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
Architecture of Decision Support System
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
ELEMENTS OF A COMPUTER SYSTEM HARDWARE SOFTWARE PEOPLEWARE DATA.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
Application Software System Software.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Convert generic gUSE Portal into a science gateway Akos Balasko.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
STAR Scheduling status Gabriele Carcassi 9 September 2002.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
EGEE is a project funded by the European Union under contract IST Enabling bioinformatics applications to.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
STAR Scheduler Gabriele Carcassi STAR Collaboration.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
10 March Andrey Grid Tools Working Prototype of Distributed Computing Infrastructure for Physics Analysis SUNY.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Convert generic gUSE Portal into a science gateway Akos Balasko.
Practical using C++ WMProxy API advanced job submission
Data Bridge Solving diverse data access in scientific applications
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
Interpret the execution mode of SQL query in F1 Query paper
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste

Grids Grid is a computer service that allows to have access to enormous amounts of computing and disk space resources Grid is now a mature product. There are several grid implementation, each one with its own distinctive characteristics. gLite, EU funded project coordinated by EGI and EMI gLite is batch system grid, with schedulers an queues.

BaSTI Bag of Stellar Tracks and Isochrones. BaSTI is theoretical astrophysical catalogue that collects fundamental data set involving star formation and evolution. To create this database is necessary to run a large number of stellar evolutionary computations. BaSTI is based on relational database and have query and visualization capability.

FRANEC FRANEC is the evolutionary code used to populate BaSTI database. FRANEC calculate a synthetic model. To compute an isochrone it is necessary to execute a large number of synthetic model. The grid technology seems to be a good answer to data storage and processing needs of the BaSTI catalogue. We decide to build an application that use a gLite grid.

CLI Application The firs applicatio that was developed, was based on gLite user interface (UI). gLite UI is command line interfaces. The application was designed for the computation of isochrones. It can produces a large number of running jobs that can produce a large amount of data. It was develped to produce the data to populate BaSTI database. Application have to be used by an expert user

CLI Application The application consist of bash and per script. It uses grid services Workload Management System (WMS) is a computing resource broker Metadata catalogue AMGA, is a data catalogue that can service both as a directory service or as a light database Grid strorage and Logical File Catalog (LFC).

CLI Application First set of script manage the interaction with the user and creation of the configuration tasks. Second set is used to manage the interaction with the grid: job submission and monitoring. Each SM is identified by it initial data set and this data are saved in AMGA. Application before submitting a SM job checks whether it was already calculated. The output file are stored in grid and have an logical file name.

P-GRADE portal Extending the use of FRANEC to less experienced user, as for example students. To meet this needs it was opted to provide a graphical interface. P-GRADE web portal was chosen. Web portal: Provide graphical interface. Simplify the management of updates, being centralized. The access tool for the user is simple browser. Expandable through modules called portlets.

P-GRADE portal P-GRADE portal is specialized for grid interaction, both for job run and data access. The new application we developed is set of portlets with specific functionality. For less advanced user it is possible to specify the initial parameter of an SM and then by pressing a few buttons job is created and submitted in grid. The poweruser may also run parametric jobs, when some parameters was supplied through an interval of value with given step.

P-GRADE portal To develop this application it was necessary to go down to low level technical details on some components. This is not an optimal situation from a design and development point of view. This problem will be solved by adopting the succesor to P-GRADE, gUSE and WS-PGRADE, a web services based system where the graphical interface is separate from the services.

P-GRADE portal Another problem is that of digital certificates for occasional users. The time of isue of personal certificate is to long. This too, we hope will, be solved with the newer version because users will be allowed to submit only SM jobs and will no longer have access to the generic job submission facility. In this way the system will be a fully fledged service on its own, and so be able to submit jobs to the grid with its own grid certificate.

Conclusions We have seen that it is possible to create applications based on the grid and that the numerical simulations are ideal candidates for these applications. The use of graphical interfaces brings the technology, which may be complex, closer to users. Moreover the portal is more than just a graphical interface, but a tool to create new applications due to its reusable components and provided services. This is even more true with the gUSE and WS-PGRADE that combine a service-oriented architecture with modularity.

Conclusions The grid is an excellent way to provide computing resources to occasional users. Having these resources in house would be too expensive and wasteful. Therefore, the use of the grid is a strategic choice.

Thanks Massimo Sponza OATs - INAF