INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org Comp Chem and MAGIC (based on info from Den Haag and follow-up since) F Harris on behalf of.

Slides:



Advertisements
Similar presentations
Challenges for Interactive Grids a point of view from Int.Eu.Grid project Remote Instrumentation Services in Grid Environment RISGE BoF Manchester 8th.
Advertisements

An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
– n° 1 VO Magic – Planck – Compchem in the production infrastructure.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Dr. Harald Kornmayer A distributed, Grid-based analysis system for the MAGIC telescope, CHEP 2004, Interlaken1 H. Kornmayer, IWR, Forschungszentrum Karlsruhe.
Enabling, facilitating and delivering quality training in the UK and Internationally The challenge of grid training and education David Fergusson, Deputy.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
H. Kornmayer MAGIC-GRID Status report EGAAP meeting, Athens, 21th April EnablingGrids for E-sciencE Benefits of the MAGIC Grid Status report of.
BaBar Grid Computing Eleonora Luppi INFN and University of Ferrara - Italy.
INFSO-RI Enabling Grids for E-sciencE iASTRO MC MEETING&WORKSHOP, 27-30, APRIL, 2005,SOFIA, BULGARIA Introduction to Grid Technologies.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
A short introduction to the Worldwide LHC Computing Grid Maarten Litmaath (CERN)
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
H. Kornmayer MAGIC-GRID Status report EGAAP meeting, Athens, 21th April EnablingGrids for E-siencE Generic Application: Monte Carlo Production.
EGEE is a project funded by the European Union under contract IST Advances in the Grid enabled molecular simulator (GEMS) EGEE 06 Conference.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Enabling Grids for E-sciencE University of Perugia CompChem VO progress report NA4 Generic Applications Meeting – Jan 9 th, 2006 Catania,
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE – paving the way for a sustainable infrastructure.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Training services offered by SZTAKI for EGEE and EGI Gergely Sipos MTA SZTAKI (Hungarian.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE is a project funded by the European Union under contract IST Status of NA4 Generic Applications Roberto Barbera Univ. di Catania e INFN.
Enabling Grids for E- sciencE EGEE and gLite are registered trademarks EGEE-III INFSO-RI Analysis of Overhead and waiting times.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
Induction: Adding new applications to EGEE infrastructure –April 26-28, Adding new applications to EGEE infrastructure Roberto Barbera EGEE is.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III Proposal Draft Summary of activity.
INFSO-RI Enabling Grids for E-sciencE Deployment of CompChem VO Osvaldo Gervasi and Antonio Laganà University of Perugia, Italy.
Università di Perugia Enabling Grids for E-sciencE GEMS, Grid Enabled Molecular Simulations EGEE 1 st EU Review – 9 th to 11 th February.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
FESR Consorzio COMETA - Progetto PI2S2 GRID Success Stories in Sicily (The TriGrid VL and PI2S2 Projects) Roberto Barbera University.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
H. Kornmayer MAGIC-Grid EGEE, Panel discussion, Pisa, Monte Carlo Production for the MAGIC telescope A generic application of EGEE Towards.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 The EU DataGrid Project Three years.
INFSO-RI Enabling Grids for E-sciencE Introduction to the gLite tutorial: the GILDA t-Infrastructure for Dissemination and Training.
EGEE is a project funded by the European Union EGEE Generic Applications Advisory Panel (EGAAP) update and future Vassiliki KOTRONI National Observatory.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Spanish National Research Council- CSIC Isabel.
INFSO-RI Enabling Grids for E-sciencE Clermond-Ferrant (FR), February 11 th -14 th, 2008 Vangelis Daskalakis 1, Manos Giatromanolakis.
EGEE is a project funded by the European Union under contract IST The CompChem Virtual Organization EGEE 07 Conference Budapest (HU)‏ October.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Software Licensing in the EGEE Grid infrastructure.
Università di Perugia Enabling Grids for E-sciencE GEMS, Grid Enabled Molecular Simulations EGEE 1 st EU Review – 9 th to 11 th February.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE: Enabling grids for E-Science Bob Jones.
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
EGEE is a project funded by the European Union under contract IST The GILDA Testbed Valeria Ardizzone INFN Catania EGEE tutorial,
INFSO-RI Enabling Grids for E-sciencE VOCE & AUGER User Support a Current State & Future Plans Jan Kmuníček, Jiří Chudoba CESNET.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure Roberto Barbera.
INFSO-RI Enabling Grids for E-sciencE GILDA t-Infrastructure Antonio Fuentes Bermejo
First South Africa Grid Training June 2008, Catania (Italy) GILDA t-Infrastructure Valeria Ardizzone INFN Catania.
EGEE is a project funded by the European Union under contract IST Compchem VO's user support EGEE Workshop for VOs Karlsruhe (Germany) March.
INFSO-RI Enabling Grids for E-sciencE Resource allocation and negotiation update C. Vistoli, R. Rumler Operations workshop Bologna.
INFSO-RI Enabling Grids for E-sciencE The t-Infrastructure, Gilda Dr. Rüdiger Berlich, Forschungszentrum Karlsruhe / Germany Dr.
INFSO-RI Enabling Grids for E-sciencE Demonstrations Session Introduction Bob Jones 2 nd EGEE conference Den Haag, Netherlands 24.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract IST Report from.
EGEE is a project funded by the European Union under contract IST NA4/NA2 activities Roberto Barbera TB INFN Grid,
EGEE is a project funded by the European Union under contract IST NA activities Roberto Barbera Technical Board INFN Grid, Bologna,
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
BaBar-Grid Status and Prospects
EGEE is a project funded by the European Union
Ian Bird GDB Meeting CERN 9 September 2003
CompChem VO: User experience using MPI
SA1 ROC Meeting Bologna, October 2004
LHC Data Analysis using a worldwide computing grid
The LHCb Computing Data Challenge DC06
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE Comp Chem and MAGIC (based on info from Den Haag and follow-up since) F Harris on behalf of Harald Kornmayer(MAGIC) Osvaldo Gervasi(Comp Chem)

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, MAGIC Telescope Ground based Air Cerenkov Telescope LaPalma, Canary Islands ( 28° North, 18° West ) 17 m diameter operation since autumn 2003 (still in commissioning) Collaborators: IFAE Barcelona, UAB Barcelona, Humboldt U. Berlin, UC Davis, U. Lodz, UC Madrid, MPI München, INFN / U. Padova, U. Potchefstrom, INFN / U. Siena, Tuorla Observatory, INFN / U. Udine, U. Würzburg, Yerevan Physics Inst., ETH Zürich

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, CrossGrid LCG-2 testbed with extentions from CrossGrid 16 sites in Europe(? All going to LCG) The first prototype for a MC production system for the MAGIC telescope exists  A europeanwide system will be setup together with CNAF, PIC and GridKA

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, MAGIC – Monte Carlo Simulation Based on the air shower simulation program CORSIKA Simulation of hadronic background is very CPU consuming –to simulate the background of one night, 70 CPUs (P4 2GHz) needs to run days –to simulate the gamma events of one night for a Crab like source takes 288 days. –The detector/atmosphere is volatile. Only with a coordinated effort can help to connect distributed resources  MAGIC Grid

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Simulation – first test on GILDA The GILDA testbed has been used to get experience on the GRID middleware NA4 implemented a webportal for MAGIC to submit one simulation on the GILDA testbed. The MMCS software was packed in a rpm to deploy it on the GILDA testbed  demo

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, The plans for the future A magic Virtual Organisation already exists –VO server is hosted by SARA/NIKHEF CNAF will support the magic VO with a Resource Broker PIC will support the magic VO with storage and the RLS CNAF, PIC and GridKA will provide CPU cycles GILDA can be used for the first test too Others sites can join the MC data challenge Feb 2005 –(hopefully) Usage of the CrossGrid Migrating Desktop/Roaming Access Server to provide a user friendly GUI for potential Grid Users

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Resources for MAGIC NOW –Just ordered a blade cluster of 112 CPUs, 10 Tbyte of disk Storage and 50 Tbyte of tape storage. (? Do they get unique use of this-probably not) NEEDS in 2005 –200 CPUs –5TByte disk storage Regional Support –The following regions have ‘promised’ % of their resources(list from Bob Jones) –Slovenia 20% –Hungary 11% –Poland 5% –Netherlands 100% (up to, prioritisation will be applied!) –Russia 2.5% –Italy 2% –France 1% –UK.5% –Germany,Spain ??

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Grid based European Molecular Simulator (GEMS)

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, List of candidate members Institution #Researchers Dept.Chemistry, University of Barcelona5 Dept. Physical Chemistry, Univ. Basque Country3 Institute of Chemistry, Hungarian Academy of Sciences2 School of Chemistry, Bristol3 Institute for Theoretical Chemistry and Structural Biology University of Vienna 3 Department of Chemistry, University of Bari, 3 Department of Chemistry, Univesity of Bologna 3 ISTM, Italian National Research Council, Perugia6 Dept. of Chemistry, University of Perugia5 COST working groups 27 TOTAL 60 Sites will gradually build up dedicated resources – some orders already made

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Resources for Comp Chem NOW – Will bring a cluster of 14 biproc. Nodes REQUEST for early 2005 (?some satisfied by them) –16 CPUs with at least 2GB of RAM –64 – 128 nodes with no special requirements in terms of RAM –? Check on storage needs and plans for use of RLS Regional Support (who is ‘owner’ of this information?) –The following regions have ‘promised’ % of their resources –Czech Republic 30% –Hungary 10% –Poland 27% –Russia 2.5% –Italy 2% –France 1% –UK.5%

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Deployment of the VO Even if all technical aspects have been implemented and we should able to start the deployment of the CompChem VO, we have chosen to begin in a stable environment. We have chosen so far to adopt GILDA certificates participating to the test bed infrastructure –A new Resource Centre has been ported into GILDA (13 nodes + CE + SE) –A User Interface has been created to interface the user to the Grid –A prototype implementation of the Molecular Simulator has been deployed (DEMO at Den Haag-chosen for review) –Also a prototype implementation of the Molecular Simulator has been deployed in GENIUS, thanks to the collaboration with INFN Catania and CNAF people

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Issue related to ComChem VO The implementation of the prototype has shown the most relevant aspects of GEMS –Interactive access to the Grid through Sockets  We use the supported set of ports: , left open by the firewall in all nodes of the Grid  We need a small latency to schedule the job on the Grid –Parallel and distributed nature of most CompChem programs  MPI prerequisite in all nodes  We need the highest possible number of Working Nodes

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Issue related to ComChem VO –Commercial Licence of some programs  Some programs, especially those for the Ab Initio calculations (GAMESS, MOLPRO, MOLCAS, etc) require a Commercial Licence even if used for Research purposes.  A strategy for acquiring the licences for the users of the Grid may be sought.  Several sites own the licence for various programs in their machines. We need a mechanism to map the sites owning those programs, so that using this information the user may specify such requisite in the JDL script, when submitting the job to the Grid.

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, Populating the VO Have started the the deployment of the VO, following the instructions in A consortium agreement will be signed with the participating institutions. We will contribute to the Grid with new resources and expertise. A new COST D23 Action called GridChem will be started next year following the ending initiative MetaChem.

INFSO-RI Enabling Grids for E-sciencE New Generic Applications selected at Den Haag Roberto Barbera, Univ. of Catania and INFN NA4/SA1 Meeting, CERN,

Enabling Grids for E-sciencE INFSO-RI NA4/SA1 Meeting, CERN, New Generic Applications Earth Science: Hydrology –users will go into ESR VO Earth Science: Seismology –users will to into ESR VO GRACE –users will stay in the GILDA VO till the end of the Project ( ) Drug discovery –users will go into Biomed VO Astrophysics and cosmology: PLANCK satellite –new VO needed ! –VO manager: Giuliano Taffoni –VO server and RLS most probably hosted at INFN CNAF