Manuel Delfino Director, Port d’Informació Científica (PIC) GRID activities in Spain Brief personal summary for the INFN-Grid Workshop Bari, 27 October 2004 Manuel Delfino Director, Port d’Informació Científica (PIC) 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Outline General info about structure of research in Spain EU DataGrid and CrossGrid The LCG-ES Coordinated Project as part of LCG Phase 1 INFN-CICYT bilateral collaboration on CASTOR EGEE in Spain The IRIS-Grid initiative Coordination Action on Middleware Development Grid in the National Research Plan 2004-2007 Outlook for the short and medium term 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

General info about research in Spain There is no thematic or general “National Institute” ~40% of spanish basic research is in the CSIC, which is a general public research entity and covers from medieval history to nanotechnology The different Autonomic Communities which compose Spain have different degrees of competences. This includes Universities and Research. Andalucía, Catalunya, Euskadi, Galicia and Madrid fund or co-fund quite a bit of research + infrastructures (this is the case of PIC, for example) There are also “mixed centers” University-CSIC Research is done in other areas, for example in Health, but the coordination with basic research is not great R&D spending is ~factor of two lower than it should be. Public sector spending is not so low. Industrial research is very low. 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Example: The Academic Network Catalunya:Anella Científica + National:RedIRIS + GEANT 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari LCG-ES IFCA (CMS) USC (LHCb) PIC (LCG) IFAE (ATLAS) CIEMAT (CMS) UB (LHCb) UAM (ATLAS) IFIC (ATLAS) LCG-ES is a Coordinated Project of 7 Groups involved in 3 LHC experiments + PIC It is a development and deployment project, not an R&D project. You can think of it as the overlapped “pre-production” , “pre-assembly” and “development of Engineering Design Report” of the Computing Subdetector in 36 months. 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Elementos del Proyecto Coordinado LHCb EADs MCF ETD GDC PIC GRD GVM LCG GSW EDS CTS CDC RSG SEG ATLAS CMS 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Elementos del Proyecto Coordinado LHCb EADs MCF ETD GDC PIC GRD GVM LCG GSW EDS CTS CDC RSG SEG ATLAS CMS 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

An example of a large facility in Spain: IFIC-Valencia 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

PIC: the Spanish Tier-1 center for LHC Multi-disciplinary HEP: ATLAS, CMS, LHCb, MAGIC, K2K, CDF Medical Imaging Earth Observation Molecular Biology 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari CMS DC ATLAS DC LCG-ES 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Collaboration with Medical Imaging Unit of Hospital Parc Taulí in Sabadell The past The present and future 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Detectores digitales para mamografía instalados en la UDIAT del Parc Taulí Futuro: Desarrollo de innovación proyecto U.E. Dear-Mama (Detection of Early Markers in Mammography http://xray.ifae.es) IFAE (coordinador) Centro Nacional de Microelectrónica UDIAT-Parc Taulí Universidad de Viena Hôpital d’Enfants Armand Trousseau de Paris (empresa española en proceso de negociación con la UE) 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Outline General info about structure of research in Spain EU DataGrid and CrossGrid The LCG-ES Coordinated Project as part of LCG Phase 1 INFN-CICYT bilateral collaboration on CASTOR EGEE in Spain The IRIS-Grid initiative Coordination Action on Middleware Development Grid in the National Research Plan 2004-2007 Outlook for the short and medium term 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

EGEE Federation Structure 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

From LCG-2 to EGEE-0: Grid Infrastructure becomes a reality INTA-CAB = Centro de Astrobiología CNB = Centro Nacional de Biotecnología 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari EGEE Southwest Europe Consortium participants (after first Contract Amendment) Portugal Laboratório de Instrumentação e Física Experimental de Partículas (LIP, Lisboa) SA1-Backup Operations Team Spain Fundación Centro Tecnológico de Supercomputación de Galicia (CESGA, Santiago de Compostela) SA1-Monitoring and Accounting Consejo Superior de Investigaciones Científicas Centro Nacional de Biotecnología (CNB, Madrid) NA4-Molecular Biology Instituto de Física de Cantabria (IFCA, Santander) SA1-CA Interoperation Instituto de Física Corpuscular (IFIC, Valencia) SA1-VO Management Institut de Física d’Altes Energies (coordinator) SA1-Operations Team Port d’Informació Científica (PIC, Barcelona) (also funded by CIEMAT and UAB) Instituto Nacional de Técnica Aeroespacial Centro de Astrobiología (CAB, Madrid) SA1-Middleware problem analysis Universidad Politécnica de Valencia (UPV) NA4-Bio-medicine Red.es Rediris NA5-Policies, eIRG participation Telefónica I+D SA1-Process Engineering 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Activities SA1 + SA2 “Operations” 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari SW Federation– User Support Structure NB: “User” = “Expert” or “SysAdmin” initially The support structure has two levels Front end support Back end support There are two front end support centres (at LIP and PIC) which deal directly with the end-users and site administrators that need help. This split allows for a better contact with the end-users and site administrators The front-ends speak the national language (Portuguese, Spanish) The front-ends are awere of the national specificities The front-ends filter the requests and answer them directly if possible, otherwise the requests are scaled to the experts in the back-end. The “Back-end Level” is country independent. It is composed by areas of expertise (boxes), containing a group of experts for each area, from all SA1 partners in the SW federation: LIP, IFIC, CESGA, IFCA, CAB, PIC. 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

SW Federation– User Support Structure Front-end Level Portugal - LIP Spain - PIC Back-end Level Administrators Support Users & Applications Support ...... .... TB Admin TB setup Area 2 Area n TB Usage Appl 1 Appl 2 Area n 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

PIC: Foto de familia primavera 2004 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

PIC: Evolución del personal +2 Acuerdo colaboración con Telefónica I+D 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari PIC: Safety features Global Laser-based smoke detection Potassium Carbonate powder fire extinguishing “bombs” 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

PIC: Electrical safety features 200 KVA de electricidad “capilarizada” Individual Rack Smoke Detectors connected to Electrical Breakers 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Transformadores de Datos, Servidores de Disco y Cinta, Virtualizadores de Servicios 120 Dell P4 3 GHz HT Grid UI, RB, BDII, SE, CE “Pizza + TeraBrik” Disk Servers Dell Poweredge Tape Servers 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Motivation for collaboration PIC / Telefonica I+D Source: Gartner Group, April 1999 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Resources and Infrastructure The CNRS has Offered 23 WNodes to the Biomed VO. On the Other Side, the UPV has Set up 4 LCG-2 Nodes. Problems in the Installation of LCG-2 are being Faced to Increase the Number of Donated Nodes. Red Hat 7.1 is not Compatible at CE Level Due to Incompatibilities with the Libraries. Targets: Source Code Will be Recompiled and only WN will be Ported to the RH 7.1 Systems. Installed Nodes Run Fedora and Red Hat 7.3. The UPV has Set up a RB and a UI to be Shared with the IBCP. The Total Number of Nodes UPV-IBCP will be Around 8. More Nodes Will be Needed when the Applications will be on Production Stage. Slide courtesy of V. Hernández, UPV Second NA4 Biomed Meeting, 8 June 2004 - 26

Clinical Decision Support Systems (CDSS) Application that Extracts Medically Relevant Knowledge from a Large Set of Information with the Objective of Guiding the Practitioners in their Clinical Practice. A Medical Knowledge Base (KB) is a Systematically Organized Collection of Medical Knowledge that is Accessible Electronically and Interpretable by the Computer. Similar, but not Computer-Based System do Exists Since 1950s. The CDSS do not Substitute Human Medical Decision, but Improves Factors such as Sensitivity, Sensibility and Working Conditions. Clinical Decision Support Systems exist since the late 50s. Original Systems were based on decision trees and written guidelines, and computer-based systems appeared with the development of artificial intelligence and expert systems. By definition, a Clinical Decision Support System (CDSS) is an Application that Extracts Medically Relevant Knowledge from a Large Set of Information with the Objective of Guiding the Practitioners in their clinical Practice. CDSS rely on Medical Knowledge Bases, which are a systematically organized collections of medical knowledge that can be accessed and interpreted electronically by a computer. Finally, it is important to say that this kind of tools do not substitute human medical decision. Clinics use this tools for increasing the performance in factors such as the sensibility and sensitivity, and they also reduce tedious work, focusing expert’s attention on the interesting cases. Slide courtesy of V. Hernández, UPV Second NA4 Biomed Meeting, 8 June 2004 - 27

Slide courtesy of V. Hernández, UPV Re-Design of the CDSS The Grid Version (and the CDSS Itself) was Developed Under a Service-Based Approach. LCG2 is Globus 2.X-Based, and Redesign was Needed. Needs A Service-Oriented Interface to the Grid Middleware. A Web-based User Interface. Automatic Management of Login and Security. Efficient Execution of Short Jobs. Ubiquitous Access to Databases and Classifier Engines. Slide courtesy of V. Hernández, UPV Second NA4 Biomed Meeting, 8 June 2004 - 28

Slide courtesy of V. Hernández, UPV Final Grid Structure Slide courtesy of V. Hernández, UPV LCG GRID The Web User Interface Web Server Replica Manager Resource Broker Request.xml Https + User Certificate Reports.xml SE UI WN CE UI WN CE UI WN CE UI Java Web Start Web Browser Https Second NA4 Biomed Meeting, 8 June 2004 - 29

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Outline General info about structure of research in Spain EU DataGrid and CrossGrid The LCG-ES Coordinated Project as part of LCG Phase 1 INFN-CICYT bilateral collaboration on CASTOR EGEE in Spain The IRIS-Grid initiative Coordination Action on Middleware Development Grid in the National Research Plan 2004-2007 Outlook for the short and medium term 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari

Coordination Action for Grid Middleware Initiatives in Spain asds.dacya.ucm.es/GridMiddleware Goal Promote and support the coordination of research groups in Grid middleware in Spain Partners Financial Support Ministerio de Ciencia y Tecnología Information about projects at asds.dacya.ucm.es/GridMiddleware/grupos 64 Researchers 18 Universities and Research Centers 3 Companies

asds.dacya.ucm.es/gridway The GridWay Project asds.dacya.ucm.es/gridway Goal and Philosophy To provide an easier and more efficient execution of jobs (submit & forget) on heterogeneous, dynamic and loosely coupled Grids. Features Easy to Adapt (modular design) Easy to Scale (decentralized architecture) Easy to Deploy (user, standard services) Benefits Adaptive scheduling Adaptive execution Self-adaptive applications Fault-tolerance Distributed Resource Management Application API (DRMAA) implementation Financial Support ICASE, NASA Langley Research Center, 2002 INTA (Instituto Nacional de Técnica Aeroespacial), 2002- Ministerio de Ciencia y Tecnología, 2002- Research papers and reports at asds.dacya.ucm.es/curriculum

GRID superscalar people.ac.upc.es/rosab/index_gs.htm Goal and Philosophy To reduce the development complexity of Grid applications to the minimum. Techniques inspired on the superscalar processors, as exploitation of the concurrency of a data dependence graph, renaming and forwarding, are applied. Benefits GRID superscalar allows the users to increase the performance of its applications, written as sequential code, by enabling to execute them as parallel applications on a Grid Features Automatic code generation and binary deployment Automatic data dependence analysis On demand file transfers Task scheduling, resource brokering Job submission Task level checkpointing GT2 enabled Financial Support CoreGRID Ministerio de Ciencia y Tecnología, 2004-2008 initialization(); for (i=0; i<N; i++){ T1 (“file1.txt”, “file2.txt”); T2 (“file4.txt”, “file5.txt”); T3 (“file2.txt”, “file5.txt”, “file6.txt”); T4 (“file7.txt”, “file8.txt”); T5 (“file6.txt”, “file8.txt”, “file9.txt”); } Grid T10 T20 T30 T40 T50 T11 T21 T31 T41 T51 T12 …

Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari Outline General info about structure of research in Spain EU DataGrid and CrossGrid The LCG-ES Coordinated Project as part of LCG Phase 1 INFN-CICYT bilateral collaboration on CASTOR EGEE in Spain The IRIS-Grid initiative Coordination Action on Middleware Development Grid in the National Research Plan 2004-2007 Outlook for the short and medium term 27 October 2004 Grid Activities in Spain / M. Delfino / INFN-Grid meeting Bari