EGEE is a project funded by the European Union under contract IST-2003-508833 Generic Applications Requirements Roberto Barbera NA4 Generic Applications.

Slides:



Advertisements
Similar presentations
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Advertisements

An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
Job submission architectures in GRID environment Masamichi Ando M1 Student Taura Lab. Department of Information Science and Technology.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The CrossGrid project Juha Alatalo Timo Koivusalo.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Earth Simulator Jari Halla-aho Pekka Keränen. Architecture MIMD type distributed memory 640 Nodes, 8 vector processors each. 16GB shared memory per node.
Design and Implementation of a Single System Image Operating System for High Performance Computing on Clusters Christine MORIN PARIS project-team, IRISA/INRIA.
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
EGEE is a project funded by the European Union under contract IST EGEE Generic Applications Roberto Barbera NA4 Generic Applications Coordinator.
3DAPAS/ECMLS panel Dynamic Distributed Data Intensive Analysis Environments for Life Sciences: June San Jose Geoffrey Fox, Shantenu Jha, Dan Katz,
Virtualization Concept. Virtualization  Real: it exists, you can see it.  Transparent: it exists, you cannot see it  Virtual: it does not exist, you.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Tools and Utilities for parallel and serial codes in ENEA-GRID environment CRESCO Project: Salvatore Raia SubProject I.2 C.R. ENEA-Portici. 11/12/2007.
DISTRIBUTED DATA FLOW WEB-SERVICES FOR ACCESSING AND PROCESSING OF BIG DATA SETS IN EARTH SCIENCES A.A. Poyda 1, M.N. Zhizhin 1, D.P. Medvedev 2, D.Y.
EGEE is a project funded by the European Union under contract IST Input from Generic and Testing Roberto Barbera NA4 Generic Applications Coordinator.
Future role of DMR in Cyber Infrastructure D. Ceperley NCSA, University of Illinois Urbana-Champaign N.B. All views expressed are my own.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
A short introduction to the Worldwide LHC Computing Grid Maarten Litmaath (CERN)
A Grid Computing Use case Datagrid Jean-Marc Pierson.
EGEE is a project funded by the European Union under contract IST Messaging and queuing Common components Krzysztof Nienartowicz EGEE JRA1.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
INFSO-RI Enabling Grids for E-sciencE ES applications in EGEEII – M. Petitdidier –11 February 2008 Earth Science session Wrap up.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
EGEE is proposed as a project funded by the European Union under contract IST EU eInfrastructure project initiatives FP6-EGEE Fabrizio Gagliardi.
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
EGEE is a project funded by the European Union under contract IST JRA1-SA1 requirement gathering Maite Barroso JRA1 Integration and Testing.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
SA1/SA2 meeting 28 November The status of EGEE project and next steps Bob Jones EGEE Technical Director EGEE is proposed as.
EGEE is a project funded by the European Union under contract IST Status of NA4 Generic Applications Roberto Barbera Univ. di Catania e INFN.
Grid Middleware Tutorial / Grid Technologies IntroSlide 1 /14 Grid Technologies Intro Ivan Degtyarenko ivan.degtyarenko dog csc dot fi CSC – The Finnish.
Induction: Adding new applications to EGEE infrastructure –April 26-28, Adding new applications to EGEE infrastructure Roberto Barbera EGEE is.
Future of grids V. Breton CNRS. EGEE training, CERN, May 19th Table of contents Introduction Future of infrastructures : from networks to e-
INFSO-RI Enabling Grids for E-sciencE User Survey Objectives and Results F.Jacq CNRS-IN2P3 EGEE Conference - Athens 21 th April.
EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.
EGEE is a project funded by the European Union under contract IST Generic Applications in EGEE-NA4 Roberto Barbera NA4 Generic Applications.
INFSO-RI Enabling Grids for E-sciencE EGEE-2 NA4 Biomed Bioinformatics in CNRS Christophe Blanchet Institute of Biology and Chemistry.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
EGEE is a project funded by the European Union under contract IST EGEE Summary NA2 Partners April
Parallel IO for Cluster Computing Tran, Van Hoai.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE: Enabling grids for E-Science Bob Jones.
Cluster computing. 1.What is cluster computing? 2.Need of cluster computing. 3.Architecture 4.Applications of cluster computing 5.Advantages of cluster.
Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
The Helmholtz Association Project „Large Scale Data Management and Analysis“ (LSDMA) Kilian Schwarz, GSI; Christopher Jung, KIT.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Earth Observation inputs to ATF Annalisa Terracina EU-DataGrid Project Work Package 9 – EO Applications April 2003 CERN.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
EGEE is a project funded by the European Union under contract IST NA activities Roberto Barbera Technical Board INFN Grid, Bologna,
EGEE is a project funded by the European Union under contract INFSO-RI DGAS Grid accounting L.Gaido on behalf of A.Guarise LCG Workshop November.
Compute and Storage For the Farm at Jlab
Bob Jones EGEE Technical Director
Accessing the VI-SEEM infrastructure
Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming
WP18, High-speed data recording Krzysztof Wrona, European XFEL
EGEE Middleware Activities Overview
EGEE is a project funded by the European Union
Geoffrey Fox, Shantenu Jha, Dan Katz, Judy Qiu, Jon Weissman
Porting MM5 and BOLAM codes to the GRID
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Ruslan Fomkin and Tore Risch Uppsala DataBase Laboratory
Grid Computing.
CompChem VO: User experience using MPI
SA1 ROC Meeting Bologna, October 2004
University of Technology
Overview of big data tools
H2020 EU PROJECT | Topic SC1-DTH | GA:
Presentation transcript:

EGEE is a project funded by the European Union under contract IST Generic Applications Requirements Roberto Barbera NA4 Generic Applications Coordinator 1 st EGAAP Meeting, CERN,

1 st EGAAP Meeting, CERN, Contents Earth Sciences Requirements (short form) Earth Sciences Requirements (long form with priorities) Astro-particle Physics Requirements

1 st EGAAP Meeting, CERN, EO Applications Requirements Improvement on metadata handling (RMC, Spitfire) Improvement on security (restricted access, groups and roles within a VO) Improvement on scalability (e.g. number of files, file sizes). Improvement of the performance of most of the functionalities. Support for parallel programs (e.g. MPI, PVM)

1 st EGAAP Meeting, CERN, Climate Applications Requirements Handling of large data sets stored in different places and formats: This may include data sets combining hundred-thousands of files or other data objects for one analysis A secure but comfortable access to the mass storage archives (single- sign-on, data security, resource sharing) Resource broker services for transparent access to data and processing tools Concepts for load balancing, quality of service and assurance of data quality Definition of the role and permission for each partner of a VO to access metadata and data Integration of different scripting languages and COTS.

1 st EGAAP Meeting, CERN, Solid Earth Physics Applications Requirements MPI with Mirinet, SCI or other fast network and Fortran 90: The simulation proposed requires the possibility to submit a script and not only the executable. Modeling and imaging are also intrinsically parallel applications using large memory, medium to large exchanges between computing nodes with MPI, local scratch disk space and are heavy cpu intensive. Another requirement, not encountered in DataGrid, is the consistency between the compiler and libraries available on the UI and the ones needed by the cluster at the working node where the job is executed. Definition of the role and permission for each partner of a VO to access metadata and data Operational databases: update, mirroring, integrity, secure access and metadata handling. Secure access to external database such as the GPS and seismological databases

1 st EGAAP Meeting, CERN, Geophysics Applications Requirements MPI with Mirinet, SCI or other fast network and Fortran 90: The simulation proposed requires the possibility to submit a script and not only the executable. Modelling and imaging are also intrinsically parallel applications using large memory, medium to large exchanges between computing nodes with MPI, local scratch disc space and are heavy cpu intensive. Another requirement, not encountered in DataGrid, is the consistency between the compiler and libraries available on the UI and the ones needed by the cluster at the working node where the job is executed. Definition of the role and permission for each partner of a VO to access metadata and data Operational databases: update, mirroring, integrity, secure access and metadata handling. Secure access to external database such as the GPS and seismological databases

1 st EGAAP Meeting, CERN, Earth Sciences Requirements (long form with priorities) external document

1 st EGAAP Meeting, CERN, Astro-particle Physics Requirements (MAGIC Telescope) The security of all distributed system is an important topic. But the astroparticle physics community is purely scientific and therefore the security problems will not be as great as in field like medicine, pharmacy or genomic applications. This offers the use of already existing security mechanisms like the Globus Security infrastructure, etc. without any longer time lag due to not available stricter Security and Privacy mechanisms.

1 st EGAAP Meeting, CERN, Computational Chemistry Requirements