Compute Area Marco Cecchi Massimo Sgaravatto

Slides:



Advertisements
Similar presentations
SLA-Oriented Resource Provisioning for Cloud Computing
Advertisements

CREAM-CE status and evolution plans Paolo Andreetto, Sara Bertocco, Alvise Dorigo, Eric Frizziero, Alessio Gianelle, Massimo Sgaravatto, Lisa Zangrando.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
EMI INFSO-RI EMI Structure, Plans, Deliverables Alberto Di Meglio (CERN) Project Director ATLAS Software & Computing Week Geneva, 21 July 2011.
BOF: Megajobs Gracie: Grid Resource Virtualization and Customization Infrastructure How to execute hundreds of thousands tasks concurrently on distributed.
WNoDeS – Worker Nodes on Demand Service on EMI2 WNoDeS – Worker Nodes on Demand Service on EMI2 Local batch jobs can be run on both real and virtual execution.
RCA Consulting Thoughts on Post Merger Integration.
Editing Building Block (EBB) Validation Tool for FDI and ITS Balance of Payments Working Group 02 April 2012 Unit B4, IT for Statistical Production Georges.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EMI INFSO-RI Overview of the EMI development objectives Balázs Kónya (Lund University) EMI Technical Director EMI All Hands Prague, 23rd November.
The GridPP DIRAC project DIRAC for non-LHC communities.
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN)
Compute Area Status and Plans Marco Cecchi – INFN CNAF Massimo Sgaravatto – INFN Padova.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
EMI INFSO-RI Technical Overview Balázs Kónya (Lund University) Technical Director 1 st EMI Periodic Review Brussels, 22 June 2011.
EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.
New solutions for large scale functional tests in the WLCG infrastructure with SAM/Nagios: The experiments experience ES IT Department CERN J. Andreeva.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Requirements Status EGI.eu UCB
Some interest in common solutions in various areas – Federated data, common analysis framework, dashboards, SAM, clouds, …, etc In 2013 after end of EGI-SA3.
The GridPP DIRAC project DIRAC for non-LHC communities.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
DIRAC Distributed Computing Services A. Tsaregorodtsev, CPPM-IN2P3-CNRS FCPPL Meeting, 29 March 2013, Nanjing.
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CREAM: current status and next steps EGEE-JRA1.
ABOUT COMPANY Janbask is one among the fastest growing IT Services and consulting company. We provide various solutions for strategy, consulting and implement.
3 Compute Elements are manageable By hand 2 ? We need middleware – specifically a Workload Management System (and more specifically, “glideinWMS”) 3.
The Grid Information System Maria Alandes Pradillo IT-SDC White Area Lecture, 4th June 2014.
EGEE is a project funded by the European Union under contract IST Padova report Massimo Sgaravatto On behalf of the INFN Padova JRA1 Group.
CREAM Status and plans Massimo Sgaravatto – INFN Padova
Lund All Hands meeting Compute Area Section Massimo Sgaravatto INFN Padova.
JRA1/Job Submission and Monitoring Moreno Marzolla INFN Padova.
Claudio Grandi INFN Bologna Workshop congiunto CCR e INFNGrid 13 maggio 2009 Le strategie per l’analisi nell’esperimento CMS Claudio Grandi (INFN Bologna)
EMI is partially funded by the European Commission under Grant Agreement RI EMI Status And Plans Laurence Field, CERN Towards an Integrated Information.
HTCondor Accounting Update
Evolution of storage and data management
Requirements Determination
Kilian Schwarz ALICE Computing Meeting GSI, October 7, 2009
AMBIENT ASSISTED LIVING JOINT PROGRAMME
WLCG IPv6 deployment strategy
Review of the WLCG experiments compute plans
WLCG Workshop 2017 [Manchester] Operations Session Summary
CEMon
Chapter 1: Introduction to Systems Analysis and Design
Sviluppi in ambito WLCG Highlights
European Middleware Initiative (EMI)
Grid accounting system
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
EMI Interoperability Activities
PROTEAN: A Scalable Architecture for Active Networks
Massimo Sgaravatto INFN Padova On behalf of the CREAM product team
The CREAM CE: When can the LCG-CE be replaced?
Compute Client Harmonization opportunities
EMI-ES demo Emidio Giorgio INFN Catania
Infrastructure Area EMI All Hands Summary.
WLCG Collaboration Workshop;
Object Oriented Analysis and Design
GlobAL Public Procurement Conference September 2018
ORGANIZATIONAL Change management
Danilo Dongiovanni INFN-CNAF
WMS Options: DIRAC and GlideIN-WMS
Chapter 1: Introduction to Systems Analysis and Design
What is a Project? Project Defined Major Characteristics of a Project
Partner Implications from Seminar: New Approaches to Capacity Development Break-out Group: Role of Assessment frameworks.
An Overview of Project Management 5e.
Chapter 1: Introduction to Systems Analysis and Design
An Overview of Project Management 5e.
An Overview of Project Management 5e.
Presentation transcript:

Compute Area Marco Cecchi Massimo Sgaravatto

EMI Execution Service (EMI- ES) Compute Area EMI Execution Service (EMI- ES) Feeling that there is not a common vision. EMI-ES just as a prototype (since the goal is to implement and support something really standard) vs. EMI-ES as a production system Clarify EMI-ES support in WMS Find the right balance among objectives targeted to standardization, harmonization, removal of duplications, and requests coming from our user communities, otherwise there is the risk to lose some existing customers Pilot jobs Clear message from the WLCG WM TEG that the LHC experiments are all referring to pilot based frameworks and intend to keep following this path We should focus in this area, to address some existing issues Enhancing the functionality of the CE to implement a generic, non VO specific pilot factory Standardization of pilots and pilot based frameworks ?

Compute Area Some items in the workplan for the third year are risky There is not a clear understanding (yet) on what should be done e.g. for: Implement cloud strategy Integrate EMI delegation in compute services Implement EMI unified solution for service monitoring Some other items not in the workplan where work should be done: Support execution on user-defined virtual environments Possible implementations: WNODES, ... Improve batch system support in CREAM (SLURM and Condor) Support workflow in gLite WMS CREAM-LB integration