ALICE & Clouds GDB Meeting 15/01/2013 Predrag.Buncic@cern.ch.

Slides:

Advertisements

Similar presentations

SLA-Oriented Resource Provisioning for Cloud Computing

Advertisements

Xrootd and clouds Doug Benjamin Duke University. Introduction Cloud computing is here to stay – likely more than just Hype (Gartner Research Hype Cycle.

HEPiX Virtualisation Working Group Status, July 9 th 2010

T1 at LBL/NERSC/OAK RIDGE General principles. RAW data flow T0 disk buffer DAQ & HLT CERN Tape AliEn FC Raw data Condition & Calibration & data DB disk.

CHEP 2012 – New York City 1.  LHC Delivers bunch crossing at 40MHz  LHCb reduces the rate with a two level trigger system: ◦ First Level (L0) – Hardware.

Tunis, Tunisia, June 2012 Cloud Research Activities Pr. Mohamed JEMNI Computing Center Al Khawarizmi (CCK) Research Laboratory LaTICE

Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo

Pilots 2.0: DIRAC pilots for all the skies Federico Stagni, A.McNab, C.Luzzi, A.Tsaregorodtsev On behalf of the DIRAC consortium and the LHCb collaboration.

The Grid System Design Liu Xiangrui Beijing Institute of Technology.

Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.

WNoDeS – Worker Nodes on Demand Service on EMI2 WNoDeS – Worker Nodes on Demand Service on EMI2 Local batch jobs can be run on both real and virtual execution.

PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

Support in setting up a non-grid Atlas Tier 3 Doug Benjamin Duke University.

CernVM WebAPI CernVM Users Workshop 2015 Ioannis Charalampidis, PH/SFT CERN, 5 March 2015.

ALICE Offline Week | CERN | November 7, 2013 | Predrag Buncic AliEn, Clouds and Supercomputers Predrag Buncic With minor adjustments by Maarten Litmaath.

1 The Adoption of Cloud Technology within the LHC Experiments Laurence Field IT/SDC 17/10/2014.

Virtualised Worker Nodes Where are we? What next? Tony Cass GDB /12/12.

Trusted Virtual Machine Images a step towards Cloud Computing for HEP? Tony Cass on behalf of the HEPiX Virtualisation Working Group October 19 th 2010.

Grid and Cloud Computing Alessandro Usai SWITCH Sergio Maffioletti Grid Computing Competence Centre - UZH/GC3

Federating PL-Grid Computational Resources with the Atmosphere Cloud Platform Piotr Nowakowski, Marek Kasztelnik, Tomasz Bartyński, Tomasz Gubała, Daniel.

2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.

CLOUD COMPUTING. What is cloud computing ??? What is cloud computing ??? Cloud computing is a general term for anything that involves delivering hosted.

DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,

Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.

Family Connection Collaborative Webs A Tool for Creating and Managing Web sites.

Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.

Workload management, virtualisation, clouds & multicore Andrew Lahiff.

AliEn central services Costin Grigoras. Hardware overview  27 machines  Mix of SLC4, SLC5, Ubuntu 8.04, 8.10, 9.04  100 cores  20 KVA UPSs  2 * 1Gbps.

Vignesh Ravindran Sankarbala Manoharan. Infrastructure As A Service (IAAS) is a model that is used to deliver a platform virtualization environment with.

Cloud Computing. new buzz word driven largely by marketing and service offerings Provided by big corporate players Google IBM Amazon Apple.

OpenStack Chances and Practice at IHEP Haibo, Li Computing Center, the Institute of High Energy Physics, CAS, China 2012/10/15.

ALICE Software Evolution Predrag Buncic. GDB | September 11, 2013 | Predrag Buncic 2.

Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.

NA61 Collaboration Meeting CERN, December Predrag Buncic, Mihajlo Mudrinic CERN/PH-SFT Enabling long term data preservation.

INFN OCCI implementation on Grid Infrastructure Michele Orrù INFN-CNAF OGF27, 13/10/ M.Orrù (INFN-CNAF) INFN OCCI implementation on Grid Infrastructure.

Breaking the frontiers of the Grid R. Graciani EGI TF 2012.

Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.

Trusted Virtual Machine Images the HEPiX Point of View Tony Cass October 21 st 2011.

INFSO-RI Enabling Grids for E-sciencE Grid & Cloud Computing Introduction

PRIN STOA-LHC: STATUS BARI BOLOGNA-18 GIUGNO 2014 Giorgia MINIELLO G. MAGGI, G. DONVITO, D. Elia INFN Sezione di Bari e Dipartimento Interateneo.

The HEPiX Virtualisation Working Group Towards a Grid of Clouds Tony Cass CHEP 2012 May 24 th 2012.

Predrag Buncic, CERN/PH-SFT The Future of CernVM.

Storage discovery in AliEn

Virtual machines ALICE 2 Experience and use cases Services at CERN Worker nodes at sites – CNAF – GSI Site services (VoBoxes)

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.

DIRAC: Workload Management System Garonne Vincent, Tsaregorodtsev Andrei, Centre de Physique des Particules de Marseille Stockes-rees Ian, University of.

Kilian Schwarz ALICE Computing Meeting GSI, October 7, 2009

WLCG IPv6 deployment strategy

Review of the WLCG experiments compute plans

(Prague, March 2009) Andrey Y Shevel

Use of HLT farm and Clouds in ALICE

Update on revised HEPiX Contextualization

AWS Integration in Distributed Computing

Virtualisation for NA49/NA61

Blueprint of Persistent Infrastructure as a Service

Dag Toppe Larsen UiB/CERN CERN,

Dag Toppe Larsen UiB/CERN CERN,

Design rationale and status of the org.glite.overlay component

ATLAS Cloud Operations

GSIAF & Anar Manafov, Victor Penso, Carsten Preuss, and Kilian Schwarz, GSI Darmstadt, ALICE Offline week, v. 0.8.

Virtualisation for NA49/NA61

Cloud Management Mechanisms

FCT Follow-up Meeting 31 March, 2017 Fernando Meireles

Chapter 21: Cloud Computing and Related Security Issues

CernVM Status Report Predrag Buncic (CERN/PH-SFT).

WLCG Collaboration Workshop;

VMDIRAC status Vanessa HAMAR CC-IN2P3.

Chapter 22: Cloud Computing Technology and Security

Support for ”interactive batch”

Technical Capabilities

Presentation transcript:

ALICE & Clouds GDB Meeting 15/01/2013 Predrag.Buncic@cern.ch

Status As of no, no official strategy for use Clouds in ALICE Initial work has started in the context of enabling HLT farm for dual online/offline use (…) Based on CernVM family of solutions The computing model of ALICE is relatively flat and Cloud friendly Uniform data access using xrootd Single task queue Only outgoing network connectivity required for services other than storage No real distinction between T1/T2 We accept virtualized grid worker nodes In the future, we would welcome and use pure Cloud sites Providing that they offer API compatible with Public Clouds No need for batch, Job Agent interacts directly with Task Queue

Vision Private CERN Cloud HLT Public Cloud AliEn Cloud Gateway QA CAF Demand CernVM/FS Cloud Agent HLT Public Cloud

Managing many Cloud environment Instances Cloud agents expose the resources available in the cloud. The users request resources via the gateway interface. The site administrators only takes care of the installation. Cloud Agent Public Cloud Cloud Agent Private Cloud Cloud Agent System user Site Administrator Cloud Agent Machine Browser API Cloud Gateway

CernVM Online Cluster definition

Conclusion We expect to live in mixed Grid/Cloud environment for some time Not an issue, Grid job or Cloud API are just the mechanisms to start Job Agent We plan to use CernVM family tools and collaborate with PH/SFT on developments CernVM, CernVM/FS, CernVM Online, Cloud Gateway, Cloud Agent…. Contextualization, credentials