Computing activities in Napoli

Slides:



Advertisements
Similar presentations
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Advertisements

Pre-Commercial Procurement proposal - HNSciCloud
DPM Italian sites and EPEL testbed in Italy Alessandro De Salvo (INFN, Roma1), Alessandra Doria (INFN, Napoli), Elisabetta Vilucchi (INFN, Laboratori Nazionali.
DPM Italian sites and EPEL testbed in Italy Alessandro De Salvo (INFN, Roma1), Alessandra Doria (INFN, Napoli), Elisabetta Vilucchi (INFN, Laboratori Nazionali.
Procurement Innovation for Cloud Services in Europe CERN – 14 May 2014 Bob Jones (CERN) This document produced by Members of the Helix Nebula consortium.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
1 Resource Provisioning Overview Laurence Field 12 April 2015.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
1 User Analysis Workgroup Discussion  Understand and document analysis models  Best in a way that allows to compare them easily.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
Ian Bird, WLCG MB; 27 th October 2015 October 27, 2015
A Silvio Pardi on behalf of the SuperB Collaboration a INFN-Napoli -Campus di M.S.Angelo Via Cinthia– 80126, Napoli, Italy CHEP12 – New York – USA – May.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
The GridPP DIRAC project DIRAC for non-LHC communities.
ATLAS Distributed Computing ATLAS session WLCG pre-CHEP Workshop New York May 19-20, 2012 Alexei Klimentov Stephane Jezequel Ikuo Ueda For ATLAS Distributed.
Andrea Manzi CERN EGI Conference on Challenges and Solutions for Big Data Processing on cloud 24/09/2014 Storage Management Overview 1 24/09/2014.
Belle II Computing Fabrizio Bianchi INFN and University of Torino Meeting Belle2 Italia 17/12/2014.
XRootD Monitoring Report A.Beche D.Giordano. Outlines  Talk 1: XRootD Monitoring Dashboard  Context  Dataflow and deployment model  Database: storage.
An Analysis of Data Access Methods within WLCG Shaun de Witt, Andrew Lahiff (STFC)
DIRAC for Grid and Cloud Dr. Víctor Méndez Muñoz (for DIRAC Project) LHCb Tier 1 Liaison at PIC EGI User Community Board, October 31st, 2013.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
Volunteer Clouds for the LHC experiments H. Riahi – 12/11/15 EGI User Forum Laurence Field Hassen Riahi CERN IT-SDC.
PRIN STOA-LHC: STATUS BARI BOLOGNA-18 GIUGNO 2014 Giorgia MINIELLO G. MAGGI, G. DONVITO, D. Elia INFN Sezione di Bari e Dipartimento Interateneo.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
CEPC software & computing study group report
Dynamic Extension of the INFN Tier-1 on external resources
Extending the farm to external sites: the INFN Tier-1 experience
WLCG IPv6 deployment strategy
Review of the WLCG experiments compute plans
WLCG Workshop 2017 [Manchester] Operations Session Summary
on behalf of the Belle II Computing Group
DPM at ATLAS sites and testbeds in Italy
Distributed storage, work status
LHCOPN/LHCONE status report pre-GDB on Networking CERN, Switzerland 10th January 2017
Ian Bird, CERN & WLCG CNAF, 19th November 2015
Dr. Silvio Pardi INFN-Napoli Belle II Italia 21 December 2015
LCG Service Challenge: Planning and Milestones
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Evolution of CERN Facilities
Steve Brewer Stichting European Grid Initiaitive
StoRM: a SRM solution for disk based storage systems
gLite->EMI2/UMD2 transition
Silvio Pardi R&D Storage Silvio Pardi
ATLAS Cloud Operations
Openlab Compute Provisioning Topics Tim Bell 1st March 2017
WLCG experiments FedCloud through VAC/VCycle in the EGI
How to enable computing
Future challenges for the BELLE II experiment
David Cameron ATLAS Site Jamboree, 20 Jan 2017
The INFN TIER1 Regional Centre
Computing at CEPC Xiaomei Zhang Xianghu Zhao
WLCG Demonstrator R.Seuster (UVic) 09 November, 2016
Proposal for the LHCb Italian Tier-2
Vision for CERN IT Department
The INFN Tier-1 Storage Implementation
Tony Cass, Edoardo Martelli
WLCG and support for IPv6-only CPU
WLCG Collaboration Workshop;
Introduction to Cloud Computing
Data Management cluster summary
Xiaomei Zhang On behalf of CEPC software & computing group Nov 6, 2017
14th International IEEE eScience Conference
Computing activities in Napoli
HTTP Federations and Caching
This work is supported by projects Research infrastructure CERN (CERN-CZ, LM ) and OP RDE CERN Computing (CZ /0.0/0.0/1 6013/ ) from.
The LHCb Computing Data Challenge DC06
Presentation transcript:

Computing activities in Napoli Dr. Silvio Pardi (INFN-Napoli) Seventh Belle II Italian collaboration meeting 4 May 2017 – Trieste - Italy

Activities in Napoli Grid Services Network: Belle II Network Representative Network Requirements Network DC Http/Webdav and Dynamic Federation Helix Nebula Science Cloud SCOReS-GARR Project Vcycle Cloud

Grid Services: Computing GRID Cluster updated with the possibility to use opportunistic resource from local project (Prisma, SCOReS) LCG.Napoli.it has been one of the most used Site in the last 3 Quarters

Grid Services: Storage Storage totally Full In February up to Mach Some data have been deleted in April NAPOLI-SE has been one of the most used storage in the last 3 Quarters

Network Activity in Napoli Silvio Pardi and Bruno Hoeft Network Representative for Europe. Presentation of Belle II Network activity at the LHCONE in Helsinki (sept 2016) Participation at the WLCG-GDB focus on Network representing Belle II (January 2017) Network Estimation: updated at the last B2GM Data Challenge: New DC activity focus on test HTTP for third-part copy with FTS. Some preliminary tests already done in Napoli using WebFTS provided by CERN as proof of the concept New test are ongoing, in collaboration with Vikas and other site managers, using the FTS Server in PNNL

Http/Webdav and Dynamic Federation # STORGE DIRAC NAME HOSTNAME TYPE 1 DESY-DE dcache-belle-webdav.desy.de DCACHE 2 GRIDKA-SE f01-075-140-e.gridka.de 3 NTU-SE bgrid3.phys.ntu.edu.tw 4 SIGNET-SE dcache.ijs.si 5 UVic-SE charon01.westgrid.ca 6 Adelaide-SE coepp-dpm-01.ersa.edu.au DPM 7 CESNET-SE dpm1.egee.cesnet.cz 8 CYFRONNET-SE dpm.cyf-kr.edu.pl 9 Frascati-SE atlasse.lnf.infn.it 10 HEPHY-SE hephyse.oeaw.ac.at 11 Melbourne-SE b2se.mel.coepp.org.au 12 Napoli-SE belle-dpm-01.na.infn.it 13 ULAKBIM-SE torik1.ulakbim.gov.tr 14 IPHC-SE sbgse1.in2p3.fr 15 CNAF-SE ds-202-11-01.cr.cnaf.infn.it STORM 16 ROMA3-SE storm-01.roma3.infn.it 17 KEK-SE Kek-se03.cc.kek.jp 18 McGill-SE gridftp02.clumeq.mcgill.ca Testing Dynafed server in Napoli updated at the last version 2 weeks ago. The testbed is expanded Now included 18 of the 23 SRM in production. In April a new call for interest has been sent to the mailing list. Other sites plan to join included Torino, Pisa https://dynafed01.na.infn.it/myfed/

Http/Webdav and Dynamic Federation Ongoing Activities: Test S3 storage areas in Dynafed Test standard WedDav Storage in Dynafed using a local synology Testing ACL in Dynafed The Dynafed Server in Napoli is part of the WLCG demonstrator for data federation as representative of the Belle II use-case. 10 May 2017 a new presentation will be done at the WLCG-GDB at CERN

HNSciCloud Goal The Helix Nebula – The Science Cloud (HNSciCloud) is a Pre-Commercial Procurement support action funded by the EU Framework Programme for Research and Innovation Horizon 2020. HNSciCloud aims to create a competitive marketplace of innovative cloud services serving scientific users from a wide range of domains. The marketplace builds on a hybrid cloud platform including commercial cloud service providers, publicly funded e-infrastructures and buyers' in-house resources. INFN Coordinator: Luca dell’Agnello. Dr. Silvio Pardi

Participants Dr. Silvio Pardi Ref: HNSciCloud Introduction - Bob Jones - Prototype Phase kickoff meeting

HNSciCloud project phases Dr. Silvio Pardi Ref: HNSciCloud Introduction - Bob Jones - Prototype Phase kickoff meeting

Challenges Dr. Silvio Pardi Ref: HNSciCloud Introduction - Bob Jones - Prototype Phase kickoff meeting

HNSciCloud Tender: Winning Bidders of the Design Phase The 3 April the winners of the bids to build prototypes have been announced at CERN during the “Launching the Helix Nebula Science Cloud Prototype Phase” webcast event. http://www.hnscicloud.eu/events/launching-the-helix-nebula-science-cloud-prototype- phase-webcast-3-april-2017-cern Contractor 1: T-Systems, Huawei, Cyfronet, Divia Contractor 2: IBM Contractor 3: RHEA Group, T-Systems, exoscale, SixSq Dr. Silvio Pardi

Cloud Prototype for Belle II Belle II is a use-case supported by INFN because is a VO supported by CNAF (early proponent) First goal is study how to setup the VMs provided by the contractors in order to be used by Belle II users or for run Montecarlo. At now we don’t have access to the contractors platforms and we are waiting for see the start of the activities. Dr. Silvio Pardi

SCOReS Project Italian Acronym for: Study of a Caching system for optimize the usage of Opportunistic Resources and site without pledged storage, for e-Science application (SCOReS). Project funded by GARR within a National call consisting in a 1+1Year fellowship. Davide Michelino - project fellowship Domenico del Prete - Master Thesis student Silvio Pardi – Project Tutor for INFN-Napoli

SCOReS Project: Motivation Working Group WLCG/INFN “Protocol zoo” Strategy Discussed at CHEP2016 Reduce maintenance costs and manpower Help site without pledged storage Simply usage Cloud resources Sam Skipsey

SCOReS Project: Technologies Caching System: Squid, Varnish, Nginx, Apache Traffic Server Protocol: HTTP/S3/WebDav, Xrootd Federation: Dynafed Analysis: Apache Lucene, Log Stash, Elastic Search, Kibana

SCOReS Project: Facilities The project will integrate the caching system in the RECAS-Napoli infrastructure supporting belle II and Atlas experiment. The goal is to create a pilot system and if possible a pre-production services For the testbed we can take advantage from a local cloud based on Openstack, with the following characteristics 2 Server (tot 80 Cores to store the collective service) 384 cores for computation 88TB Raw Data 10Gbps Network

What is VCYCLE VCYLCE is VM lifecycle manager developed by GRIDPP, it is designed to create VM on Cloud endpoints offering EC2, Openstack or Azzure interface. VCYCLE can be easily integrated in DIRAC and the accounting system is compatible with APEL. VCYCLE is currently used in production by LHCb. https://www.gridpp.ac.uk/vcycle/

How VCYCLE works

VCYCLE for Belle II Testing activity started during the last B2GM26 suggested by Ueda. In February I have been at CERN to meet the vcycle developer Andrew McNab for a working session. We configured a VCYCLE endpoint attached to the PRISMA/SCOReS Cloud and we integrated it in the DIRAC VALIDATION server of PNNL. The work required an intenste activity of VCYLCE customization for the Belle II use-case.

VCYCLE Pilot Jobs via PNNL DIRAC Server

People Prof. Guido Russo Dr. Silvio Pardi Dr. Davide Michelino (GARR fellowship) Dr. Domenico del Prete (Master Thesis)