A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct 2015 1 CERN Cloud 2 nd Price Inquiry Andrea Valassi (IT-SDC) Thanks to Andrew,

Slides:



Advertisements
Similar presentations
FCMAT Response & Preparation: Process Outline October 25, 2006.
Advertisements

National Grid's Contribution to LHCb IFIN-HH Serban Constantinescu, Ciubancan Mihai, Teodor Ivanoaica.
CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013.
New VOMS servers campaign GDB, 8 th Oct 2014 Maarten Litmaath IT/SDC.
Project Management. Managing Capital Projects  What is a Project?  Something that: has a beginning and an end, and is carried out to meet established.
Pilots 2.0: DIRAC pilots for all the skies Federico Stagni, A.McNab, C.Luzzi, A.Tsaregorodtsev On behalf of the DIRAC consortium and the LHCb collaboration.
Stefano Belforte INFN Trieste 1 CMS SC4 etc. July 5, 2006 CMS Service Challenge 4 and beyond.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
ATLAS Off-Grid sites (Tier-3) monitoring A. Petrosyan on behalf of the ATLAS collaboration GRID’2012, , JINR, Dubna.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
IST E-infrastructure shared between Europe and Latin America High Energy Physics Applications in EELA Raquel Pezoa Universidad.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
1 Resource Provisioning Overview Laurence Field 12 April 2015.
Cloud Status Laurence Field IT/SDC 09/09/2014. Cloud Date Title 2 SaaS PaaS IaaS VMs on demand.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
Status Report of WLCG Tier-1 candidate for KISTI-GSDC Sang-Un Ahn, for the GSDC Tier-1 Team GSDC Tier-1 Team 12 th CERN-Korea.
TRACI V3 Status & Delivery Plans UPDATE Paolo Petagna LHCb CO2 cooling meeting Apr 15 th, 2015.
FP6−2004−Infrastructures−6-SSA EUChinaGrid Infrastructure Giuseppe Andronico - INFN Catania Concertation Meeting – Budapest,
CENF meeting 3-Oct What is going on? WA104 and WA105 still waiting for an official CERN communication, to be treated as any other approved experiment.
Efi.uchicago.edu ci.uchicago.edu Using FAX to test intra-US links Ilija Vukotic on behalf of the atlas-adc-federated-xrootd working group Computing Integration.
CERN - IT Department CH-1211 Genève 23 Switzerland t COOL Conditions Database for the LHC Experiments Development and Deployment Status Andrea.
MultiJob pilot on Titan. ATLAS workloads on Titan Danila Oleynik (UTA), Sergey Panitkin (BNL) US ATLAS HPC. Technical meeting 18 September 2015.
Technical Workshop 5-6 November 2015 Alberto Di Meglio CERN openlab Head.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon Kick-off meeting, 24 th October 2011.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
D. Giordano Second Price Enquiry Update L. Field On behalf of the IT-SDC WLC Resource Integration Team.
Update of SAM Implementation ALICE TF Meeting 18/10/07.
Eygene Ryabinkin, on behalf of KI and JINR Grid teams Russian Tier-1 status report May 9th 2014, WLCG Overview Board meeting.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
OPERATIONS REPORT JUNE – SEPTEMBER 2015 Stefan Roiser CERN.
Possibilities for joint procurement of commercial cloud services for WLCG WLCG Overview Board Bob Jones (CERN) 28 November 2014.
OSG Area Coordinator’s Report: Workload Management October 6 th, 2010 Maxim Potekhin BNL
Accreditation Update Self-Study Progress and Review MPC Flex Days Spring 2015.
Criteria for Deploying gLite WMS and CE Ian Bird CERN IT LCG MB 6 th March 2007.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Ian Bird, CERN WLCG LHCC Referee Meeting 1 st December 2015 LHCC; 1st Dec 2015 Ian Bird; CERN1.
3rd Helix Nebula Workshop on Interoperability among e-Infrastructures and Commercial Clouds Carmela ASERO, EGI.eu 17 September 2013, Madrid
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
M.C. Vetterli – WLCG-CB, March ’09 – #1 Simon Fraser WLCG Collaboration Board Meeting Praha, March 22 nd, 2009 Thanks to Milos for hosting us.
EMI is partially funded by the European Commission under Grant Agreement RI EMI SA2 Report Andres ABAD RODRIGUEZ, CERN SA2.4, Task Leader EMI AHM,
WLCG Service Report ~~~ WLCG Management Board, 17 th February 2009.
Monitoring the Readiness and Utilization of the Distributed CMS Computing Facilities XVIII International Conference on Computing in High Energy and Nuclear.
Ian Bird, CERN 1 st February Dec 2015
Activities and Perspectives at Armenian Grid site The 6th International Conference "Distributed Computing and Grid- technologies in Science and Education"
Volunteer Clouds for the LHC experiments H. Riahi – 12/11/15 EGI User Forum Laurence Field Hassen Riahi CERN IT-SDC.
The Helix Nebula marketplace 13 May 2015 Bob Jones, CERN.
15-Jun-04D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Update (Report from the LCG Security Group) CERN 15 June 2004 David Kelsey CCLRC/RAL, UK
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
LHCb Computing 2015 Q3 Report Stefan Roiser LHCC Referees Meeting 1 December 2015.
Cabling for LHCb Upgrade
Overview of the Belle II computing
The “Understanding Performance!” team in CERN IT
ATLAS Cloud Operations
Grid status ALICE Offline week Nov 3, Maarten Litmaath CERN-IT v1.0
Update on Plan for KISTI-GSDC
KISTI-GSDC Tier-1 SITE REPORT
LHCb Software & Computing Status
8th Grade Yearbook Ads Create your own special message for your 8th grader to see in the yearbook. Ads for sale for $30. Must be ordered and submitted.
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
WLCG Collaboration Workshop;
Customer Overview Pack – September 2018
OVERVIEW INFORMATION Fund for Bilateral Relations at National Level
Customer Overview Pack – September 2018
CHIPP - CSCS F2F meeting CSCS, Lugano January 25th , 2018.
OVERVIEW INFORMATION Fund for Bilateral Relations at National Level
Presentation transcript:

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct CERN Cloud 2 nd Price Inquiry Andrea Valassi (IT-SDC) Thanks to Andrew, Stefan, Vladimir, Federico, Chris and the IT-SDC cloud team for help and discussions! LHCb brainstorming – 7 th October 2015

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct CERN Cloud Procurement Overview Timeline for commercial procurement of clouds –2 nd Price Inquiry (~MC simulation workflows) 1000 cores for LHCb from ~1 st Oct to 18 th Dec 2015 –3 rd Price Inquiry (“Data-intensive” workflows) Higher budget, preparation ongoing, resources from ~March 2016 –Pre-Commercial Procurement Project starting Jan 2016 (details in May GDB talk by Bob Jones)talk by Bob Jones In parallel, tests with various providers –MS Azure Limited budget and resources for technology tests and stress tests Using this in IT-SDC also to prepare for Price Inquiry resources

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct Azure tests Successfully executed the first few MC jobs –Single-core VMs, 2GB memory limit –Vcycle infrastructure (now merged to LHCb code base) Submitted ~10 jobs, more than half failed –Not 100% clear why, but seems correlated to “upgrade” MC Submitting now ~100 jobs as a new test –Special MC production excluding “upgrade” MC (Vladimir) –Also solved ASM/ARM issues on IT-SDC side (3k VMs ok) Next steps if this test is successful –Ramp up to ~1000 jobs –Also test Andrew’s multi-core aware pilots

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct Azure tests On second look: only mildly correlated to “upgrade” –4 success: 2 upgrade, 2 not –9 failures: 7 upgrade, 2 not –Need more statistics... will try more jobs and see

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct nd Price Inquiry – Overview

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct nd Price Inquiry – Status Status –Provider identified: consortium with 5 sites –Network connectivity to Geant being prepared (1 week?) –Minimal resources available and under tests in IT-SDC LHCb preparation –Plan to use this for MC simulation –Multi-core-aware pilots by Andrew are now ready –Agreed to set up 5 different sites –LHCb-GEOC will be added to communication list –VO sharing [resources will be paid for even if not used!]

A. Valassi – CERN Clouds 2 nd Price Inquiry LHCb brainstorming – 7 th Oct nd Price Inquiry – Questions