Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 1 PanDA Infrastructure at CERN Status Sergey Baranov 3 Sep 2013.

Slides:



Advertisements
Similar presentations
WGISS #19 Plenary, CONAE, Cordoba, Argentina, March 2005 Cluster and Grid Project: Status & Update Pakorn Apaphant Geo-Informatics and Space Technology.
Advertisements

NorthGrid status Alessandra Forti Gridpp12 Brunel, 1 February 2005.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN-IT Plans on Virtualization Ian Bird On behalf of IT WLCG Workshop, 9 th July 2010.
SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently on- line data 100 TB work area (not controlled by SUMS) 2 PB near-line.
Rates and Billing for New ITS Services Financial Unit Liaison Meeting February 16, 2011 Barry D. MacDougall Information Technology Service.
1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
Testing as a Service with HammerCloud Ramón Medrano Llamas CERN, IT-SDC
SAP on windows server 2012 hyper-v documentation
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Michal Kwiatek, Juraj Sucik, Rafal.
CERN IT Department CH-1211 Genève 23 Switzerland t Integrating Lemon Monitoring and Alarming System with the new CERN Agile Infrastructure.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
SMS 2003 Deployment and Managing Windows Security Rafal Otto Internet Services Group Department of Information Technology CERN 26 May 2016.
CERN IT Department CH-1211 Genève 23 Switzerland t Experiences running a production Puppet Ben Jones HEPiX Bologna Spring.
Configuration Management Evolution at CERN Gavin
CERN IT Department CH-1211 Genève 23 Switzerland t Evolution of virtual infrastructure with Hyper-V Juraj Sucik, Slavomir Kubacka Internet.
Using Virtual Servers for the CERN Windows infrastructure Emmanuel Ormancey, Alberto Pace CERN, Information Technology Department.
INFSO-RI SA1 Service Management Alberto AIMAR (CERN) ETICS 2 Final Review Brussels - 11 May 2010.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Virtualised Worker Nodes Where are we? What next? Tony Cass GDB /12/12.
Design Virtualization Infrastructure. Module 8: Design Virtualization Infrastructure Virtualization of a test server environment Virtualization and migration.
Managing the CERN LHC Tier0/Tier1 centre Status and Plans March 27 th 2003 CERN.ch.
WLCG infrastructure monitoring proposal Pablo Saiz IT/SDC/MI 16 th August 2013.
DEV327. tag – you’re it! Application Tier (AT) Data Tier (DT) Configuration Database Relational Warehouse OLAP Cube Database Collection Databases.
Virtualization and Databases Ashraf Aboulnaga University of Waterloo.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS CERN Virtual Infrastructure Status update.
Online System Status LHCb Week Beat Jost / Cern 9 June 2015.
CMap Version 0.16 Ben Faga. CMap CMap Version 0.16 Bug fixes and code optimizations More intuitive menu system Asynchronous loading of comparative map.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
SERVER I SLIDE: 3. SERVER I Topic for tomorrow: Chapter 3: Configuring Hyper-V ■■ Objective 3.1: Create and configure virtual machine settings (Group.
CERN General Infrastructure Services Department CERN GS Department CH-1211 Geneva 23 Switzerland Db Futures Workshop
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
PROOF Benchmark on Different Hardware Configurations 1 11/29/2007 Neng Xu, University of Wisconsin-Madison Mengmeng Chen, Annabelle Leung, Bruce Mellado,
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal at CERN Juraj Sucik Jarosław Polok.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Juraj Sucik, Michal Kwiatek, Rafal.
OSG Area Coordinator’s Report: Workload Management October 6 th, 2010 Maxim Potekhin BNL
RALPP Site Report HEP Sys Man, 11 th May 2012 Rob Harper.
1 Update at RAL and in the Quattor community Ian Collier - RAL Tier1 HEPiX FAll 2010, Cornell.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
Spark and Jupyter 1 IT - Analytics Working Group - Luca Menichetti.
Automated virtualisation performance framework 1 Tim Bell Sean Crosby (Univ. of Melbourne) Jan van Eldik Ulrich Schwickerath Arne Wiebalck HEPiX Fall 2015.
CERN IT Department CH-1211 Geneva 23 Switzerland t ES 1 how to profit of the ATLAS HLT farm during the LS1 & after Sergio Ballestrero.
Virtual Server Server Self Service Center (S3C) JI July.
Status of Grid & RPC-Tests Stand DAQ(PU) Sumit Saluja Programmer EHEP Group Deptt. of Physics Panjab University Chandigarh.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Agile Infrastructure Project Overview : Status and.
Acronyms GAS - Grid Acronym Soup, LCG - LHC Computing Project EGEE - Enabling Grids for E-sciencE.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
Microsoft Exam
CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland.
Lessons learned administering a larger setup for LHCb
CERN Openlab Openlab II virtualization developments Havard Bjerke.
WLCG IPv6 deployment strategy
Applications Area News
RHEV Platform at LHCb Red Hat at CERN 17-18/1/17
AI How to: System Update and Additional Software
Virtualization and Clouds ATLAS position
Research on an universal Openstack upgrade solution
File Share Dependencies
ATLAS Cloud Operations
Pablo Pinés León – FTEC 2016 Program
Service Challenge 3 CERN
Update on Plan for KISTI-GSDC
ETICS Services Management
The Infrastructure of the CDS Group
Frontier Status Alessandro De Salvo on behalf of the Frontier group
Presentation transcript:

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep PanDA Infrastructure at CERN Status Sergey Baranov 3 Sep 2013

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 Main Activities We have about 50 nodes at CERN for PanDA: PanDA Server, Cache, Bamboo, Monitor, Pilot Factories, DaTRI, development. lMigrations to: nSLC6 nAI infrastructure lPanDA Version control: nWe are ready to organize a special cluster for running and testing several versions of PanDA monitor. We need synchronized TAGs for PanDA monitor and part of PanDA Server:  We can start a new service on HyperV nodes voatlas210, 233, 234 or later on AI. nDo we need version control for other PanDA parts? 2

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 Migration to SLC6 lPanDA migrated to SLC6 (Quattor) perfectly: nPanDA Server (8 nodes, 2 dev) {updated: Dashboard, AGIS Client…} nPilot Factories (5 nodes, 2 dev)  Doesn’t migrated CHIRT powerful node. It’s not clear what we can use soon virtual or real node. nDaTRI nOracle Web Tools:  & lOpen question for PanDA Cache is migration to SLC6/AI. We don’t know what we can use again: virtual or real powerful nodes:  Panda Cache service needs several TB disk storage.  We’ll use AI nodes when disk storage will available for Open Stack nodes.  The migration could be possible end of the year. lMigration does not needed: nBamboo as deprecated service 3

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 Migration to SLC6 lPanDA Monitor are very close to migration to SLC6. lWe have one development node where panda.cern.ch and pandamon.cern.ch (using wsgi) configuration working together. We’ll use this configuration for migration to SLC6. lWe’ll start migration from development nodes, then PanDA cron machine and so on. 4

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 AI Infrastructure 5 lWe started migration to AI Infrastructure (OpenStack, Puppet): lWe have useful flavor specially for ADC PanDA project, thanks to Tim Bell  4 cores, 300 GB system disk lThe migration is complete for the first special ADC node which needs for rpm making and security scans. lWe have plans to make for each service (PanDA Server, Pilots, PanDA Monitor) at least one AI node and start long test (at least month) as a production machine. lAt the end of this year we’ll see how good AI in practical operation is. If we’ll satisfied we start removing Quattor infrastructure from PanDA.

Sergey Baranov: PanDA Infrastructure at CERN 3 Sep 2013 Conclusion lPanDA in a good shape for migration to SLC6. Only few services postpone SLC6 migration.  We didn’t see any technical problems for migration, at least today. Few service responsible peoples are just busy right now.  We plan finalize SCL6 migration at end of this year. lWe expect that PanDA version control will be in operation in two month. lThe AI nodes will work on all production services end of this year. lWe have a chance end of February to have all PanDA nodes in new AI CERN IT infrastructure. 6