Rucio Commissioning ADC Operations. Rucio Commissioning  Won’t go into the details of the commissioning ToDo list and priorities didn’t change respect.

Slides:

Advertisements

Similar presentations

SUS Feature Pack for SMS Michel Jouvin LAL / IN2P3

Advertisements

Anatoli Romaniouk, TRT IB meeting October 30 th 2013 TRT Tasks/Responsibilities/Manpow er issues. 1.

FlareCo Ltd ALTER DATABASE AdventureWorks SET PARTNER FORCE_SERVICE_ALLOW_DATA_LOSS Slide 1.

1 Latest CLIC FFS Tuning Results Americas Workshop on Linear Colliders Thanks to: Rogelio Tomas Garcia, Yngve Inntjore Levinsen, Andrea Latina, Oscar Roberto.

Chapter 15 Design, Coding, and Testing. Copyright © 2005 Pearson Addison-Wesley. All rights reserved Design Document The next step in the Software.

Updating indicator implementation in Indistar Assessment Step Plan/Tasks Step Monitoring Step Flag to Re-assess.

1 G4MICE TOF Reconstruction & KEK Test Beam Analysis Update Aron Fish Tracker Phone Conference May 25, 2006.

Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.

Agenda  Overview  Configuring the database for basic Backup and Recovery  Backing up your database  Restore and Recovery Operations  Managing your.

Tier-0: Preparations for Run-2 Armin NAIRZ (CERN) ADC Technical Interchange Meeting Chicago, 29 October 2014.

Students: Nadia Goshmir, Yulia Koretsky Supervisor: Shai Rozenrauch Industrial Project Advanced Tool for Automatic Testing Final Presentation.

Client Management. Introduction In a typical organization there are a lot of client machines used for day to day operations Client management is a necessary.

ITimpulse NOC process This is an interactive, detailed, step wise guide explaining how alerts are managed at our NOC. This document contains information.

Automate Microsoft Azure Ross Sponholtz Mark Ghazai.

Scalability By Alex Huang. Current Status 10k resources managed per management server node Scales out horizontally (must disable stats collector) Real.

MC, REPROCESSING, TRAINS EXPERIENCE FROM DATA PROCESSING.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.

LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.

Joint Commissioning (2) Commissioning plan Gene Flanagan Purdue University.

ATLAS : File and Dataset Metadata Collection and Use S Albrand 1, J Fulachier 1, E J Gallas 2, F Lambert 1 1. Introduction The ATLAS dataset search catalogs.

Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.

EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,

Status report on SRM v2.2 implementations: results of first stress tests 2 th July 2007 Flavia Donno CERN, IT/GD.

OSG Area Coordinator’s Report: Workload Management February 9 th, 2011 Maxim Potekhin BNL

Physics and Data Analysis Working Group – January 2007 Dear all, thanks for the participation to this Tutorial that is intended to encourage American participation.

SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.

To Patch or not to Patch SharePoint Charmaine Malan 3 October 2015 Johannesburg, SA.

PanDA Summary Kaushik De Univ. of Texas at Arlington ADC Retreat, Naples Feb 4, 2011.

4/24/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.

DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.

Storage cleaner: deletes files on mass storage systems. It depends on the results of deletion, files can be set in states: deleted or to repeat deletion.

Post-DC2/Rome Production Kaushik De, Mark Sosebee University of Texas at Arlington U.S. Grid Phone Meeting July 13, 2005.

Online System Status LHCb Week Beat Jost / Cern 9 June 2015.

European Middleware Initiative (EMI) The Software Engineering Model Alberto Di Meglio (CERN) Interim Project Director.

CERN IT Department CH-1211 Genève 23 Switzerland t Streams Service Review Distributed Database Workshop CERN, 27 th November 2009 Eva Dafonte.

Version Control and SVN ECE 297. Why Do We Need Version Control?

November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /

Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.

CSE 434: Computer Networks Project Single vs. Per Connection vs. Pooling Threading Techniques Dominic Hilsbos, Dorothy Johnson, Chris Volpe, Andy Wong,

Shifters Jamboree Kaushik De ADC Jamboree, CERN December 4, 2014.

Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.

Distributed Analysis Tutorial Dietrich Liko. Overview  Three grid flavors in ATLAS EGEE OSG Nordugrid  Distributed Analysis Activities GANGA/LCG PANDA/OSG.

WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.

Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.

1 Ch 11. Backup your data. 2 Backup Device An object contain location of backup device Location can be a file or a tape device.

OSG Area Coordinator’s Report: Workload Management February 9 th, 2011 Maxim Potekhin BNL

QC – User Interface QUALITY CENTER. QC – Testing Process QC testing process includes four phases: Specifying Requirements Specifying Requirements Planning.

Consistency Checking And RUCIO Progress Update Sarah Williams Indiana University ADC Weekly Meeting,

Monitoring the Readiness and Utilization of the Distributed CMS Computing Facilities XVIII International Conference on Computing in High Energy and Nuclear.

19 Copyright © 2004, Oracle. All rights reserved. Database Backups.

Configuring and Managing the DHCP Server Role. DHCP overview RARP – one of the first ways to assign addresses BOOTP – Another legacy way to assign addresses.

Production System 2 manpower and funding issues Alexei Klimentov Brookhaven National Laboratory Aug 19, 2013 Production System Technical Meeting CERN.

BSHS 382 Week 2 DQ 1 Check this A+ tutorial guideline at 382/UOP%20BSHS-382-Week-2-DQ-1 What is the difference between.

Item 9 The committee recommends that the development and operations teams review the list of workarounds, involving replacement of palliatives with features.

NERC Published Lessons Learned Summary

Computing Operations Roadmap

Towards continuous integration: Automated Oracle database testing with capture and replay Emil Pilecki.

Monitoring Implementation and Sustainability

3D Application Tests Application test proposals

The ADC Operations Story

2017 Microsoft Exam.

LHCb Conditions Database TEG Workshop 7 November 2011 Marco Clemencic

10 – Workstation Fleet Logistics

University of Wisconsin at Madison

Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.

TTCN-3 Status Report.

System Center Configuration Manager Assessment Results

SharePoint Server Assessment Results

Multi VO Rucio Andrew Lister.

Presentation transcript:

Rucio Commissioning ADC Operations

Rucio Commissioning  Won’t go into the details of the commissioning ToDo list and priorities didn’t change respect to 6 weeks ago  /slides/1.pdf /slides/1.pdf  ial/slides/1.pdf ial/slides/1.pdf But a lot of work has been done in the meanwhile! 28 October 2014 ADC Ops 2

.. 28 October 2014 ADC Ops 3

.. 28 October 2014 ADC Ops 4

ProdSys2 task with input/output in Rucio  Full chain is ongoing Not all task finished (evgen and simul OK)  not a real issue, more an error while defining the chain. Still assigned manually  Not spot up to now real issues related to Rucio 28 October 2014 ADC Ops 5

Horizontal scalability  Present situation: possible to scale horizontally with “fixed” configuration  Judge: rucio-daemon-prod-01, singleprocess, multithread  Conveyor: rucio-daemon-prod-02,06,07,08, multiprocess, multithread  Hermes: rucio-daemon-prod-02, singleprocess, singlethread  Undertaker: rucio-daemon-prod-03, singleprocess, multithread  Kronos: rucio-daemon-prod-03, singleprocess, singlethread  Automatix: rucio-daemon-prod-04, singleprocess, multithread  Transmogrifier: rucio-daemon-prod-04, singleprocess, singlethread  Necromancer: rucio-daemon-prod-04, singleprocess, singlethread  Reaper: rucio-daemon-prod-05, multiprocess, multithread Trying to increase the available VMs now  “Automatic” scalability: The database change for automatic configuration of scalability of daemons is in production. The patch to support this is implemented, not in production yet. 28 October 2014 ADC Ops 6

Rucio Tape management: stagein  Blocker issues resolved Retries with timestamp Bringonline parameters passed to FTS3  Sorting out now details of RSEs for tapes One RSE for “staging area” Mostly internal, between judge and conveyor 28 October 2014 ADC Ops 7

Rucio *now* 28 October 2014 ADC Ops 8 ongoing Ongoing: spot inconsistencies, under fixing done tested

28 October 2014 ADC Ops 9 Still to be done Ongoing done To be validated Recovery done, monitoring ongoing ongoing Still to be done Ongoing See rucio-ui Patched, not deployed Rucio “others” ongoing

DQ2 – Rucio migration 28 October 2014 ADC Ops 10

Backup Horizontal scalability from Vincent 28 October 2014 ADC Ops 11

.. .. .. . 28 October 2014 ADC Ops 12