PWG-CF Jan Fiete Grosse-Oetringhaus Analysis Session Offline Week March 2012.

Slides:

Advertisements

Similar presentations

Operating Systems Operating system is the “executive manager” of all hardware and software.

Advertisements

The LEGO Train Framework

– Unfortunately, this problems is not yet fully under control – No enough information from monitoring that would allow us to correlate poor performing.

Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.

ALICE Operations short summary and directions in 2012 Grid Deployment Board March 21, 2011.

ALICE Operations short summary LHCC Referees meeting June 12, 2012.

ALICE Operations short summary and directions in 2012 WLCG workshop May 19-20, 2012.

Staging to CAF + User groups + fairshare Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE Offline week,

Chiara Zampolli in collaboration with C. Cheshkov, A. Dainese ALICE Offline Week Feb 2009C. Zampolli 1.

Form Handling, Validation and Functions. Form Handling Forms are a graphical user interfaces (GUIs) that enables the interaction between users and servers.

MC, REPROCESSING, TRAINS EXPERIENCE FROM DATA PROCESSING.

03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.

Costin Grigoras ALICE Offline. In the period of steady LHC operation, The Grid usage is constant and high and, as foreseen, is used for massive RAW and.

PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

Analysis infrastructure/framework A collection of questions, observations, suggestions concerning analysis infrastructure and framework Compiled by Marco.

David Adams ATLAS DIAL status David Adams BNL November 21, 2002 ATLAS software meeting GRID session.

June 10, D0 Use of OSG D0 relies on OSG for a significant throughput of Monte Carlo simulation jobs, will use it if there is another reprocessing.

Offline report – 7TeV data taking period (Mar.30 – Apr.6) ALICE SRC April 6, 2010.

Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.

Computer Systems Week 14: Memory Management Amanda Oddie.

PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.

Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.

Analysis trains – Status & experience from operation Mihaela Gheata.

Working with AliEn Kilian Schwarz ALICE Group Meeting April

5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.

8-Dec-15T.Wildish / Princeton1 CMS analytics A proposal for a pilot project CMS Analytics.

AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.

CERN – Alice Offline – Thu, 20 Mar 2008 – Marco MEONI - 1 Status of Cosmic Reconstruction Offline weekly meeting.

ROOT Users Workshop, Saas-Fee, March 2013 Andrei Gheata, Jan Fiete Grosse-Oetringhaus for the ALICE Collaboration.

ALICE Operations short summary ALICE Offline week June 15, 2012.

PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.

Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Operations procedures: summary for round table Maite Barroso OCC, CERN

A. Gheata, ALICE offline week March 09 Status of the analysis framework.

The Development Process Compilation. Compilation - Dr. Craig A. Struble 2 Programming Process Problem Solving Phase We will spend significant time on.

AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.

1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.

Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.

M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+

Analysis Trains Costin Grigoras Jan Fiete Grosse-Oetringhaus ALICE Offline Week,

PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.

PWG3 analysis (barrel)

Physics selection: online changes & QA M Floris, JF Grosse-Oetringhaus Weekly offline meeting 30/01/

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES L. Betev, A. Grigoras, C. Grigoras, P. Saiz, S. Schreiner AliEn.

Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.

Analysis train M.Gheata ALICE offline week, 17 March '09.

Offline Weekly Meeting, 24th April 2009 C. Cheshkov & C. Zampolli.

Analysis efficiency Andrei Gheata ALICE offline week 03 October 2012.

David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.

 In order to use the time clock there are four major steps that need to be setup in conjunction with your employee profile. › Must be part of an Organization.

Some topics for discussion 31/03/2016 P. Hristov 1.

D. Elia (INFN Bari)ALICE Offline week / CERN Update on the SPD Offline Domenico Elia in collaboration with H. Tydesjo, A. Mastroserio Overview:

LEGO train limits Offline week, 31/03/2016 LB 1. Incident of 22/03/2016 A train operator has submitted 107 LEGO trains in one go – These resulted in more.

ALICE Offline Week – 22 Oct Visualization of embedding Matevz Tadel, CERN Adam Kisiel, Ohio State University.

ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.

Offline week meetings CERN – June 25, 2009 CAF user experience Maria Nicassio (INFN Bari)

Jan Fiete Grosse-Oetringhaus

Adient PLC - Global Supplier Scorecard Report Training

Database Replication and Monitoring

Analysis trains – Status & experience from operation

PWG2 Analysis status Adam Kisiel, CERN for the PWG2 group.

Running a job on the grid is easier than you think!

Visualization of embedding

Status of the CERN Analysis Facility

Offline meeting Azimuthally sensitive Hanbury-Brown-Twiss (HBT) Interferometry Lukasz Graczykowski Warsaw University of Technology Johanna.

Offline data taking and processing

Analysis Trains - Reloaded

Analysis framework - status

Adient PLC - Global Supplier Scorecard Report Training

Presentation transcript:

PWG-CF Jan Fiete Grosse-Oetringhaus Analysis Session Offline Week March 2012

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus2 SVN Folders PWGCF has four folders for the PAGs –Correlations: responsible Andrew Adare –E-by-E: Panos Christakoglou –Femtoscopy: Adam Kisiel –Flow: Ilya Selyzhenkov Main SVN responsible: Michael Weber

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus3 Trains Four active analysis trains –PbPb train, run by Michael Weber. Schedule: 2010 AODs each Friday 11 wagons –PbPb MC train, run by Michael Weber. Schedule: on request 2 wagons –pp train, run by Eva Sicking. Schedule: AODs of 0.9, 2.76, and 7.0 TeV data, run each Friday 2 wagons –pp MC train, run by Eva Sicking. Schedule: AODs of 0.9, 2.76, and 7.0 TeV MC data, run each Friday 2 wagons We are happy with the efficiency, but the overall running time including merging (3 days+) could still be improved (1-2 day for merging sounds too much)

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus4 Requests: MonALISA Buttons for job management –Kill jobs –Kill all jobs –Resubmit all jobs in error state Some status missing in MonALISA (e.g. OVER_WAITING)?!

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus5 Requests: AliEn Allow to retrieve log files upon ERROR_E –Ticket submitted on –Important for us as otherwise cases of TTL expired or too high memory can hardly debugged Current job splitting produces large number of sub jobs for AOD analysis –Ticket submitted on –AODs are replicated to 3+ SEs –Only AODs are combined which are exactly on the set of SEs –Usually 300 input files, one gets 100 jobs –Waste of resources (due to overhead) and additional merging effort, and longer real time to get results back We find both these features important to implement/improve soon

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus6 Requests: AliEn (2) Provide standard XML collection per run instead of each user creating the XMLs for herself

PWG-CF Analysis Tools Experience - Jan Fiete Grosse-Oetringhaus7 Requests: AliRoot We suggest to have AN tags twice per week –Allows more frequent train runs