Trigger release and validation status and plans David Strom (Oregon), Simon George (RHUL), Ricardo Gonçalo (RHUL)

Slides:



Advertisements
Similar presentations
L2 chains for single-beam menu Muon full reconstruction T2Calo starting from MBTS Ricardo Gonçalo, Denis Damazio.
Advertisements

Jet Slice Status Report Ricardo Gonçalo (LIP) and David Miller (Chicago) For the Jet Trigger Group Trigger General Meeting – 9 July 2014.
Releases and Validation Status Simon George, David Strom, Dmitry Emeliyanov, Monika Wielers, Ricardo Goncalo Trigger Open Meeting – 15 July 2009.
Releases & validation Simon George & Ricardo Goncalo Royal Holloway University of London HLT UK – RAL – 13 July 2009.
Trigger Validation Validation team: – Under the Releases and Validation activity coordinated by Simon – Validation team co-coordinated by David Strom (Oregon)
TRIGGER STATUS AND MENU OPTIMIZATION LHCC Referee Meeting with ATLAS – 7 th July 2009 Ricardo Gonçalo (RHUL) on behalf of ATLAS Trigger/DAQ.
1 The ATLAS Missing E T trigger Pierre-Hugues Beauchemin University of Oxford On behalf of the ATLAS Collaboration Pierre-Hugues Beauchemin University.
Trigger Data Formats From CBNT to ESD and/or DPD June 11, 2008 Fabrizio Salvatore, Ricardo Gonçalo, RHUL.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
TRIGGER DATA FOR PHYSICS ANALYSIS ATLAS Software Tutorial – 22 nd to 24 th April 2009 Ricardo Gonçalo – Royal Holloway.
MC, REPROCESSING, TRAINS EXPERIENCE FROM DATA PROCESSING.
LHCb Quarterly Report October Core Software (Gaudi) m Stable version was ready for 2008 data taking o Gaudi based on latest LCG 55a o Applications.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – Mar. 1, 2007 Outline: Status of infrastructure Schedule.
Trigger-aware analysis Current status Under development What’s missing Conclusions & Outlook Ricardo Gonçalo (RHUL)
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
TRIGGER-AWARE ANALYSIS TUTORIAL ARTEMIS Workshop – Pisa – 18 th to 19 th June 2009 Alessandro Cerri (CERN), Ricardo Gonçalo – Royal Holloway.
News from the Beatenberg Trigger Workshop Ricardo Gonçalo - 18 February 2009 Higgs WG Meeting during ATLAS Week.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
What’s in the ATLAS data : Trigger Decision ATLAS Offline Software Tutorial CERN, August 2008 Ricardo Gonçalo - RHUL.
Trigger validation for Event size TrigDecision Jets Electrons Ricardo Gonçalo, RHUL Physics Validation Meeting – 9 October 2007.
Ricardo Gonçalo (RHUL) Higgs WG meeting – 28 th August, 2007 Outline: Introduction & release plans Progress in menus for cm -2 s -1 Workshop on trigger.
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
1 Trigger “box” and related TDAQ organization Nick Ellis and Xin Wu Chris Bee and Livio Mapelli.
2nd September Richard Hawkings / Paul Laycock Conditions data handling in FDR2c  Tag hierarchies set up (largely by Paul) and communicated in advance.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
TRIGGER STATUS AND MENU OPTIMIZATION LHCC Referee Meeting with ATLAS – 7 th July 2009 Ricardo Gonçalo (RHUL) on behalf of the ATLAS TDAQ.
Preparation for the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs WG Meeting during ATLAS Week - 4 Dec.08.
Preparation for the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs sub-group conveners meeting – 9 Jan.09.
OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team.
LVL2 ID ESD/AOD classes Status and plans. PESA L2 ID Algorithms Review - RAL 25 July Ricardo Goncalo ESD/AOD More and more interest from physics.
DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.
Status of trigger software and EDM Ricardo Gonçalo, RHUL – on behalf of ATLAS TDAQ.
Trigger Offline Expert Report Simon George (RHUL), Ricardo Gonçalo (RHUL) Trigger General Meeting – 25 th November 2009.
TDAQ Upgrade Software Plans John Baines, Tomasz Bold Contents: Future Framework Exploitation of future Technologies Work for Phase-II IDR.
Trigger Validation TAPM Open meeting 2 October 2007 Ricardo Goncalo.
Analysis trains – Status & experience from operation Mihaela Gheata.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – April 12, 2007 Outline: Reminder of plans Status of infrastructure.
Post-DC2/Rome Production Kaushik De, Mark Sosebee University of Texas at Arlington U.S. Grid Phone Meeting July 13, 2005.
Latest News & Other Issues Ricardo Goncalo (LIP), David Miller (Chicago) Jet Trigger Signature Group Meeting 9/2/2015.
Artemis School On Calibration and Performance of ATLAS Detectors Jörg Stelzer / David Berge.
AOD/ESD plans Status and plans focusing on LVL2 e/  and some items for discussion On behalf of: J.Baines, P.Casado, G.Comune, A.DiMattia, S.George, R.Goncalo,
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
Trigger validation for Many thanks to Long Zhao, Chihiro Omachi, Julie Kirk, Giovanni Siragusa, Patricia Conde Muiño, Andreas Reinsch, Olya Igonkina,
Update on Diffractive Dijet Production Search Hardeep Bansil University of Birmingham Birmingham ATLAS Weekly Meeting 24/01/2013.
1 SICBDST and Brunel Migration status and plans. 2 Migration Step 1: SICBMC/SICBDST split  Last LHCb week: Split done but not tested  Software week.
Trigger Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) on behalf of trigger community Physics Validation Meeting – Feb. 13, 2007.
Trigger Offline Monitoring Report Experts: Jiri Masik, Ricardo Gonçalo Shifters: Iwona Grabowska-Bold, Holger von Radziewski, Gustavo Otero y Garzon, Michael.
MUON DAQ WORKSHOP Muon Week, CERN February 2014 Nicoletta Garelli (SLAC)
Performance DPDs and trigger commissioning Preparing input to DPD task force.
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
TAGS in the Analysis Model Jack Cranshaw, Argonne National Lab September 10, 2009.
H->bb Weekly Meeting Ricardo Gonçalo (RHUL) HSG5 H->bb Weekly Meeting, 22 February 2011.
Trigger Input to First-Year Analysis Model Working Group And some soul searching… Trigger Open Meeting – 29 July 2009.
Performance of the ATLAS Trigger with Proton Collisions at the LHC John Baines (RAL) for the ATLAS Collaboration 1.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
ELSSISuite Services QIZHI ZHANG Argonne National Laboratory on behalf of the TAG developers group ATLAS Software and Computing Week, 4~8 April, 2011.
Tim Christiansen (CERN), Claudio Campagnari (UCSB), and Benedikt Hegner (CERN) for the Top-Physics Group AOD/PAT-tuples: Top-PAG Plans and Needs for the.
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
News and Related Issues Ted & Kirsten May 27, 2005 TDWG News since last meeting (April 29th) Organization Issues: how to improve communication Future Plans:
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very.
LHCb 2009-Q4 report Q4 report LHCb 2009-Q4 report, PhC2 Activities in 2009-Q4 m Core Software o Stable versions of Gaudi and LCG-AA m Applications.
I/O and Metadata Jack Cranshaw Argonne National Laboratory November 9, ATLAS Core Software TIM.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
Calibration Operations ● Recent Changes ● Required Changes ● Calibration by Shifters Murrough Landon 23 March 2011.
Monitoring of L1Calo EM Efficiencies
Online Software Status
Presentation transcript:

Trigger release and validation status and plans David Strom (Oregon), Simon George (RHUL), Ricardo Gonçalo (RHUL)

Releases 1 April 2009Trigger release plans2 ????

1 April 2009Trigger release plans3 Announcement from David Quarrie April – tag submission deadline Thu 9 Apr at 21:00 – Main emphasis is Simulation Production validation May – tag submission deadline Thu 7 May at 21:00 – Main emphasis is slice weeks & cosmics runs in late June and MC09 initial production June – tag submission deadline Thu 4 Jun at 21:00 – baseline release for ATLAS commissioning and first beams

1 April 2009Trigger release plans4 Announcement from DQ continued Dates are two weeks later than original schedule to accommodate additional time needed for deliverables If there is a significant delay in meeting each of these intermediate milestones, the overall schedule has to be maintained such that 15.X.0 is built as the baseline release for ATLAS commissioning and first beams on that date. If necessary we will drop an intermediate release, but that will itself have some repercussions since the intermediate releases are already targeted at important milestones. The bottom line is that we will attempt to meet the above schedule, dropping late deliverables if need be, and focussing on stability rather than functionality. For developers, the tag submission deadlines for these releases are detailed above. The subsequent days prior to the release will focus on fixing lingering bugs. Any other tag requests made during this time will be deferred until after the release is built.

1 April 2009Trigger release plans5 Run Coordination Schedule Release in use Build Build Build

1 April 2009Trigger release plans6 Mapping on to trigger deliverables Based on discussion between trigger release & validation coordinators, HLT integration coordinators and trigger operations coordinators – Cat B: mainly (13 May), (few/algorithm) changes may spill over into (10 June) – Cat C: for software features, anticipate in case of LHC delays, which should be known in June. Aim for dates rather than releases in case of delays P1HLT patch releases – We expect certain things like menus and monitoring to evolve during commissioning and running. – We expect bug fixes reacting to problems identified online. – The patch releases will be available for these whenever needed – The validation threshold will be very high, so not practical for a large number of late deliverables. Looking ahead – Run of ~1 year: long time to go without major software updates. – Current software will be challenged by collisions for the first time (we hope) – Plan now in case we decide a new release needs to be deployed during the run – Action underway, coordinated by trigger operations

1 April 2009Trigger release plans7 Top Level Deliverables Athena runs from DB menus (core) [Cat. A] runs from DB jo (core) [Cat. B] Menus uploaded to DB and distributed with release (core) [Cat. A] Timeout handling within algorithms (core) [Cat. B] Serialization/Deserialization monitored and robust against corruption (core) [Cat. A] BeamCondSvc gets distributed online beam-spot info (core) [Cat. C] Fast update of HLT prescales, i.e. during run or with v. fast stop/start (core) [Cat. A] Access COOL folders with timestamp IoV (core) [Cat. B] Algorithms able to modify response to missing data modified based on OKS info on which detectors are being read out in a run. (core + all slices) [Cat. B] Fast update of info on deactivated RoS or detectors available to algorithms. i.e. during run or with v. fast stop/start (core, calo, ID, Muon) [Cat. B] Monitoring tailored for different phases of running: Cosmic, Single Beam, Early collisions, Stable running (monitoring+all slices) [Cat. B] Tier0 monitoring comparing offline and HLT quantities (all slices) [Cat. B] CAF monitoring in place (all slices) [Cat. B] Algorithms automatically configured for Solenoid and Toroid field settings. (core, ID, Muon) [Cat. B] Completed definition of Trigger content in DPD (EDM) [Cat. C] Changes to follow Muon Review recommendations (muon) [Cat. B] Minor EDM changes (ID, Muon, Electron, Jet) [Cat.B] Improved use of noisy cell information (calo, egamma, tau, jet, MET) [Cat. B] Add LUCID and ZDC chains (min. bias) [Cat. B] and startup menus for production (menus) [Cat. A] menu (menus) [Cat. B] Menus for data taking (menus) [Cat. C] First version of new TrigDecisionTool for Athena/ARA (menus) [Cat A.] iteration and client migration [Cat. C] Serializer extended to handle top level persistent class (tlp) evolution (EDM) [Cat. B] A - 6 B - 15 C - 4 To be updated: cat B need to be split into B1 (15.2.0) and B2 (15.3.0).

Validation 1 April 2009Trigger release plans8

The past week Nightlies last week mostly ok for general use Current problems/issues (see next slide) – more detailed status in 15.X.0 recipes page: x0ntly x0ntly Recovering from problems due to the Menu split: lumi1E31 is now MC_lumi1E31 and Physics_lumi1E31 – see Iwona’s talk in menus meeting last week Standalone tests breaking due to missing xml file Whole menu being run in slice tests (#48740) ATN references updated but moved back to rel_6 until we can check new menu PIT bus position of CTP inputs changed when L1 menu changed – printed L1 counts are for previous item (#48754) Re-running hypos fails in TrigHisto2D (#48646) Waiting for new feature in monitoring (#48530) Keeping an average of ~ open bugs in Savannah 1 April 2009Trigger release plans9

Validation news Validation now looking at : 15.X.0 and 15.X.0-VAL in the run up to Y AtlasP1HLT for possible uses in the technical run Changes to ATN/RTT tests : Menu changed from “full” to “default” “default” is currently the same as MC_lumi1E31_no_prescale Some slice tests to have a few chains in addition: Use GenerateMenu.overwriteSignaturesWith([function]) Example in TriggerTest/testMETSliceAthenaModernRDO.py Currently need to use lumi1E31_no_prescale due to bug #48740 In TrigAnalysisTest tests added StreamAOD.CheckNumberOfWrites=True, to ease debugging of StreamAOD/ESD problems New tests : TriggerTest/AthenaModernRDO_noFPE – resistant to floating point exceptions TriggerTest/AthenaModernRDO_StatusCodes – should crash job on unchecked StatusCodes TriggerTest/compareXMLvsDBconfig – compares XML and DB configuration 1 April 2009Trigger release plans10

Validation plans Migration to gcc43 and SLC5 will increasingly become a priority gcc43 is an intermediate step to migrate to SLC5 SLC5 migration to happen in May or July (see slide 5) Need to start paying attention to this in the nightly tests Validation open tasks (counting for OT): DPD validation: Performance DPDs Same trigger content as ESD Rely on trigger selection for skimming Physics DPDs should be available soon Place stringent requests on TrigNavigationSlimming (e.g. due to need of writing several streams in parallel) and need careful validation – also being done in physics groups Migrations to gcc43 and slc5 Covered by Mary Robinson, David Strom, Nick Sinev so far More candidates welcome – especially from non-european time zones 1 April 2009Trigger release plans11

Validation conclusions & outlook 1 April 2009Trigger release plans12 Nightlies are not in a bad state, b ut there are problems to solve before Validation coffee meetings have been proving very useful Both or people at CERN and not at CERN – make it easier to know what’s going on Publications: Talk from the validation group presented at CHEP’09 by Wolfgang: Final version of validation paper submitted to ACAT’08 by Danilo: Near future: Release soon: important deliverables to be updated soon (see slide 7) New tag deadline 9 th April; release deadline 15 th April Migration to gcc43 and SLC5 will be the next priorities Open validation tasks: Migration to gcc43 and SLC5 DPD validation