Releases and Validation Status Simon George, David Strom, Dmitry Emeliyanov, Monika Wielers, Ricardo Goncalo Trigger Open Meeting – 15 July 2009.

Slides:



Advertisements
Similar presentations
L2 chains for single-beam menu Muon full reconstruction T2Calo starting from MBTS Ricardo Gonçalo, Denis Damazio.
Advertisements

Jet Slice Status Report Ricardo Gonçalo (LIP) and David Miller (Chicago) For the Jet Trigger Group Trigger General Meeting – 9 July 2014.
Releases & validation Simon George & Ricardo Goncalo Royal Holloway University of London HLT UK – RAL – 13 July 2009.
Trigger Validation Validation team: – Under the Releases and Validation activity coordinated by Simon – Validation team co-coordinated by David Strom (Oregon)
Trigger Data Formats From CBNT to ESD and/or DPD June 11, 2008 Fabrizio Salvatore, Ricardo Gonçalo, RHUL.
D. Düllmann - IT/DB LCG - POOL Project1 POOL Release Plan for 2003 Dirk Düllmann LCG Application Area Meeting, 5 th March 2003.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – Mar. 1, 2007 Outline: Status of infrastructure Schedule.
Trigger-aware analysis Current status Under development What’s missing Conclusions & Outlook Ricardo Gonçalo (RHUL)
News from the Beatenberg Trigger Workshop Ricardo Gonçalo - 18 February 2009 Higgs WG Meeting during ATLAS Week.
What’s in the ATLAS data : Trigger Decision ATLAS Offline Software Tutorial CERN, August 2008 Ricardo Gonçalo - RHUL.
Trigger validation for Event size TrigDecision Jets Electrons Ricardo Gonçalo, RHUL Physics Validation Meeting – 9 October 2007.
LHC: ATLAS Experiment meeting “Conditions” data challenge Elizabeth Gallas - Oxford - August 29, 2009 XLDB3.
Software Validation Infrastructure for the ATLAS Trigger Wolfgang Ehrenfeld – DESY On behalf of the ATLAS Trigger Validation Group CHEP 2009 – Prague –
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
1 Trigger “box” and related TDAQ organization Nick Ellis and Xin Wu Chris Bee and Livio Mapelli.
2nd September Richard Hawkings / Paul Laycock Conditions data handling in FDR2c  Tag hierarchies set up (largely by Paul) and communicated in advance.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Darren Price – HLT B-trigger offline status report :: B-Physics meeting July 23 rd ‘08Page 1 HLT B-trigger offline monitoring status Darren Price, LANCASTER.
Study for Migration from CVS to SubVersion (SVN) Gunter Folger CERN/PH/SFT.
Trigger Offline DQ Monitoring DQ Meeting – 27 Oct 2009 Ricardo Goncalo for Trigger Offline Monitoring.
TRIGGER STATUS AND MENU OPTIMIZATION LHCC Referee Meeting with ATLAS – 7 th July 2009 Ricardo Gonçalo (RHUL) on behalf of the ATLAS TDAQ.
Preparation for the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs WG Meeting during ATLAS Week - 4 Dec.08.
Preparation for the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs sub-group conveners meeting – 9 Jan.09.
Jet Trigger On-Call Shift Summary Ricardo Gonçalo - LIP.
US ATLAS T2/T3 Workshop at UTANovember 11, Profiling Analysis at Startup Jim Cochran Iowa State Outline: - Computing model status - Expected Early.
OFFLINE TRIGGER MONITORING TDAQ Training 5 th November 2010 Ricardo Gonçalo On behalf of the Trigger Offline Monitoring Experts team.
24/06/03 ATLAS WeekAlexandre Solodkov1 Status of TileCal software.
DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.
Physics Validation. Validations 18/12/13: DC14 (1) 5 validation tasks for this week: Several DC14 simulation tests, grouped into 3 tasks 2 tasks on IBL/ITK.
Status of trigger software and EDM Ricardo Gonçalo, RHUL – on behalf of ATLAS TDAQ.
Trigger Offline Expert Report Simon George (RHUL), Ricardo Gonçalo (RHUL) Trigger General Meeting – 25 th November 2009.
Full Dress Rehearsal (FDR1) studies Sarah Allwood-Spiers 11/3/2008.
News from Jet/Etmiss Monica. Jet/Etmiss meeting yesterday (25/5) at P&P week – Mostly review of conf notes for ICHEP10 – Good review to check where we.
Organisation of the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs WG Meeting - 22 Jan.09.
Trigger Validation TAPM Open meeting 2 October 2007 Ricardo Goncalo.
Analysis trains – Status & experience from operation Mihaela Gheata.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – April 12, 2007 Outline: Reminder of plans Status of infrastructure.
Post-DC2/Rome Production Kaushik De, Mark Sosebee University of Texas at Arlington U.S. Grid Phone Meeting July 13, 2005.
Latest News & Other Issues Ricardo Goncalo (LIP), David Miller (Chicago) Jet Trigger Signature Group Meeting 9/2/2015.
Artemis School On Calibration and Performance of ATLAS Detectors Jörg Stelzer / David Berge.
AOD/ESD plans Status and plans focusing on LVL2 e/  and some items for discussion On behalf of: J.Baines, P.Casado, G.Comune, A.DiMattia, S.George, R.Goncalo,
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
Trigger validation for Many thanks to Long Zhao, Chihiro Omachi, Julie Kirk, Giovanni Siragusa, Patricia Conde Muiño, Andreas Reinsch, Olya Igonkina,
PESAsim – the e/  analysis framework Validation of the framework First look at a trigger menu combining several signatures Short-term plans Mark Sutton.
Trigger Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) on behalf of trigger community Physics Validation Meeting – Feb. 13, 2007.
The ATLAS TAGs Database - Experiences and further developments Elisabeth Vinek, CERN & University of Vienna on behalf of the TAGs developers group.
Trigger Offline Monitoring Report Experts: Jiri Masik, Ricardo Gonçalo Shifters: Iwona Grabowska-Bold, Holger von Radziewski, Gustavo Otero y Garzon, Michael.
Jet/MET Trigger On-Call Report Ricardo Gonçalo – LIP Jet Trigger Meeting – 31/3/2015.
Performance DPDs and trigger commissioning Preparing input to DPD task force.
Trigger Input to First-Year Analysis Model Working Group And some soul searching… Trigger Open Meeting – 29 July 2009.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
Ricardo Gonçalo (RHUL) Higgs WG meeting – 26 th September, 2007 Outline: Programme for today Where we are: –List of tests – post mortem –Slices.
E/gamma report Ricardo Gonçalo for the e/γ slice.
Tim Christiansen (CERN), Claudio Campagnari (UCSB), and Benedikt Hegner (CERN) for the Top-Physics Group AOD/PAT-tuples: Top-PAG Plans and Needs for the.
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very.
I/O and Metadata Jack Cranshaw Argonne National Laboratory November 9, ATLAS Core Software TIM.
Trigger release and validation status and plans David Strom (Oregon), Simon George (RHUL), Ricardo Gonçalo (RHUL)
MET Slice Monitoring Xiaowen Lei, Venkat Kaushik Ken Johns.
1/5/09 Jiri Masik1 Event Filter Tracking in the Inner Detector Jiri Masik EFID Trigger related work –Trigger bytestream –Event display.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Introduction 08/11/2007 Higgs WG – Trigger meeting Ricardo Gonçalo, RHUL.
ATLAS UK physics meeting, 10/01/08 1 Triggers for B physics Julie Kirk RAL Overview of B trigger strategy Algorithms – current status and plans Menus Efficiencies.
Metadata and Supporting Tools on Day One David Malon Argonne National Laboratory Argonne ATLAS Analysis Jamboree Chicago, Illinois 22 May 2009.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
Latest News & Other Issues
ATLAS DC2 & Continuous production
Presentation transcript:

Releases and Validation Status Simon George, David Strom, Dmitry Emeliyanov, Monika Wielers, Ricardo Goncalo Trigger Open Meeting – 15 July 2009

Releases Ricardo GonçaloTrigger Open Meeting - 15 July ????

Ricardo GonçaloTrigger Open Meeting - 15 July Release schedule Wed 24 June – For MC09 digitization and reconstruction and MC08 re-reconstruction – Tag submission deadline Thu 18 Jun 21:00 – Critical item for trigger: menus and bug fixes – Bug fixes go to AtlasProduction cache – out in the next few days Wed 22 July – For ATLAS turn-on (Sept) – tag submission deadline Thu 16 Jul 21:00 – 4-days delay being discussed: Mon 20 Jul 21:00 – Must have trigger deliverables for online use in this release – LCG externals change so sync with new TDAQ release (end July) – Bug fixes go to AtlaP1HLT and AtlasTier0 caches Post ? – Series of caches and bug fix releases – Expect new features for analysis, detectors and monitoring – Plan to limit trigger to real bug fixes in cache, plus valuable enhancements via bugfix releases (to be discussed) – Releases & validation work will switch focus to cache & bugfix releases – Mid to long term plans for dev releases during data taking not yet formulated.

Ricardo GonçaloTrigger Open Meeting - 15 July Point 1 schedule 15.2.X.Y15.4.X.Y TDAQ

Ricardo GonçaloTrigger Open Meeting - 15 July status - I Outstanding deliverables for ; list based on: T1b Athena runs from DB jo (core) B1 J.Stelzer T2 MC Menus uploaded to DB and distributed with release (core) B1 P. Bell T3b Timeout handling inside algorithms (calo,id,muon) B1 calo,id,muon T5 BeamCondSvc gets distributed online beam-spot info (core) R.Bartholdus T8b Algorithms able to modify response to missing data modified based on DetMask? (i.e. which detectors are being read out in a run) (all slices) B1 Slices ? T10a Monitoring tailored for Cosmic running (histogram ranges, ref. histos, DQ checks) (monitoring+all slices) B1 slices T10b Monitoring tailored for Single Beam (monitoring+all slices) B2 slices T10c Monitoring tailored for Early collisions & Stable running (monitoring+all slices) B3 slices T11 Tier0 monitoring comparing offline and HLT quantities (all slices) B2 slices T12 CAF monitoring in place (all slices) B3 slices T13b Algorithms automatically configured for Solenoid and Torroid field settings (ID done, Muon) B2 Oh T14 Completed definition of Trigger content in DPD (EDM) B3 Salvatore T15 Changes to follow Muon Review recommendations (muon) B2 Spagnolo, Oh T16a Minor EDM changes (ID) [Cat. B] B1 Emeliyanov (done pending tests) T16c Minor EDM changes (Electron) [Cat. B] B1 Goncalo (done pending tests)

Ricardo GonçaloTrigger Open Meeting - 15 July status – II Outstanding deliverables for ; list based on: T18a Add LUCID chains (min. bias) B1 P.Bell T18b Add ZDC chains (min. bias) B2 Bell T21d Migration of all TrigDecisionTool trigger clients B3 Slices T22 Serializer extended to handle top level persistent class evolution (EDM) B1 Masik (done pending tests) T23 ntuples can be written to single or multiple files configured by TriggerJobOpts? & tested with tier0 production script B3 Slices? T19a revised menu for MC09 (menus)B2Srini T19b menu (menus) not needed in 2009n/aSrini T20Menus for data taking (menus)CSrini T21aFirst version of new TrigDecisionTool for Athena/ARA (menus)ABold T21b First version of TrigDecisionTool for users (menus)B1 Bold T21dMigration of all TrigDecisionTool trigger clientsB3Slices T21eMigration of all TrigDecisionTool other clientsB3Joerg T22Serializer extended to handle top level persistent class evolution (EDM)B1Masik T23ntuples can be written to single or multiple files configured by TriggerJobOpt & tested with tier0 production script B3 Joerg+slices

Validation Ricardo GonçaloTrigger Open Meeting - 15 July 20097

Ricardo GonçaloTrigger Open Meeting - 15 July Bug counts – the calm before the storm?

Ricardo GonçaloTrigger Open Meeting - 15 July Bug closing campaign by slice

Status of X – I Validation of X for MC08 reprocessing and MC09 production has started with (not MC09 menu) – See physics validation meeting yesterday: Event filter electron and muon (comb) efficiency zero for eta < 2.1!! – Appears in AtlasProduction but not in AtlasOffline (for muons) – Probably fixed by latest InDetTrigRecExample – Seen in other slices? We will NOT sign off on trigger validation for MC09 production before having feedback from each slice – See the muon slice presentation for a good example of what is needed: Ricardo GonçaloTrigger Open Meeting - 15 July A.Ventura J.Kretzschmar

Status of X – II AOD size issue: – We were surprised by a huge increase in the trigger EDM size in AOD/ESD files – for ttbar events in a recently nightly: MC menu with no pre-scales 140 kB/event MC menu, with some prescales 110 kB/event Physics menu with no pre-scales 50 kB/event Physics menu with pre-scales 35 kB/event – Not a relevant problem for real data, but seriously affects how much MC can be made, kept and analysed – note nominal AOD size is 150 kB/event – The menu evolution needs to take the AOD size into account and this needs to be monitored in validation – Solution: run Physics menu on most MC09 production and the full MC menu only on min-bias, di-jets, and individual samples for trigger studies Note that MC09 trigger menu is NOT in MC09 trigger menu being finalised for – Sample A and enhanced bias will need to be validate d!! Ricardo GonçaloTrigger Open Meeting - 15 July

Status of X – III Menu/DB infrastructure for production ready to test – This includes no longer using $AtlasVersion We are still left with: – #52096 – re-running hypos – maybe solved (waiting for tomorrow’s devval) – # decide what if anything to put in cache for IDScan. – # slimming broken, could affect DPD production, will try Tomasz since Ben is away and Michael is busy. – Quite a few WARNINGs – remember these can affect production if they occur too frequently! Ricardo GonçaloTrigger Open Meeting - 15 July

Status of Nightly tests have been ok lately but with large fluctuations in quality – Last 2 nightlies have serious problems – Mostly from outside the trigger but also ongoing trigger problems A delay to the schedule of a few days is being discussed for Monday 20 July at 21:00 – Not certain! Expect an announcement later today or tomorrow Ricardo GonçaloTrigger Open Meeting - 15 July

Validation tests There is an ongoing cleanup and improvement of trigger tests. E.g.: Removed "Modern" from test names and add trig to the name: AthenaModernRDO.py -> AllTrigRDO.py Remove “CSC” from reference file names Add “leakcheck” to the test that have this switched on (AllTrigRDO_leakecheck) and AllTrigRDO_blackhole_leakcheck) Remove lumi0.01 tests: – lumi0.01 -> AllTrigRDO_lumi1E32 Add doc tags to all tests Rationalize test that sort chains Rename some tests so that the results occur together in summary page, e.g. XMLvsDBconfig Change BStoESD for MC to use RAWtoESD transform Remove HLTtesting and move all tests to TrigP1Test Ricardo GonçaloTrigger Open Meeting - 15 July Basic test; based on RecExCommon; read RDO; run trigger 

Validation coordination This is my last talk as validation coordinator The role is changing: – David will continue through next year – A second rotating coordinator from a pool of trigger experts will serve for 2-3 months – Many thanks to Monika for agreeing to fulfill this role!!! – A detailed job description is being put together for this Ricardo GonçaloTrigger Open Meeting - 15 July