DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.

Slides:



Advertisements
Similar presentations
L2 chains for single-beam menu Muon full reconstruction T2Calo starting from MBTS Ricardo Gonçalo, Denis Damazio.
Advertisements

Jet Slice Status Report Ricardo Gonçalo (LIP) and David Miller (Chicago) For the Jet Trigger Group Trigger General Meeting – 9 July 2014.
Releases & validation Simon George & Ricardo Goncalo Royal Holloway University of London HLT UK – RAL – 13 July 2009.
SLUO LHC Workshop, SLACJuly 16-17, Analysis Model, Resources, and Commissioning J. Cochran, ISU Caveat: for the purpose of estimating the needed.
Trigger Data Formats From CBNT to ESD and/or DPD June 11, 2008 Fabrizio Salvatore, Ricardo Gonçalo, RHUL.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Real Time 2010Monika Wielers (RAL)1 ATLAS e/  /  /jet/E T miss High Level Trigger Algorithms Performance with first LHC collisions Monika Wielers (RAL)
TRIGGER DATA FOR PHYSICS ANALYSIS ATLAS Software Tutorial – 22 nd to 24 th April 2009 Ricardo Gonçalo – Royal Holloway.
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
Trigger Tools for Physics Analysis Some use cases Building a data sample Event by event analysis Input from across the Atlantic conclusions Thank you!
Trigger-aware analysis Current status Under development What’s missing Conclusions & Outlook Ricardo Gonçalo (RHUL)
News from the Beatenberg Trigger Workshop Ricardo Gonçalo - 18 February 2009 Higgs WG Meeting during ATLAS Week.
The New TrigDecision Nicolas Berger, Till Eifert, Ricardo Gonçalo Physics Analysis Tools session ATLAS Software Workshop – Munich, March 2007.
What’s in the ATLAS data : Trigger Decision ATLAS Offline Software Tutorial CERN, August 2008 Ricardo Gonçalo - RHUL.
Trigger validation for Event size TrigDecision Jets Electrons Ricardo Gonçalo, RHUL Physics Validation Meeting – 9 October 2007.
Ricardo Gonçalo (RHUL) Higgs WG meeting – 28 th August, 2007 Outline: Introduction & release plans Progress in menus for cm -2 s -1 Workshop on trigger.
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
1 Trigger “box” and related TDAQ organization Nick Ellis and Xin Wu Chris Bee and Livio Mapelli.
Overview of trigger EDM and persistency Focusing on the e/  slice Referring to the work of several people Ricardo Gonçalo.
LVL2 ID ESD/AOD classes Status and plans. PESA L2 ID Algorithms Review - RAL 25 July Ricardo Goncalo ESD/AOD More and more interest from physics.
Trigger ESD/AOD Simon George (RHUL) Ricardo Goncalo (RHUL) Monika Wielers (RAL) Reporting on the work of many people. ATLAS software week September.
Status of trigger software and EDM Ricardo Gonçalo, RHUL – on behalf of ATLAS TDAQ.
The ATLAS Trigger: High-Level Trigger Commissioning and Operation During Early Data Taking Ricardo Gonçalo, Royal Holloway University of London On behalf.
Full Dress Rehearsal (FDR1) studies Sarah Allwood-Spiers 11/3/2008.
Trigger Software Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) TAPM Open Meeting – April 12, 2007 Outline: Reminder of plans Status of infrastructure.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
Artemis School On Calibration and Performance of ATLAS Detectors Jörg Stelzer / David Berge.
AOD/ESD plans Status and plans focusing on LVL2 e/  and some items for discussion On behalf of: J.Baines, P.Casado, G.Comune, A.DiMattia, S.George, R.Goncalo,
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
A New Tool For Measuring Detector Performance in ATLAS ● Arno Straessner – TU Dresden Matthias Schott – CERN on behalf of the ATLAS Collaboration Computing.
Trigger validation for Many thanks to Long Zhao, Chihiro Omachi, Julie Kirk, Giovanni Siragusa, Patricia Conde Muiño, Andreas Reinsch, Olya Igonkina,
PESAsim – the e/  analysis framework Validation of the framework First look at a trigger menu combining several signatures Short-term plans Mark Sutton.
W/Z Plan For Winter Conferences Tom Diehl Saclay 12/2001.
Kyle Cranmer (BNL)HCP, Isola d’Elba, March 23, The ATLAS Analysis Architecture Kyle Cranmer Brookhaven National Lab.
University user perspectives of the ideal computing environment and SLAC’s role Bill Lockman Outline: View of the ideal computing environment ATLAS Computing.
Trigger Validation Olga Igonkina (U.Oregon), Ricardo Gonçalo (RHUL) on behalf of trigger community Physics Validation Meeting – Feb. 13, 2007.
The PESAsim analysis framework What it is How it works What it can do How to get it and use it Mark Sutton Tania McMahon Ricardo Gonçalo.
The ATLAS TAGs Database - Experiences and further developments Elisabeth Vinek, CERN & University of Vienna on behalf of the TAGs developers group.
Reconstruction of t  bl. Ricardo GoncaloCSC ttH, H->bb; 11 Oct 062 The idea is (try to) to improve the reconstruction of the top decaying as t  bl –To.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
Performance DPDs and trigger commissioning Preparing input to DPD task force.
H->bb Weekly Meeting Ricardo Gonçalo (RHUL) HSG5 H->bb Weekly Meeting, 22 February 2011.
Trigger Input to First-Year Analysis Model Working Group And some soul searching… Trigger Open Meeting – 29 July 2009.
M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+
E/gamma report Ricardo Gonçalo for the e/γ slice.
Status report for LVL2 e/  ESD/AOD Aims and constraints Tracking status Calorimetry status (Monika) Monika Wielers Ricardo Gonçalo.
Tim Christiansen (CERN), Claudio Campagnari (UCSB), and Benedikt Hegner (CERN) for the Top-Physics Group AOD/PAT-tuples: Top-PAG Plans and Needs for the.
Planning sample T Ricardo Gonçalo, RHUL. What we’re doing… We are putting together a wish list for: – Signal MC samples to be generated when there are.
Aug _5071 Top stop by charm channel analysis using D0 runI data OUTLINE physics process of top to stop Monte Carlo simulation for signal data.
Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
ATLAS Group Introduction + TriggerMasahiro Morii20’ Muon Spectrometer + Upgrades João Guimarães da Costa25’ Cosmic Ray AnalysisAlberto Belloni20’ Physics.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
3rd April Richard Hawkings Analysis models in the top physics group  A few remarks …  What people are doing now  Where we are going - Top reconstruction.
Status Report on Data Reconstruction May 2002 C.Bloise Results of the study of the reconstructed events in year 2001 Data Reprocessing in Y2002 DST production.
H->bb Note Plans for Summer Ricardo Gonçalo (RHUL) HSG5 H->bb weekly meeting, 21 June 2011.
Introduction 08/11/2007 Higgs WG – Trigger meeting Ricardo Gonçalo, RHUL.
ATLAS UK physics meeting, 10/01/08 1 Triggers for B physics Julie Kirk RAL Overview of B trigger strategy Algorithms – current status and plans Menus Efficiencies.
ATLAS B trigger Overview of B trigger Di-muon algorithms Performance (efficiency/rates) Menu for data taking experience 7/1/20101ATLAS UK Meeting,
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Skimming in Zztop Ricardo – SLT meeting.
Monitoring of L1Calo EM Efficiencies
Atlas IO improvements and Future prospects
Some introduction Cosmics events can produce energetic jets and missing energy. They need to be discriminated from collision events with true MET and jets.
Concluding discussion on Commissioning, Etmiss and DPD
Developments of the PWG3 muon analysis code
G. Watts (UW/Seattle) For the Hidden Valley Group
ALICE Computing Upgrade Predrag Buncic
Presentation transcript:

DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL

Derived Physics Data Why do we need them? Disk space at Tier2s – Tier2 sites will provide data access to most of ATLAS – this is not enough for many studies – Only a fraction of the space can be taken with ESD – DPDs can have some ESD-level data if on the whole they’re small enough Centralized production – the train model Skimming should make analysis faster – Primary DPDs produced centrally at Tier1s to optimize resources Ricardo Gonçalo2Trigger Menus - 26 Aug 08 Skimming – remove un-interesting events Slimming – remove un-needed containers/objects Thinning – remove un-necessary object details Skimming – remove un-interesting events Slimming – remove un-needed containers/objects Thinning – remove un-necessary object details

DPD task force Created 22 July to establish the requirements and address the design of the DPD – Led by Gustaaf Brooijmans and David Côté First prototype is working in the FDR-2c starting today – Needs release PATJobTransforms PrimaryDPDMaker – This will be a first prototype to be improved for initial running More details: – – Trigger represented by Xin and me; Fabrizio also part of DPD Task Force Ricardo GonçaloTrigger Menus - 26 Aug 083

The story/plan so far… Only concerned with primary DPD – D n PD really means ntuples obtained from DPD Produce 8 “Performance DPDs” at Tier0 and Tier1 for detector/reconstruction performance studies – Physics DPDs to be defined later – not immediate priority and would benefit from more experience Design based on (trigger) streams – Rely somewhat on stream overlap ≈ 10% – not producing 8 DPDs × N streams! Count on 1 DPD/stream + few extra requests Data formats in Tier2 disk: – 25% Simulation – 25% AOD – 25% DPD – 25% the rest: BS, ESD, user data (job output) – requested by each group Sizes: – AOD ≈ ⅕ ESD – Performance DPD ≈ 10% ESD ≈ ½ AOD – AOD : around 50 kB/event for ttbar with no Bphysics menu – assume 30 kB/streamed event – Perfrormance DPD: bottom line is around 15 kB / (event × stream efficiency × skimming efficiency) assuming 1 DPD per trigger stream Ricardo GonçaloTrigger Menus - 26 Aug 084

Performance DPDs Strategies: – “RoI DPD” – keep heavy objects only from regions of interest E.g. calorimeter cells in a cone around an electron Typical “efficiency” wrt full ESD found to be ~20% – Skim events to keep signal enriched sample (W/Z signal/standard candles, high-p T, tight PID) – Prescale: keep only a fraction of events in some DPDs Heavy and Light performance DPDs – Heavy: ESD->DPD at Tier0 ESD-level information for detailed performance studies 8 heavy DPDs ≅ 80% AOD volume – Light: AOD->DPD at Tier1 AOD-level information for quick exploration 8 light DPDs ≅ 10% AOD volume DPD Light intended as basis for Physics DPD DPD making: – New package PhysicsAnalysis/PrimaryDPDMaker to organise code for primary DPDs – Use Tau/Egamma/XXXDPDMakers for D 2 PD, D 3 PD only Bookkeeping: – Use EventBookkeeper being deveoped within PAT to keep track of skim efficiencies, etc – Need to address event duplication from stream overlap Ricardo GonçaloTrigger Menus - 26 Aug 085

Ricardo GonçaloTrigger Menus - 26 Aug 086 See PhysicsAnalysis/PrimaryDPDMaker/python/PrimaryDPD_OutputDefinitions.py for list of objects

DPDs and Trigger Trigger slices interested in using Combined Performance DPDs Important to have enough trigger info to also allow trigger studies Monte Carlo DPDs: – DPD relies on streaming – Streaming relies on Trigger – For Monte Carlo data rely on trigger simulation Ricardo GonçaloTrigger Menus - 26 Aug 087

Trigger information in DPDs Input from slices and physics groups collected: reported by Fabrizio in the July 23 rd Menus meeting Which triggers passed/failed, prescale, passthrough Enough info to allow tag-and-probe (match trigger and offline objects) Benchmark for minimal trigger info being requested! Possibility: use for selection optimisation Trigger navigation: – For 2008 run: store as is, no thinning – For 2009 run: Thin down to contain only requested chains Tomasz and Harvard group interested Not clear how to deal with trigger features attached to deleted chains Configuration information to remain unslimmed Matching between offline and online objects – Quite some interest from physics groups – Existed in EventViewTrigger – Can we provide common solution? Carsten Hensel working on this Ricardo GonçaloTrigger Menus - 26 Aug 088

Ricardo GonçaloTrigger Menus - 26 Aug 089 Menus meeting 23/7/08

Trigger objects currently in DPD Configuration and steering: TrigConf::Lvl1AODPrescaleConfigData#AODConfig-0 TrigConf::Lvl1AODPrescaleConfigData#AODConfig* duplicate TrigConf::HLTAODConfigData#AODConfig* TrigConf::Lvl1AODConfigData#AODConfig* TrigDec::TrigDecision#TrigDecision* HLT::HLTResult#HLTResult_EF HLT::HLTResult#HLTResult_L2 TrigRoiDescriptorCollection#HLT TrigRoiDescriptorCollection#HLT_T2TauFinal TrigRoiDescriptorCollection#HLT_TrigT2CaloEgamma TrigRoiDescriptorCollection#HLT_TrigT2CaloJet TrigRoiDescriptorCollection#HLT_TrigT2CaloTau TrigRoiDescriptorCollection#HLT_forMS Level 1: LVL1_ROI#LVL1_ROI LVL1::JEMRoI#JEMRoIs LVL1::TriggerTower#TriggerTowers LVL1::JEMEtSums#JEMEtSums L2 muons: CombinedMuonFeature#HLT_egamma CombinedMuonFeature#HLT MuonFeatureContainer#HLT TrigMuonEFContainer#HLT_MuonEF Configuration and steering: TrigConf::Lvl1AODPrescaleConfigData#AODConfig-0 TrigConf::Lvl1AODPrescaleConfigData#AODConfig* duplicate TrigConf::HLTAODConfigData#AODConfig* TrigConf::Lvl1AODConfigData#AODConfig* TrigDec::TrigDecision#TrigDecision* HLT::HLTResult#HLTResult_EF HLT::HLTResult#HLTResult_L2 TrigRoiDescriptorCollection#HLT TrigRoiDescriptorCollection#HLT_T2TauFinal TrigRoiDescriptorCollection#HLT_TrigT2CaloEgamma TrigRoiDescriptorCollection#HLT_TrigT2CaloJet TrigRoiDescriptorCollection#HLT_TrigT2CaloTau TrigRoiDescriptorCollection#HLT_forMS Level 1: LVL1_ROI#LVL1_ROI LVL1::JEMRoI#JEMRoIs LVL1::TriggerTower#TriggerTowers LVL1::JEMEtSums#JEMEtSums L2 muons: CombinedMuonFeature#HLT_egamma CombinedMuonFeature#HLT MuonFeatureContainer#HLT TrigMuonEFContainer#HLT_MuonEF L2 Jets: TrigT2Jet#HLTAutoKey*obsolete TrigT2JetContainer#HLT_TrigT2CaloJet L2 Missing ET: TrigMissingETContainer#HLT_T2MissingET L2 tracks: TrigInDetTrackCollection#HLTAutoKey* TrigInDetTrackCollection#HLT TrigInDetTrackCollection#HLT_TRTSegmentFinder TrigInDetTrackCollection#HLT_TRTxK TrigInDetTrackCollection#HLT_TrigIDSCAN_eGamma* TrigInDetTrackCollection#HLT_TrigSiTrack_eGamma* TrigInDetTrackCollection#HLT_TrigIDSCAN_Tau TrigInDetTrackCollection#HLT_TrigSiTrack_Tau TrigInDetTrackCollection#HLT_TrigIDSCAN_Muon TrigInDetTrackCollection#HLT_TrigIDSCAN_Jet TrigInDetTrackCollection#HLT_TrigIDSCAN_eGamma L2 egamma: TrigEMCluster#HLTAutoKey*obsolete TrigEMClusterContainer#HLT* TrigEMClusterContainer#HLT_TrigT2CaloEgamma TrigElectronContainer#HLTAutoKey*obsolete TrigPhotonContainer#HLTAutoKey*obsolete TrigElectronContainer#HLT_L2IDCaloFex TrigPhotonContainer#HLT_L2PhotonFex L2 Jets: TrigT2Jet#HLTAutoKey*obsolete TrigT2JetContainer#HLT_TrigT2CaloJet L2 Missing ET: TrigMissingETContainer#HLT_T2MissingET L2 tracks: TrigInDetTrackCollection#HLTAutoKey* TrigInDetTrackCollection#HLT TrigInDetTrackCollection#HLT_TRTSegmentFinder TrigInDetTrackCollection#HLT_TRTxK TrigInDetTrackCollection#HLT_TrigIDSCAN_eGamma* TrigInDetTrackCollection#HLT_TrigSiTrack_eGamma* TrigInDetTrackCollection#HLT_TrigIDSCAN_Tau TrigInDetTrackCollection#HLT_TrigSiTrack_Tau TrigInDetTrackCollection#HLT_TrigIDSCAN_Muon TrigInDetTrackCollection#HLT_TrigIDSCAN_Jet TrigInDetTrackCollection#HLT_TrigIDSCAN_eGamma L2 egamma: TrigEMCluster#HLTAutoKey*obsolete TrigEMClusterContainer#HLT* TrigEMClusterContainer#HLT_TrigT2CaloEgamma TrigElectronContainer#HLTAutoKey*obsolete TrigPhotonContainer#HLTAutoKey*obsolete TrigElectronContainer#HLT_L2IDCaloFex TrigPhotonContainer#HLT_L2PhotonFex Ricardo GonçaloTrigger Menus - 26 Aug 0810

L2 taus: TrigTau#HLTAutoKey*obsolete Trigtauclustercontainer#HLT_TrigT2CaloTau TrigTauContainer#HLT TrigTauTracksInfoCollection#HLT EF taus: Analysis::TauJetContainer#HLT_TrigTauRecMerged Analysis::TauJetContainer#HLT_TrigTauRecCalo Analysis::TauDetailsContainer#HLT_TrigTauDetailsCalo Analysis::TauDetailsContainer#HLT_TrigTauDetailsMerged Analysis::TauDetailsContainer#HLTAutoKey* duplicate Analysis::TauJetContainer#HLTAutoKey*obsolete Analysis::TauJetContainer#HLT_TrigTauRecMerged Analysis::TauJetContainer#HLT_TrigTauRecCalo TrigTauTracksInfoCollection#HLT EF Missing ET: TrigMissingET#HLTAutoKey* TrigMissingETContainer#HLT_TrigEFMissingET L2 taus: TrigTau#HLTAutoKey*obsolete Trigtauclustercontainer#HLT_TrigT2CaloTau TrigTauContainer#HLT TrigTauTracksInfoCollection#HLT EF taus: Analysis::TauJetContainer#HLT_TrigTauRecMerged Analysis::TauJetContainer#HLT_TrigTauRecCalo Analysis::TauDetailsContainer#HLT_TrigTauDetailsCalo Analysis::TauDetailsContainer#HLT_TrigTauDetailsMerged Analysis::TauDetailsContainer#HLTAutoKey* duplicate Analysis::TauJetContainer#HLTAutoKey*obsolete Analysis::TauJetContainer#HLT_TrigTauRecMerged Analysis::TauJetContainer#HLT_TrigTauRecCalo TrigTauTracksInfoCollection#HLT EF Missing ET: TrigMissingET#HLTAutoKey* TrigMissingETContainer#HLT_TrigEFMissingET EF Jets: JetCollection#HLTAutoKey*obsolete JetCollection#HLT JetCollection#HLT_TrigJetRec EF Muons: TrigMuonEFContainer#HLTAutoKey*obsolete EF egamma: egammaContainer#HLTAutoKey*obsolete egammaContainer#NoIDEF_RoI* egammaContainer#egamma_RoI* egammaContainer#HLT_egamma Egdetailcontainer#HLTAutoKey* egDetailContainer#HLT_egamma* EF tracks: Rec::TrackParticleContainer#HLTAutoKey*obsolete? VxContainer#HLT_PrimVx Rec::TrackParticleContainer#HLT_InDetTrigParticleCreation _Tau_EFID EF Jets: JetCollection#HLTAutoKey*obsolete JetCollection#HLT JetCollection#HLT_TrigJetRec EF Muons: TrigMuonEFContainer#HLTAutoKey*obsolete EF egamma: egammaContainer#HLTAutoKey*obsolete egammaContainer#NoIDEF_RoI* egammaContainer#egamma_RoI* egammaContainer#HLT_egamma Egdetailcontainer#HLTAutoKey* egDetailContainer#HLT_egamma* EF tracks: Rec::TrackParticleContainer#HLTAutoKey*obsolete? VxContainer#HLT_PrimVx Rec::TrackParticleContainer#HLT_InDetTrigParticleCreation _Tau_EFID Ricardo GonçaloTrigger Menus - 26 Aug 0811 See PhysicsAnalysis/PrimaryDPDMaker/python/PrimaryDPD_OutputDefinitions.py for more details and offline objects Please let us know what’s missing and what’s obsolete (we need confirmation)

Conclusions First prototype of Performance DPDs being tried out right now in FDR-2c All trigger information being kept – We need to know what is missing and what is old Ricardo GonçaloTrigger Menus - 26 Aug 0812

EDM migration allowed improvements in data size on file Overall size of trigger data depends strongly on data type and on menu Running menu for L=10 31 cm -2 s -1 (no Bphysics): – AOD total size: 48 kB/event – ESD total size: 86 kB/event The HLTResult may be reduced further to 1-2 kB/event by slimming out navigation information - (e.g. for inclusion in DPDs) Ricardo GonçaloTrigger Menus - 26 Aug HLTResult 12.1Rec::TrackParticleContainer 9.9TrigInDetTrackCollection 3.6CaloClusterContainer 2.1TrigElectronContainer 1.9egDetailContainer 1.2Trk::VxContainer 0.7TrigTauClusterContainer

Ricardo GonçaloTrigger Menus - 26 Aug 0814