Validation and RTT in the new xAOD Framework Bruce Schumm, UC Santa Cruz For the ID Val/RTT Task Force Tim Adye, Max Baugh, Nick Edwards, Goetz Gaycken,

Slides:



Advertisements
Similar presentations
SiD PFA Status and Calorimeter Performance Ron Cassell (SLAC) SiD Design Study Meeting 11/15/08.
Advertisements

B-tagging, leptons and missing energy in ATLAS after first data Ivo van Vulpen (Nikhef) on behalf of the ATLAS collaboration.
1 Reconstruction of Non-Prompt Tracks Using a Standalone Barrel Tracking Algorithm.
Implementation of e-ID based on BDT in Athena EgammaRec Hai-Jun Yang University of Michigan, Ann Arbor (with T. Dai, X. Li, A. Wilson, B. Zhou) US-ATLAS.
A Package For Tracking Validation Chris Meyer UC Santa Cruz July 6, 2007.
First Thoughts About Backtracking Performance Assessment and Validation Bruce Schumm UC Santa Cruz July Validation Meeting.
Off-axis Simulations Peter Litchfield, Minnesota  What has been simulated?  Will the experiment work?  Can we choose a technology based on simulations?
Efficiency and Purity Studies Outside the VXD: Applying AxialBarrelTrackfinderZ and GarfieldTrackFinder By: Tyler Rice, Chris Meyer August 21, 2007.
Validation of DC3 fully simulated W→eν samples (NLO, reconstructed in ) Laura Gilbert 01/08/06.
SUSY studies at UCSC Bruce Schumm UC Santa Cruz Victoria Linear Collider Workshop July 28-31, 2004.
First Thoughts About Backtracking Validation Bruce Schumm UC Santa Cruz October 3, 2007 Inner Detector Software Meeting.
First Thoughts About Backtracking Validation Bruce Schumm UC Santa Cruz October 3, 2007 Inner Detector Software Meeting.
WH  bb and WH  uu Studies Monica Dunford FTK Monthly Meeting March 13 th, 2007.
Tracking Efficiency and Momentum Resolution Analysis Chris Meyer UCSC ILC Simulation Reconstruction Meeting March 13, 2007.
Update on Secondaries and Backtracking Validation Bruce Schumm UC Santa Cruz February 22, 2008 Inner Detector Software Meeting.
Silicon Tracking for Forward Electron Identification at CDF David Stuart, UC Santa Barbara Oct 30, 2002 David Stuart, UC Santa Barbara Oct 30, 2002.
1 N. Davidson Calibration with low energy single pions Tau Working Group Meeting 23 rd July 2007.
Tracking Simulation Studies at UC Santa Cruz Bruce Schumm UCSC/SCIPP LCWS07 DESY May 30-Jun Tracking Validation Studies Non-prompt tracks with SiD.
SIMULATION STUDIES AT SANTA CRUZ Bruce Schumm University of California at Santa Cruz ALCPG Workshop, Vancouver July 19-22, 2006 Special Recognition: Eric.
Using Track based missing Et tools to reject fake MET background Zhijun Liang,Song-Ming Wang,Dong liu, Rachid Mazini Academia Sinica 8/28/20151 TWiki page.
E. Devetak - LCWS t-tbar analysis at SiD Erik Devetak Oxford University LCWS /11/2008 Flavour tagging for ttbar Hadronic ttbar events ID.
Lepton efficiency & fake rate Yousuke Kataoka University of Tokyo Content definitions of leptons p2 efficiency and fake rate for SU3 ( ) p3, p4.
Non-prompt Track Reconstruction with Calorimeter Assisted Tracking Dmitry Onoprienko, Eckhard von Toerne Kansas State University, Bonn University Linear.
Optimising Cuts for HLT George Talbot Supervisor: Stewart Martin-Haugh.
19/07/20061 Nectarios Ch. Benekos 1, Rosy Nicolaidou 2, Stathes Paganis 3, Kirill Prokofiev 3 for the collaboration among: 1 Max-Planck-Institut für Physik,
SUSY with Photons and MET: Introduction and thoughts about Diphoton and Single Photon Analyses Annecy DESY/University of Hamburg Liverpool University Tokyo.
Physics Validation. Validations 18/12/13: DC14 (1) 5 validation tasks for this week: Several DC14 simulation tests, grouped into 3 tasks 2 tasks on IBL/ITK.
AMB HW LOW LEVEL SIMULATION VS HW OUTPUT G. Volpi, INFN Pisa.
A Study of Electron Identification Jim Branson UCSD with collaborators from FNAL, UCSB & UCSD.
/MuID status report on behalf of the Moore/MuID group. Status in the releases ( Units Migrations DC1/G3 MuonGeoModel Migration DC2/G4) MuID updates Trig.
FTKSim Status and plans FTK Meeting 07/13/2006 F. Crescioli, M. Dell'Orso, G. Punzi, G.Volpi, P. Giannetti.
Current Analysis Activity/Results (Only brief overview) Sunil Bansal (Panjab University, Chandigarh) Approved results marked.
Update on WH to 3 lepton Analysis And Electron Trigger Efficiencies with Tag And Probe Nishu 1, Suman B. Beri 1, Guillelmo Gomez Ceballos 2 1 Panjab University,
Fast Simulation and the Higgs: Parameterisations of photon reconstruction efficiency in H  events Fast Simulation and the Higgs: Parameterisations of.
The “Comparator” Atlfast vs. Full Reco Automated Comparison Chris Collins-Tooth 19 th February 2006.
Using Track based missing Et tools to reject fake MET background Muhammad Firdaus Mohd Soberi UMichigan-CERN Semester Program Thursday, 12 th February.
Tomas Hreus, Pascal Vanlaer Overview: K0s correction stability tests Jet-pt correction closure test Study of Strangeness Production in Underlying Event.
Trigger study on photon slice Yuan Li Feb 27 th, 2009 LPNHE ATLAS group meeting.
10 January 2008Neil Collins - University of Birmingham 1 Tau Trigger Performance Neil Collins ATLAS UK Physics Meeting Thursday 10 th January 2008.
VXDBasedReco TRACK RECONSTRUCTION PERFORMANCE STUDIES Bruce Schumm University of California at Santa Cruz ALCPG Workshop, Snowmass Colorado August 14-28,
Update on Diffractive Dijet Production Search Hardeep Bansil University of Birmingham 23/07/2012.
Tau31 Tracking Efficiency at BaBar Ian Nugent UNIVERSITY OF VICTORIA Sept 2005 Outline Introduction  Decays Efficiency Charge Asymmetry Pt Dependence.
John Marshall, 1 John Marshall, University of Cambridge LCD-WG2, July
BEACH 04J. Piedra1 SiSA Tracking Silicon stand alone (SiSA) tracking optimization SiSA validation Matthew Herndon University of Wisconsin Joint Physics.
ITTF “Re-View” Session, August 11, 2003 Manuel Calderón de la Barca Sánchez ITTF Evaluation for Spectra.
Photon purity measurement on JF17 Di jet sample using Direct photon working Group ntuple Z.Liang (Academia Sinica,TaiWan) 6/24/20161.
Status of the measurement of K L lifetime - Data sample (old): ~ 440 pb -1 ( ) - MC sample: ~125 pb -1 ( mk0 stream ) Selection: standard tag (|
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
H->WW->lνlν Analysis - Improvements and results - - Data and MC - Higgs Working group meeting, 6 January 2011 Magda Chełstowska & Rosemarie Aben.
David Lange Lawrence Livermore National Laboratory
E. Soldatov Tight photon efficiency study using FSR photons from Z  ll  decays E.Yu.Soldatov 1, 1 National Research Nuclear University “MEPhI”
Full Sim Status Estel Perez 27 July 2017.
RD. Schaffer, L. Iconomidou Fayard, D. Fournier
Erik Devetak Oxford University 18/09/2008
L2 Muon Trigger Study Status Report
Tracker Upgrade Simulations Software Harry Cheung (Fermilab)
Tracking performances & b-tagging commissioning
Tree based validation tool for track reconstruction
Integration and alignment of ATLAS SCT
Global PID MICE CM43 29/10/15 Celeste Pidcott University of Warwick
FTK variable resolution pattern banks
Update of Electron Identification Performance Based on BDTs
Linear Collider Simulation Tools
Muon Trigger Software Status
Search for coincidences and study of cosmic rays spectrum
Performance of BDTs for Electron Identification
Samples and MC Selection
Contents First section: pion and proton misidentification probabilities as Loose or Tight Muons. Measurements using Jet-triggered data (from run).
Linear Collider Simulation Tools
An Easy to Use Track Comparison Tool
Presentation transcript:

Validation and RTT in the new xAOD Framework Bruce Schumm, UC Santa Cruz For the ID Val/RTT Task Force Tim Adye, Max Baugh, Nick Edwards, Goetz Gaycken, Heather Gray, Simone Pagan Griso, Qi Li, Soeren Prell, Shaun Roe, Basil Schnieder, Bruce Schumm, Nick Styles July

08 July Of course, need to move into new xAOD framework Opportunity to rethink / further codify approach to validation and monitoring Reat-Time Testing (RTT): “Nightly” (daily) snapshot of tracking CP on a number of physics samples (single particle, Z  μμ, ttbar, minimum-boas Validation: More detailed review of tracking CP and MC simulation for fixed releases This will be a status report, with some points of current discussion highlighted Motivation and Outline

08 July New package, InDetPhysValMonitoring, developed from scratch (Shaun Roe) to replace prior InDetPerformanceRTT package. Uses “decorated” xAOD; decortator algorithm runs a number of tools developed by Shaun that restore detailed information to tracks nominally missing from the xAOD collections (e.g. hit info) Skeleton and basic functionality in place One exception is hit residuals; should be available soon Fine details (fiducial region, track quality) still under discussion Survey relative to prior (InDetPerformanceRTT) functionality for RTT and Validation (missing plots, plotting format) completed; missing areas being addressed Hope to have rudimentary system implemented in nightlies (RTT) soon, with DCube comparison between monitored and reference But finalization of underlying package will continue for some time Overview

08 July RTT Functionality: DCube Plots Resolutions, pulls and biases for the five track parameters, as functions of both P T and  Tracking efficiency vs.  Many categories of hit content of tracks: No. of Blayer, pixel, SCT, TRT hits, holes, shared, etc. Hit efficiencies by system Hit residuals in pixel, SCT, TRT Tracking efficiency and fakes within jets “Validation” task has substantially more plots; won’t list functionality here (still parsing the list in fact)

08 July RTT Interface for Shifters Branch: dev FitterNightly1 GeV μ 100 GeV μ Z → μμ1 GeV e 100 GeV e 1 GeV π 100 GeV π t tbar Zμμ pileup Min Bias t tbar IBL GChi2rel_0 Jul 5 14:21Jul 5 14:21 P Jul 5 14:21Jul 5 14:21 P Jul 5 11:36Jul 5 11:36 P Jul 5 16:07Jul 5 16:07 P Jul 5 15:42Jul 5 15:42 P Jul 5 14:01Jul 5 14:01 P Jul 5 15:06Jul 5 15:06 P Jul 5 11:51Jul 5 11:51 P Jul 5 10:56Jul 5 10:56 B Jul 5 11:36Jul 5 11:36 P Jul 5 11:01Jul 5 11:01 P GChi2rel_1 Jul 6 14:08Jul 6 14:08 P Jul 6 15:24Jul 6 15:24 P Jul 6 10:18Jul 6 10:18 P Jul 6 14:18Jul 6 14:18 P Jul 6 15:04Jul 6 15:04 P Jul 6 13:53Jul 6 13:53 P Jul 6 16:19Jul 6 16:19 P Jul 6 11:23Jul 6 11:23 P Jul 6 10:18Jul 6 10:18 B Jul 6 10:53Jul 6 10:53 P Jul 6 10:18Jul 6 10:18 P GChi2rel_2 Jun 30 15:18Jun 30 15:18 P Jun 30 15:23Jun 30 15:23 P Jun 30 09:52Jun 30 09:52 P Jun 30 13:33Jun 30 13:33 P Jun 30 13:08Jun 30 13:08 B Jun 30 14:48Jun 30 14:48 B Jun 30 15:03Jun 30 15:03 P Jun 30 10:22Jun 30 10:22 P Jun 30 09:47Jun 30 09:47 B Jun 30 10:22Jun 30 10:22 P Jun 30 09:52Jun 30 09:52 P GChi2rel_3 Jul 1 15:40Jul 1 15:40 B Jul 1 16:05Jul 1 16:05 P Jul 1 10:35Jul 1 10:35 P Jul 1 15:50Jul 1 15:50 B Jul 1 18:00Jul 1 18:00 P Jul 1 14:45Jul 1 14:45 P Jul 1 16:10Jul 1 16:10 P Jul 1 11:20Jul 1 11:20 P Jul 1 11:20Jul 1 11:20 B Jul 1 11:45Jul 1 11:45 P Jul 1 10:40Jul 1 10:40 P GChi2rel_4 Jul 2 15:18Jul 2 15:18 B Jul 2 15:29Jul 2 15:29 P Jul 2 10:48Jul 2 10:48 P Jul 2 14:08Jul 2 14:08 P Jul 2 16:39Jul 2 16:39 P Jul 2 13:58Jul 2 13:58 P Jul 2 14:43Jul 2 14:43 P Jul 2 11:38Jul 2 11:38 P Jul 2 10:17Jul 2 10:17 B Jul 2 11:28Jul 2 11:28 P Jul 2 10:27Jul 2 10:27 P GChi2rel_5 Jul 3 14:03Jul 3 14:03 P Jul 3 14:23Jul 3 14:23 P Jul 3 10:16Jul 3 10:16 P Jul 3 13:48Jul 3 13:48 P Jul 3 15:38Jul 3 15:38 P Jul 3 18:09Jul 3 18:09 B Jul 3 16:43Jul 3 16:43 P Jul 3 12:08Jul 3 12:08 P Jul 3 10:28Jul 3 10:28 B Jul 3 11:03Jul 3 11:03 P Jul 3 10:28Jul 3 10:28 P GChi2rel_6 Jul 4 15:32Jul 4 15:32 P Jul 4 14:01Jul 4 14:01 P Jul 4 10:31Jul 4 10:31 P Jul 4 13:56Jul 4 13:56 P Jul 4 15:37Jul 4 15:37 P Jul 4 14:16Jul 4 14:16 P Jul 4 16:12Jul 4 16:12 P Jul 4 11:06Jul 4 11:06 P Jul 4 10:31Jul 4 10:31 B Jul 4 11:11Jul 4 11:11 P Jul 4 10:56Jul 4 10:56 P

08 July Can be added: Fake (low matching probability) and duplicate (two tracks to same MC particle) rates for general tracking Tracking efficiency vs. P T ttbar sample

08 July Fiducial Region We have typically had three categories of tracking that we monitor: A)General tracking B)Outside-in tracking; i.e. BackTracking (TRT standalone tracking?) C)Tracking for Minimum Bias events For the calculation of tracking efficiency, the following have been identified as criteria to be considered in defining “trackable” particles 1) Charged 2) Stable 3) Not a strange baryon 4) Include/exclude descendants of K S or , or e+- from a conversions 5) Within specified eta range 6) Above specified Pt cut 7) Originates within specified radial extent 8) Track provenance (inside-out, backtracking, TRT standalone) 1) and 2) are always applicable; 3) comes from the MinBi analysis and would probably be fine for all types. 4) must be included for outside-in tracking. 5), 6) are probably the same for all; 7) must be relaxed for outside-in; for 8), MinBias requests only inside-out tracks

08 July Fiducial Region II Propose three fiducial-region configurations (please comment) Strange Baryons K S, , or Conversion Descendant Maximum Radius of Origin Track Provenance GeneralRejectAccept110 mmAny Minimum-Bias * Reject 110 mmInside-Out Only Outside-InRejectAcceptLargeAny Implemented via new TrackTruthSelectionTool (Nick Edwards) in InDetPhysValMonitoring package Configures via a string; more configurations can be implemented Determines “denominator” of tracking efficiency calculation * But makes use of special low-P T tracking for reconstruction

08 July Track Quality Cuts Following are the loose cuts for inside-out tracks, from InDetTrackingPerformanceGuidelines Twiki, which claims that there are applied during reconstruction and thus do not need to be applied again to the collection p T > 400 MeV: Note that we consider the p T cut to be a physics cut and, as such, is likely to be application specific. Therefore we list the cut that is used in track reconstruction here, but it does not form part of the official recommendations. |η| < 2.5 N Si ≥ 7 N sh mod ≤ 1 N hole Si ≤ 2 N hole Pix ≤ 1 Addition cuts define loose-primary Either (N Si ≥ 7 and N sh Si = 0) OR N Si ≥ 10 and tight N Si ≥ 9 (if |η| ≤ 1.65) N Si ≥ 11 (if |η| > 1.65) N IBL + N B-layer > 0 N hole Pix = 0 Additionally, for the numerator of the tracking efficiency calculation, we can apply a truth-matching probability (0.50?)

08 July Track Quality Cuts II Some questions regarding track quality cuts… Do we want to apply tighter cuts? Same cuts for MinBi as for other analyses? (“Yes” for current RTT/Validation) Separate treatment for muons and electrons? (“No” for current RTT/Validation) What about outside-in tracking? Another question for outside-in tracking: Just BackTracking or also TRT-standalone?

08 July Diamond Beam Monitor (see next slide): do we include in ID RTT/Validation? Under discussion (thoughts?). Need to incorporate package into RTT “nightlies” system (Goetz is working with Brinnick; nearly done, but just ttbar sample for now). Post processing: Validation makes use of large samples divided between numerous files  “post- processing” step must be included to combine files before performance assessment (Soeren Prell) This and That…

08 July Diamond Beam Monitor (DBM)

08 July Projected Timelines A little hard to say… but some guesses: InDetPhysValMonitoring package should be in the RTT stream (ttbar sample at least) within a week(?), but code in package will still need work before output is useful for nightly monitoring. Hoping that InDetPhysValMonitoring package will mature over the next few weeks to month. This will include outside-in tracking (BackTracking and perhaps also TRT Standalone Tracking) DCube will also require some configuring (which plots for which samples), but may happen in parallel with the final stages of code development Validation will require additional post-processing step, and the implementation of many more plots. Probably will be a few weeks longer before that rolls out. I could be totally wrong about any of this, in either direction!

08 July BACKUP