JetMET DQM Status Kenichi Hatakeyama, Anwar Bhatti, Frank Chlebana, Jared Sturdy DQM Meeting November 4th, 2008

November 4, 2008DQM Meeting2 JetMET POG Monitoring Plots From CRAFT data JetMET POG DQM is already run routinely

November 4, 2008DQM Meeting3 JetMET DQM Shift Instruction

November 4, 2008DQM Meeting4 Data Certification for “Jets”  For jets we are looking at Several different algorithms (IterativeCone, SISCone, PFlow, JPT) Regions in the detector (Barrel, EndCap, Forward) High and low jet pt triggers  Quality test compares current histogram with a reference histogram Chi2 or KS test  Several distributions are tested (Pt, eta, phi, constituents, HOverE)

November 4, 2008DQM Meeting5 Determining the Quality Flags for “Jets”  Quality flags for the different jet algorithms determined by comparing histogram to reference  JetMET_Jet_AAA (AAA = IterativeCone, SISCone, PFlow, JPT)  if ( (JetMET_Jet_AAA_Pt_Low_Val > 950 ) && (JetMET_Jet_AAA_Pt_High_Val > 950 ) && (JetMET_Jet_AAA_Eta_Low_Val > 950 ) && (JetMET_Jet_AAA_Eta_High_Val > 950 ) && (JetMET_Jet_AAA_Phi_Low_Val > 950 ) && (JetMET_Jet_AAA_Phi_High_Val > 950 ) && (JetMET_Jet_AAA_Constituents_Low_Val > 950 ) && (JetMET_Jet_AAA_Constituents_High_Val > 950 ) && (JetMET_Jet_AAA_HOverE_Low_Val > 950 ) && (JetMET_Jet_AAA_HOverE_High_Val > 950 ) ) JetMET_Jet_AAA = 1

November 4, 2008DQM Meeting6 Data Certificaiton for “MET”  For MET, we are looking at met (MET from Barrel+Endcap+HF), and metNoHF (MET from Barrel+Endcap only).  Data Certification for MET: Currently fit MEx & MEy distributions to double Gaussians and check Chi2 and the peak.  Chi2 of double Gaussian fits: reduced chi2 <20 for lum section or 200 for entire run (Need to adjust the criteria based on the statistics)  Mean of the fitted Gaussian form: within +/-10 GeV Looking into METPhi, MET, METsignificance also  For these, need to compare with reference histograms (Chi2 or KS test) Performed for the entire run and also per lumi section.  Currently we use “monitoring variable versus lumi section” 2D histograms, but a long run can exceed the axis range… (see later slides)

November 4, 2008DQM Meeting7 DBS information is organized in three layers Able to select subcomponent (HB,HO, HE, HF) Layer 1 Layer 2 Layer 3 JetMET_Global JetMET_Jet_ICone JetMET_Jet_ICone_Barrel JetMET_Jet_SISCone JetMET_Jet_ICone_EndCap JetMET_Jet_PFlow JetMET_Jet_ICone_Forward JetMET_Jet_JPT JetMET_Jet_SISCone_Barrel... JetMET_MET JetMET_MET_All JetMET_MET_NoHF Currently have histograms for ICone, SISCone, and PFlow… Data Certification Outputs

November 4, 2008DQM Meeting8 Data Certification Algorithm Implementation  Data Certification runs as a standalone cmsRun job Next step: move this into the harvesting job  Using a root Chi2 or KS test to compare current histogram against a reference Reference histograms need to be accessible Looking into the qtest code…  Results are saved in a “Data Certification” folder in the DQM root file

November 4, 2008DQM Meeting9 DCS queries which return HV/LV settings for the HCAL takes several minutes (~3 min) to complete Example from run Many channels are stable HBM_HV1_2_08/M1 CH1 HB /22/08 14:36: HBM_HV1_2_08/M1 CH1 HB /22/08 14:36: HBM_HV1_2_08/M1 CH1 HB /22/08 14:36: Some channels are changing HBP_HV2_1_10/M2 CH1 HB /22/08 14:37: HBP_HV2_1_10/M2 CH1 HB /22/08 14:37: HBP_HV2_1_10/M2 CH1 HB /22/08 14:37: … HBP_HV2_1_10/M2 CH1 HB /22/08 14:38:19 32 HBP_HV2_1_10/M2 CH1 HB /22/08 14:38:25 20 HBP_HV2_1_10/M2 CH1 HB /22/08 14:38:31 12 HBP_HV2_1_10/M2 CH1 HB /22/08 14:38:50 4 HBP_HV2_1_10/M2 CH1 HB /22/08 15:41: HBP_HV2_1_10/M2 CH1 HB /22/08 15:41: HBP_HV2_1_10/M2 CH1 HB /22/08 15:41: … HBP_HV2_1_10/M2 CH1 HB /22/08 15:42: HBP_HV2_1_10/M2 CH1 HB /22/08 15:43: HBP_HV2_1_10/M2 CH1 HB /22/08 15:43: HBP_HV2_1_10/M2 CH1 HB /22/08 15:43: HV starts out low, is lowered, then raised DCS Queries

November 4, 2008DQM Meeting10 Data Certification  The JetMET Data Certification is determined entirely from the results saved in the DQM root file…  Jet Data Certification is reported for the entire run  MET Data Certification is reported for the entire run and also per lumi section  Will use DCS information to identify Luminosity Sections with bad data…  Should be folded into the DPG (HCAL, ECAL) Data Certification results…

November 4, 2008DQM Meeting11 MET DQM in CRAFT data (in following slides…)

November 4, 2008DQM Meeting12 Run MEx (GeV) MEy (GeV) METPhi (rad) Lumi Section With HF Barrel+Endcap Only First few lumi sections appear to be problematic. Number of events

November 4, 2008DQM Meeting13 Run cont’d  Zoom-in view  Problem only in a first few lumi sections  On a lumi section based method, can keep the majority of events

November 4, 2008DQM Meeting14 Run cont’d  Data certification Looking at  Chi2 of double Gaussian fits: reduced chi2 <20 (lum section) or 200 (entire run) (Need to adjust the criteria based on the statistics)  Mean of the fitted Gaussian form: within +-10 GeV

November 4, 2008DQM Meeting15 Run MEx (GeV) MEy (GeV) METPhi (rad) Lumi Section With HF Barrel+Endcap Only No major problem. Number of events

November 4, 2008DQM Meeting16 Run cont’d  Data certification output Good run

November 4, 2008DQM Meeting17 Run MEx (GeV) MEy (GeV) METPhi (rad) Lumi Section With HF Barrel+Endcap Only Noise in HF at phi~0.8 Check of the mean MEx or MEy will detecot this problem. Number of events

November 4, 2008DQM Meeting18 Run cont’d  Data certification output MET without HF mostly OK

November 4, 2008DQM Meeting19 Run MEx (GeV) MEy (GeV) METPhi (rad) Lumi Section With HF Barrel+Endcap Only Number of events met with/withtou HF seem to suffer from hot tower(s)

November 4, 2008DQM Meeting20 Run cont’d  Data certification outputs Bad Run

November 4, 2008DQM Meeting21 Run MEx (GeV) MEy (GeV) METPhi (rad) Lumi Section With HF Barrel+Endcap Only Number of events No major problem.

November 4, 2008DQM Meeting22 Run cont’d  Data certification outputs

November 4, 2008DQM Meeting23 Summary from MET DQM Plot Scanning

November 4, 2008DQM Meeting24 Summary  Data certification results from the current rather crude algorithm are already interesting!  Need to run updated version of JetMET DQM code This has additional histograms needed for DC Need to wait until CMSSW_2_2_X  Move Data Certification into the “harvesting step” Results will be written to DQM root file…  Need to designate area for reference histograms Used to determine Data Quality flags  Continue algorithm development on DQM output Need easy access to DQM root files…

November 4, 2008DQM Meeting25 Backups

November 4, 2008DQM Meeting26 Physics Analysis  People doing an analysis using jets will initially restrict themselves to the central (barrel) well understood region and require a minimum set of working detector components….  Example query to construct dataset: RunStart, RunStop HB, EB JetMET_Jet_ICone_Barrel Trigger, Tracker, Luminosity  Quality flags should have the required granularity