28.08.2018 Using the e/gamma D3PD An end user view.

Slides:



Advertisements
Similar presentations
Submitting jobs to the grid Argonne Jamboree January 2010 R. Yoshida Esteban Fullana.
Advertisements

Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
Israel Cluster Structure. Outline The local cluster Local analysis on the cluster –Program location –Storage –Interactive analysis & batch analysis –PBS.
Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
Linux Operations and Administration
ATLAS Analysis Overview Eric Torrence University of Oregon/CERN 10 February 2010 Atlas Offline Software Tutorial.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
Nurcan Ozturk University of Texas at Arlington Grid User Training for Local Community TUBITAK ULAKBIM, Ankara, Turkey April 5 - 9, 2010 Overview of ATLAS.
*** CONFIDENTIAL *** © Toshiba Corporation 2008 Confidential Creating Report Templates.
INTRODUCTION. What is HTML? HTML is a language for describing web pages. HTML stands for Hyper Text Markup Language HTML is not a programming language,
Git workflow and basic commands By: Anuj Sharma. Why git? Git is a distributed revision control system with an emphasis on speed, data integrity, and.
Distribution After Release Tool Natalia Ratnikova.
Copyrighted material John Tullis 10/17/2015 page 1 04/15/00 XML Part 3 John Tullis DePaul Instructor
30 Jan 2009Elizabeth Gallas1 Introduction to TAGs Elizabeth Gallas Oxford ATLAS-UK Distributed Computing Tutorial January 2009.
RTÉ e-commissioning A Guide to Submitting a Proposal.
Submitting jobs to the grid Argonne Jamboree January 2010 R. Yoshida (revised March 2010) Esteban Fullana.
Full Dress Rehearsal (FDR1) studies Sarah Allwood-Spiers 11/3/2008.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Nurcan Ozturk University of Texas at Arlington US ATLAS Transparent Distributed Facility Workshop University of North Carolina - March 4, 2008 A Distributed.
Release Validation J. Apostolakis, M. Asai, G. Cosmo, S. Incerti, V. Ivantchenko, D. Wright for Geant4 12 January 2009.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Use Flowchart modeling to design and create an interactive quiz to be run on Powerpoint. Start Question Click to start the quiz Correct Incorrect, try.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
David Adams ATLAS ATLAS Distributed Analysis: Overview David Adams BNL December 8, 2004 Distributed Analysis working group ATLAS software workshop.
David Adams ATLAS ATLAS-ARDA strategy and priorities David Adams BNL October 21, 2004 ARDA Workshop.
TAGS in the Analysis Model Jack Cranshaw, Argonne National Lab September 10, 2009.
Creating a Google Doc A Quick Photo Tutorial. Sign in to Google Docs If you don’t already have an account, sign up for one, it’s FREE.
ELSSISuite Services QIZHI ZHANG Argonne National Laboratory on behalf of the TAG developers group ATLAS Software and Computing Week, 4~8 April, 2011.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
27/02/04 ATLAS weekTileCal Athena tutorial, part 21 TileCal Athena tutorial Part 2: Reading GEANT hits from ZEBRA and POOL Reading HLT and testbeam ByteStream.
Finding Data in ATLAS. May 22, 2009Jack Cranshaw (ANL)2 Starting Point Questions What is the latest reprocessing of cosmics? Are there are any AOD produced.
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
Study of missing Level-1 triggers using data10 Hardeep Bansil University of Birmingham Trigger E/Gamma Signature Group Meeting 20/05/2010.
I/O and Metadata Jack Cranshaw Argonne National Laboratory November 9, ATLAS Core Software TIM.
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
Use the Private link to upload a new file, or to update an existing entry, or to just look-up stuff that only uboone people can see. The Public link will.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
An AOD analysis example Esteban Fullana Torregrosa High Energy Physics Division Argonne National Laboratory.
Introduction to PanDA Client Tools – pathena, prun and others
Advanced HTML Tags:.
AOD example analysis Argonne Jamboree January 2010
bitcurator-access-webtools Quick Start Guide
SM Direct Photons meeting
ALICE analysis preservation
A full demonstration based on a “real” analysis scenario
Taming the protocol zoo
AMI – Status November Solveig Albrand Jerome Fulachier
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
Cadet Lieutenant Amanda Fort USMA Class of 2009 From Stratham, NH
Retrieving information from forms
Introduction of Week 3 Assignment Discussion
ADA aodhisto transformation
MIS JavaScript and API Workshop (Part 2)
Vectors and Matrices In MATLAB a vector can be defined as row vector or as a column vector. A vector of length n can be visualized as matrix of size 1xn.
Getting started with jQuery
ATLAS TAGs: Tools from the ELSSI Suite
bitcurator-access-webtools Quick Start Guide
Introduction to Athena
Python and XML Styling and other issues XML
ADA analysis transformations
Retrieving information from forms
Presentation transcript:

28.08.2018 Using the e/gamma D3PD An end user view

Outline Some useful ATLAS resources 28.08.2018 Outline Some useful ATLAS resources https://twiki.cern.ch/twiki/bin/view/AtlasProtected/D3PDMaker describes the d3pd maker https://twiki.cern.ch/twiki/bin/view/AtlasProtected/D3PD lists available d3pd's https://twiki.cern.ch/twiki/bin/viewauth/Atlas/GoodRunsListsTutorial good run lists use – in particular root usage is listed here https://espace.cern.ch/atlas- egamma/Lists/Runs%20and%20LB/Attachments/4/FinalGoodRun900GeV.xml good run list endorsed by the egamma group (generally no concern for muon items but solenoid/tracking&Calo okay) Stroll through the use and application of the above Some local resources which might be useful are indicated along the way ANL Jamboree 1/19/10

28.08.2018 D3PD making Issue free! the e/gamma d3pd is the only piece of ATLAS software that I know of that for a well distributed release (say 15.6.1) does not start with: first do a “cmt co BlahBlah” on a half dozen packages it simply runs out of the box you don't even need to run it (several options) datasets are available on the grid for the first processing shifts are organized for doing the reprocessed (r988) collision data we have the full reprocessed set of e/gamma D3PD's on disk here (~1/2 GB) look at ~reb/d3pd_analysis/15.6.1/analyze/run_analysis.C this job runs on the local copy and makes some simple histograms applies the egamma goodrun list You can see an example (messier than it needs to be simply because the latest tags for the good run list stuff is included) on: ~reb/d3pd_analysis/15.6.1 even simpler (no special tags) – the run directory has a couple of pathena submission scripts (this was used for first D3PD run shift) ~reb/d3pd_shift/15.6.1 ANL Jamboree 1/19/10

Good Run List See resources in slide two the short story 28.08.2018 Good Run List See resources in slide two the short story need to check out specific tags (in particular probably only the DataQuality/GoodRunsList one is likely needed) cmt co -r GoodRunsListsUser-00-00-08 DataQuality/GoodRunsListsUser cmt co -r GoodRunsLists-00-00-67 DataQuality/GoodRunsLists cmt co -r LumiBlockComps-00-00-78 LumiBlock/LumiBlockComps cmt co -r CoolRunQuery-00-01-89 Database/CoolRunQuery Go to DataQuality/GoodRunsLists/cmt and “make -f Makefile.Standalone” symbolically link the library into your run area GoodRunsListsLib.so -> ../DataQuality/GoodRunsLists/StandAlone/GoodRunsListsLib.so ANL Jamboree 1/19/10

Good Run List (cont.) In your “makeclass” program 28.08.2018 Good Run List (cont.) In your “makeclass” program Root::TGoodRunsList grl; Root::TGoodRunsListReader grlReader; grlReader.SetXMLFile("EGamma_FinalGoodRun900GeV.xml"); grlReader.Interpret(); grl=grlReader.GetMergedGoodRunsList(); grl.Summary(); In the event loop if(grl.HasRunLumiBlock(RunNumber,lbn) ) {... OBJ: Root::TGoodRunsList MyLBCollection notitle --- TGoodRunsList : Version: 2.1 --- TGoodRunsList : Metadata: Query : find run 141000+ and dq lar,pix,sct,trtb,trte y+ and dq til g and dq atlsol g and mag s and LHC stablebeams true andlhc beamenergy 449-451 --- TGoodRunsList : Metadata: RunList : 142383,142195,142193,142191,142189,142174,142171,142166,142165,142154,142149,141811,141749 --- TGoodRunsList : Metadata: SVNVersion : CoolRunQuery-00-01-80 --- TGoodRunsList : Number of runs: 13 ANL Jamboree 1/19/10

28.08.2018 What is in it Triggers appear as individual binary values with trigger name lumiblock (lb), RunNumber ... generally all useful data from the AOD for photons/electrons... see Scott's talk for naming conventions (pretty obvious) https://twiki.cern.ch/twiki/bin/view/Atlas/AODClassSummary15 this “documents” the AOD contents which are generally mirrored in the D3PD these items area all in the “physics” tree and appear as vectors so you can loop through multiple candidates see ~reb/d3pd_analysis/15.6.1/eGamma.[Ch] for an example ANL Jamboree 1/19/10

Example plots loose photon candidates Et>1GeV |η| < 3.5 28.08.2018 Example plots loose photon candidates Et>1GeV |η| < 3.5 not in the 1.5ish range 774446 events total 513870 good run ev. 260576 bad run ev. ANL Jamboree 1/19/10

28.08.2018 Future Jae Yu has taken up the task of soliciting input and continuing this as an official e/gamma resource (has been endorsed by e/gamma CP group) previous shift activity deposited the data in user datasets (these don't have infinite life) so this will change should become part of normal production provided the e/gamma and relevant physics groups agree they are useful ANL Jamboree 1/19/10