ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT-2008-001)

Slides:



Advertisements
Similar presentations
31/03/00 CMS(UK)Glenn Patrick What is the CMS(UK) Data Model? Assume that CMS software is available at every UK institute connected by some infrastructure.
Advertisements

Resources for the ATLAS Offline Computing Basis for the Estimates ATLAS Distributed Computing Model Cost Estimates Present Status Sharing of Resources.
SLUO LHC Workshop, SLACJuly 16-17, Analysis Model, Resources, and Commissioning J. Cochran, ISU Caveat: for the purpose of estimating the needed.
Trigger Data Formats From CBNT to ESD and/or DPD June 11, 2008 Fabrizio Salvatore, Ricardo Gonçalo, RHUL.
2007/06/22AOD ROOT Access1 AOD ROOt Access my first attempt... Physics and Astronomy University of Victoria British Columbia, Canada LAPP, 22 June 2007.
The Computing Environment. Outline Software Management –CVS –CMT –Tag-Collector –Savannah Data Structures Grid & Local cluster Athena –Projects & Packages.
December Pre-GDB meeting1 CCRC08-1 ATLAS’ plans and intentions Kors Bos NIKHEF, Amsterdam.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
Peter van Gemmeren (ANL): ANL Analysis Jamboree The ATLAS Data Model.
December 17th 2008RAL PPD Computing Christmas Lectures 11 ATLAS Distributed Computing Stephen Burke RAL.
Event Metadata Records as a Testbed for Scalable Data Mining David Malon, Peter van Gemmeren (Argonne National Laboratory) At a data rate of 200 hertz,
Alignment Strategy for ATLAS: Detector Description and Database Issues
LHC computing HEP 101 Lecture #8 ayana arce. Outline Major computing systems for LHC experiments: –(ATLAS) Data Reduction –(ATLAS) Data Production –(ATLAS)
Ian Ross Rose-Hulman Institute of Technology Mentor: Dr. Richard Teuscher University of Toronto ATLAS Group ATLAS Calorimeter: Cosmic Ray Commissioning.
C.ClémentTile commissioning meeting – From susy group talk of last Wednesday  Simulation and digitization is done in version (8) 
Event Data Model in ATLAS Edward Moyse (CERN) On behalf of the ATLAS collaboration CHEP 2004, Interlaken.
Event Data History David Adams BNL Atlas Software Week December 2001.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
ATLAS Data Challenges US ATLAS Physics & Computing ANL October 30th 2001 Gilbert Poulard CERN EP-ATC.
DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.
Full Dress Rehearsal (FDR1) studies Sarah Allwood-Spiers 11/3/2008.
Vertex finding and B-Tagging for the ATLAS Inner Detector A.H. Wildauer Universität Innsbruck CERN ATLAS Computing Group on behalf of the ATLAS collaboration.
Argonne Jamboree January 2010 Esteban Fullana AOD example analysis.
Peter van Gemmeren (ANL): ANL Analysis Jamboree The ATLAS Data Model.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
A New Tool For Measuring Detector Performance in ATLAS ● Arno Straessner – TU Dresden Matthias Schott – CERN on behalf of the ATLAS Collaboration Computing.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
Kyle Cranmer (BNL)HCP, Isola d’Elba, March 23, The ATLAS Analysis Architecture Kyle Cranmer Brookhaven National Lab.
Update on Diffractive Dijet Production Search Hardeep Bansil University of Birmingham Birmingham ATLAS Weekly Meeting 24/01/2013.
University user perspectives of the ideal computing environment and SLAC’s role Bill Lockman Outline: View of the ideal computing environment ATLAS Computing.
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
CMS Computing Model summary UKI Monthly Operations Meeting Olivier van der Aa.
Performance DPDs and trigger commissioning Preparing input to DPD task force.
How to… (a.k.a. Photon PID and Pizero Analysis) G. David, April 20, 2000 A report on the status and advertisement of the tools
TAGS in the Analysis Model Jack Cranshaw, Argonne National Lab September 10, 2009.
ATLAS Distributed Computing perspectives for Run-2 Simone Campana CERN-IT/SDC on behalf of ADC.
Trigger Input to First-Year Analysis Model Working Group And some soul searching… Trigger Open Meeting – 29 July 2009.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Victoria, Sept WLCG Collaboration Workshop1 ATLAS Dress Rehersals Kors Bos NIKHEF, Amsterdam.
L1Calo EM Efficiencies Hardeep Bansil University of Birmingham L1Calo Joint Meeting, Stockholm 29/06/2011.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ACOS Report ATLAS Software Workshop December 1998 Jürgen Knobloch Slides also on:
Analysis Performance and I/O Optimization Jack Cranshaw, Argonne National Lab October 11, 2011.
Finding Data in ATLAS. May 22, 2009Jack Cranshaw (ANL)2 Starting Point Questions What is the latest reprocessing of cosmics? Are there are any AOD produced.
Валидация TRT DCS CONDITIONS SERVICE Евгений Солдатов, НИЯУ МИФИ “Physics&Computing in ATLAS” – 22/09/2010.
Main parameters of Russian Tier2 for ATLAS (RuTier-2 model) Russia-CERN JWGC meeting A.Minaenko IHEP (Protvino)
LHCb Current Understanding of Italian Tier-n Centres Domenico Galli, Umberto Marconi Roma, January 23, 2001.
Points from DPD task force First meeting last Tuesday (29 th July) – Need to have concrete proposal in 1 month – Still some confusion and nothing very.
Introduction to FCC Software FCC Istanbul 11 March, 2016 Alice Robson (CERN/UNIGE) on behalf of / with thanks to the FCC software group.
WLCG November Plan for shutdown and 2009 data-taking Kors Bos.
Some topics for discussion 31/03/2016 P. Hristov 1.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
3rd April Richard Hawkings Analysis models in the top physics group  A few remarks …  What people are doing now  Where we are going - Top reconstruction.
Mar 05 - hvdsOffline / HLT1  Athena SW Infrastructure  programming + applying tools wrt. dependencies between packages  developing + testing extra ideas.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
Skimming in Zztop Ricardo – SLT meeting.
AOD example analysis Argonne Jamboree January 2010
Atlas IO improvements and Future prospects
ALICE analysis preservation
Overview: high-energy computing
European Organization for Nuclear Research
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Format d'analyse des donnees Physique ATLAS France Sept-07 S
Parts of an Academic Paper
Cadet Lieutenant Amanda Fort USMA Class of 2009 From Stratham, NH
An introduction to the ATLAS Computing Model Alessandro De Salvo
PPR: Purpose, Timeline PPR = “Physics Performance Report”
Linear Collider Simulation Tools
ATLAS DC2 & Continuous production
Presentation transcript:

ATLAS Analysis Model

Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT ) describing the analysis model needed. This report draws some guidelines on the way analysis should be done in Atlas. Although some of the things might not go as planned, I think it is very helpful to see what is the idea behind all the tools. Comments during this lecture are very welcome, since this is an evolving subject Heavy Ion needs were not addressed in this report. Their need are much different from the proton collision needs.

EDM This paragraph emphasizes the need for event data model:

Data Structure RDO - Raw Data Object –Content - full information of the detector response. –Size – should be ~2MB/evt ESD - Event Summary Data –Content - The detailed output of the detector reconstruction. –Derivation – from RDO. –Purpose - should have sufficient information for particle identification and track re-fitting. –Size - should be ~500 kB/evt for real data. The current data size is ~20% larger. –Format – pool file AOD - Analysis Object Data – –Content - summary of all the reconstructed objects. –Derivation – from ESD –Purpose - provide sufficient information for common analyses. –Size - should be ~100kB/evt for real data, however it is now ~200kB/evt where most of the data is trigger information. MC truth should take ~60kB/evt, so the truth information in the AOD is not full (reduction according to ATL-SOFT-INT ). –Format – pool file

Data Structure DPD (Derived Physics Data) – –D 1 PD (primary DPD) Content – different content for different communities, defined by the relevant community. Derivation - from AOD (sometimes from ESD) Size – should be small enough to copy them to Tier-3 or off-grid disks. ~10kB/evt Format – pool file –D 2 PD (secondary DPD) Content – specific for a certain analysis (defined by the relevant group). Derived information can be added Derivation – from D 1 PD and AOD Format – pool file –D 3 PD (tertiary DPD) Content – should contain all the information need to produce the final plots for publication Format – hbook/ntuple/pool file/other Tags –Content – predefined fields for quick event identification –Size – should be ~1kB/evt –Format – database or ROOT files

Terms Skimming – Removal of events Thinning – Removal of containers Slimming – Removal of object from a container

Computing Model BS DAQ + Trigger RDO Reconstruction TAGs ESD AOD Reconstruction AOD TAGs AOD Common Analysis DPD Latex

Computing Model

Frameworks Athena – analysis inside Athena. The analysis is done by writing algorithms and tools using all the Athena framework Intermediate framework (“event view”) – collection of common tools to create DPDs. ARA – provides c++ and python code to convert persistent data into transient data. It does not include the Athena services, so analyses that need database services (like geometry) can’t be done in ARA (for example analyses that involve calorimeter cells and the full information of vertices and tracking)

Recommendations in the report Official analyses must be done using validated tools only! So work with Athena tools as much as you can. And add your private tools to Athena Many recommendations were made. For completeness I copied all of them to here, but I will talk only on few of them.

Recommendations in the report Storage format of DPDs Only D 3 PD can be ntuple Use official tools for analysis. Put your tools in public place

Recommendations in the report Distribution of and access to D n PDs ARA CINT is not recommended Python – two times faster than CINT Compiled C++ - two times faster than python

Recommendations in the report Code distribution and software infrastructure Event Data Model

Recommendations in the report EDM Back on the envelope calculation: reading time of 1M events~15min only for reading the info. Ntuples are ten times faster than that

Recommendations in the report Primary DPD content Priorities and coordination of Primary DPD production

Recommendations in the report Primary DPD production

Recommendations in the report Toolkits or analysis frameworks For my understanding that means that you cannot build primary DPDs with eventView – but I’m not sure I understand it correctly

Recommendations in the report –EventView