Introduction to CMSSW Framework Concepts Simulation & Reconstruction Liz Sexton-Kennedy January 10, 2008.

Slides:



Advertisements
Similar presentations
GCT Software ESR - 10th May 2006 Jim Brooke. Jim Brooke, 10 th May 2006 HAL/CAEN Overview GCT Driver GCT GUI Trigger Supervisor Config DB Test scripts.
Advertisements

Use of G EANT 4 in CMS AIHENP’99 Crete, April 1999 Véronique Lefébure CERN EP/CMC.
March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Upgrading the CMS simulation and reconstruction David J Lange LLNL April CHEP 2015D. Lange.
Types of Data SimTracks: generated particles SimHits: energy depositions in a detector volume Digis: Single-channel pieces of the detector’s raw binary.
CMSSW Tutorial. Event processing: Event generation (in MC world)Event generation (in MC world) DigitizationDigitization Local reconstructionLocal reconstruction.
Reconstruction and Analysis on Demand: A Success Story Christopher D. Jones Cornell University, USA.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Usage of the Python Programming Language in the CMS Experiment Rick Wilkinson (Caltech), Benedikt Hegner (CERN) On behalf of CMS Offline & Computing 1.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL), Benedikt Hegner (CERN) 14 January
Lucia Silvestris, INFN Bari and CERN/CMC Status Report on CPT Project 23 March 2001, CERN Meeting del Consorzio INFN Status Reports on CPT Project, on.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL) 18 March 2015 Code Contributors: Michele De Gruttola, Benedikt Hegner, Clément.
FULL CHAIN SIMULATION of CMS DETECTOR Ijaz Ahmed National centre for Physics, Islamabad.
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
ROOT An object oriented HEP analysis framework.. Computing in Physics Physics = experimental science =>Experiments (e.g. at CERN) Planning phase Physics.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Introduzione al Software di CMS N. Amapane. Nicola AmapaneTorino, Aprile Outline CMS Software projects The framework: overview Finding more.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
Storage Manager Overview L3 Review of SM Software, 28 Oct Storage Manager Functions Event data Filter Farm StorageManager DQM data Event data DQM.
LC Software Workshop, May 2009, CERN P. Mato /CERN.
Readiness of CMS Simulation towards LHC Startup Outline  Introduction  Framework and Interface with GEANT4  Detector specific components  How have.
Alignment Strategy for ATLAS: Detector Description and Database Issues
Offline Coordinators  CMSSW_7_1_0 release: 17 June 2014  Usage:  Generation and Simulation samples for run 2 startup  Limited digitization and reconstruction.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Gnam Monitoring Overview M. Della Pietra, D. della Volpe (Napoli), A. Di Girolamo (Roma1), R. Ferrari, G. Gaudio, W. Vandelli (Pavia) D. Salvatore, P.
CHEP06, Mumbai-India, Feb 2006V. Daniel Elvira 1 The CMS Simulation Validation Suite V. Daniel Elvira (Fermilab) for the CMS Collaboration.
24/06/03 ATLAS WeekAlexandre Solodkov1 Status of TileCal software.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
1 Software for the KEK test Malcolm Ellis 13 th April 2005.
ATLAS Data Challenges US ATLAS Physics & Computing ANL October 30th 2001 Gilbert Poulard CERN EP-ATC.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Status of the LAr OO Reconstruction Srini Rajagopalan ATLAS Larg Week December 7, 1999.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
John MarshallPandora Development1 J.S. Marshall University of Cambridge.
Krzysztof Genser/Fermilab For the Fermilab Geant4 Performance Team.
DD4hep-Based Simulation Nikiforos Nikiforou CERN/PH-LCD ILD Meeting 2014 Oshu City, September 9 th, 2014.
Software for the CMS Cosmic Challenge Giacomo BRUNO UCL, Louvain-la-Neuve, Belgium On behalf of the CMS Collaboration CHEP06, Mumbay, India February 16,
Vincenzo Innocente, CERN/EPUser Collections1 Grid Scenarios in CMS Vincenzo Innocente CERN/EP Simulation, Reconstruction and Analysis scenarios.
GlueX Computing GlueX Collaboration Meeting – JLab Edward Brash – University of Regina December 11 th -13th, 2003.
04/09/2007 Reconstruction of LHC events at CMS Tommaso Boccali - INFN Pisa Shahram Rahatlou - Roma University Lucia Silvestris - INFN Bari On behalf of.
CERN Tutorial, September Overview of LHCb applications and software environment.
Software Week - 8/12/98G. Poulard - CERN EP/ATC1 Status of Software for Physics TDR Atlas Software Week 8 December 1998 G. Poulard.
CPT Week, November , 2002 Lassi A. Tuura, Northeastern University Core Framework Infrastructure Lassi A. Tuura Northeastern.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
USCMS May 2002Jim Branson 1 Physics in US CMS US CMS Annual Collaboration Meeting May 2002 FSU Jin Branson.
1 A (very) preliminary study of channel pp->h->ZZ->4mu via gg fusion with CMSSW Alessandro Giacobbe Cristina Botta Daniele Trocino Relatrice: Chiara Mariotti.
Introduction to FCC Software FCC Istanbul 11 March, 2016 Alice Robson (CERN/UNIGE) on behalf of / with thanks to the FCC software group.
VI/ CERN Dec 4 CMS Software Architecture vs Hybrid Store Vincenzo Innocente CMS Week CERN, Dec
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Current Status of the Tracking Trigger Software Andrew W. Rose.
TOTEM Collaboration Meeting 13/12/06 Fabrizio Ferro-INFN-Ge 1 T1 SW status.
1 HcalAlCaRecoProducers : Producer for HO calibration Outer hadron calorimeter is expected to improve jet energy resolution Due to different sampling/passive.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
CMS High Level Trigger Configuration Management
Migration of reconstruction and analysis software to C++
ALICE analysis preservation
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Commissioning of the ALICE HLT, TPC and PHOS systems
US ATLAS Physics & Computing
ATLAS DC2 & Continuous production
Presentation transcript:

Introduction to CMSSW Framework Concepts Simulation & Reconstruction Liz Sexton-Kennedy January 10, 2008

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Introduction CMS is now on it’s second generation of offline software. Use of the first generation software systems is long gone now, but much of the work that went into these projects (ORCA, OSCAR, COBRA, IGUANA) was reused by “porting” it to CMSSW. CMSSW is the full suite of offline software in the new architecture. Code for online data taking, Simulation, Primary reconstruction, and Physics analysis.

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Introduction CMSSW is now a large software system:

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Code Organization The thousand (or so) packages that make up the project are organized into sub-systems with names that should be suggestive of their purpose:

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Glossary T(more/less)LA's CMSSW = Compact Muon Solenoid SoftWare EDM = Event Data Model FW = Application Framework AOD = Analysis Object Dataset TDR = Technical Design Report DAQ = Data Acquisition FED = Front End Digitizer HLT = High Level Trigger PAT = Physics Analysis Toolkit – software effort PADA = Processing and Data Access – computing effort CVS = Code Versioning System – also called the code repository CmsTC = CMS Tag Collector – integration tool

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, FW Architecture - Plugins Applications in CMSSW are built from special shared object libraries called plugins. In practice this means that there is only one command you need to know to run most CMS applications: cmsRun Configurations are currently written in a specialized invented language, but we are in the process of moving to the python language. 2_0_X and earlier use the first, 2_1_X and later will use python. There are two types of plugins:  Module Plugins – EDProducers, EDFilters, EDAnalyzers, (EDLoopers, etc.) and ESSources, ESProducers. These are the worker components of the FW. ED* process event data, ES* process event setup data.  Data Object Plugins – also known as “root dictionaries” because they can also be loaded directly into the root application. These are most of the products of the above work, and form the elements of the EDM.

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Basic Concept of the EDM The data produced in the primary reconstruction farms (Tier 0 = CERN), or reprocessing farms (Tier 1s) must be immediately useful for analysis (at least once we really understand the detector). We have designed the system so that the same pool/root data file can be used in three contexts:  Bare root.exe – treat pool file as a root input file, allows browsing of simple objects (floats, ints, and composites of them) from the root TBrowser GUI.  FWLight – a small set of CMS defined loadable libraries added to root to allow more sophisticated use with root macro scripts. For the EDM this is a read-only application.  cmsRun - input for a full framework application, could be used for a reprocessing pass or creation of more refined analysis objects stored into the AOD.

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Basic Concepts of the FW A Software Bus Model  Start from the raw-raw data  Producers are scheduled to operate on the event data and produce their output which is written into the event  At any point in the processing chain, the execution can be halted and the contents of the event can be examined outside of the context of the process that made it  The schedule can be checked for correctness since the modules can declare their inputs (and outputs if they are EDProducers). This allows the FW to automatically track the provenance of what is produced.  Several instances of the same module can be run in the same application and you will still be able to uniquely identify their products. Identified by C++ type, producer label, instance name, process name

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Schematic Picture of Reconstruction A simplified example take from the calorimeter reconstruction:

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, “Where do I plug in ?”  As you can see from the previous slide each blue box must be defined by a reconstruction writer.  The first step is to define what are the input and output objects needed for your algorithmic task.  These need to be defined as C++ classes that follow the EDM rules => define EDProduct classes in some *DataFormat subsystem.  Decide what services your algorithm needs (calibrations, geometry description) from EventSetup  Start from templates or code generators for the 5 types in FWCore/Skeletons/scripts (eg. mkedprod )  Write the EDProducer that receives all of the information and passes it on to the algorithms.

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, More FW Concepts -“EventSetup” The EventSetup is the system which delivers all non-event data to EDProducers and other modules. It’s component are activated on demand rather then scheduled in contrast to the event data components. EventSetup

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Simulation in CMSSW Detector Simulation GenerationDigitization Root data file (HepMC) Root data file (add SimHits) Root data file (add Raw) Reconstruction Particle gun, physics generator (vertices, particles) Particle showers, EM Fields, based on Geant4 (SimHits) Modeling of electronic signal (Digis) Min-Bias Generator Signal SimHits Min-Bias SimHits Signal Generator Event Digis CPU Overlay in-time min-bias events from same collision and out-of-time min-bias events from neighboring collisions Event RawData

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Reconstruction in CMSSW Simulation of Electronics SimHits Signal Event SimHits Pileup Events DIGI’s RecHits, Segments Tracker Calorimeter Muon Det. Trigger 20 interactions/ crossing 25 ns crossing time: faster than detector response – read out (simulate) crossings –5; pileup events per 1 signal event! HCAL Tracks, Jets, Muons, Vertices, MET, Electrons, Photons, b-tags, etc… High-level Reconstruction and Analysis Raw Data Low-level Reconstruction

Liz Sexton-Kennedy Fermilab CMSSW++ June 18, Summary CMSSW is a large scale software system for simulation, data acquisition, triggering, reconstruction and analysis of CMS data. A lot of work has been done over the past 3 years, but there is a lot of work still to do. I expect the code base to be at least 2 to 3 times bigger (CDF for instance is). The work to understand the detector and capture that understanding in the software and databases is still to be done in the continued commissioning of the detector over the next year. Come and join the fun, become a CMSSW developer by attending the rest of the tutorials this week.