“How do I analyze the data?” -- everyone who’s ever analyzed data “How do I access the data?” Analysis Framework.

Slides:



Advertisements
Similar presentations
31/03/00 CMS(UK)Glenn Patrick What is the CMS(UK) Data Model? Assume that CMS software is available at every UK institute connected by some infrastructure.
Advertisements

Brown Bag #2 Advanced C++. Topics  Templates  Standard Template Library (STL)  Pointers and Smart Pointers  Exceptions  Lambda Expressions  Tips.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
27 Oct. 2000TGC Simulation video meeting1 Trigger Simulation Hisaya Kurashige KOBE Univ.
20 Feb LVL1 muon trigger simulation meeting1 the OO codes for endcap muon trigger simulation Hisaya Kurashige KOBE Univ.
MINERvA DAQ Software D. Casper University of California, Irvine.
COMP 171 Data Structures and Algorithms Tutorial 1 Template and STL.
Elliott Wolin CLAS12 Software Workshop U of Richmond 25-May-2010.
CSC DQA and Commissioning Summary  We are responsible for the online and offline DQA for the CSC system, a US ATLAS responsibility  We are ready for.
Chapter 22 Systems Design, Implementation, and Operation Copyright © 2012 Pearson Education, Inc. publishing as Prentice Hall 22-1.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
The JANA Calibrations and Conditions Database API March 23, 2009 David Lawrence JLab 3/23/091JANA Calibration API David Lawrence -- JLab.
LIGO-G E ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech Argonne, May 10, 2004.
Thomas Jefferson National Accelerator Facility (JLab) 6/16/09Multi-threaded event processing with JANA -- David Lawrence 1 6 GeV electron accelerator user.
Software Overview David Lawrence, JLab Oct. 26, 2007 David Lawrence, JLab Oct. 26, 2007.
SVX Software Overview Sasha Lebedev VTX meeting 09/07/ SVX Software web page:
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Online Data Challenges David Lawrence, JLab Feb. 20, /20/14Online Data Challenges.
The GlueX Collaboration Meeting October 4-6, 2012 Jefferson Lab Curtis Meyer.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
GlueX Software Status April 28, 2006 David Lawrence, JLab.
STAR Analysis Meeting, BNL, Dec 2004 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software and calibration L3 display 200 GeV February.
Event Data History David Adams BNL Atlas Software Week December 2001.
9 February 2000CHEP2000 Paper 3681 CDF Data Handling: Resource Management and Tests E.Buckley-Geer, S.Lammel, F.Ratnikov, T.Watts Hardware and Resources.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
Calibration API in JANA David Lawrence, Jlab July 17, 2007.
R.T. Jones, Newport News, May The GlueX Simulation Framework GEANT4 Tutorial Workshop Newport News, May 22-26, 2006 R.T. Jones, UConn Monte Carlo.
DANA uses a factory model to deliver data “just in time”
1 Software for the KEK test Malcolm Ellis 13 th April 2005.
AMS Tracker Data Reduction Status Claude Zurbach Laboratoire de Physique Théorique et Astroparticules – Montpellier Houston, AMS-TIM, January 08, 2007.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
1 N. BrunerUniv. of New Mexico MuTr Software  Online  Calibration  Offline.
Software plenary, 16 February 2000 David Rousseau (LAL, Orsay) ID reconstruction plans ztrack reconstruction is well understood zseveral packages (2 C++)
“How do I analyze the data?” -- everyone who’s ever analyzed data “How do I access the data?” Analysis Framework.
Template is a declaration (similar to class declaration), which deals with generic types. Templates are evaluated to produce concrete classes when a template-base.
9/12/99R. Moore1 Level 2 Trigger Software Interface R. Moore, Michigan State University.
Predrag Buncic Future IT challenges for ALICE Technical Workshop November 6, 2015.
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
The JANA Reconstruction Framework David Lawrence - JLab May 25, /25/101JANA - Lawrence - CLAS12 Software Workshop.
Monitoring Update David Lawrence, JLab Feb. 20, /20/14Online Monitoring Update -- David Lawrence1.
Introduction The STL is a complex piece of software engineering that uses some of C++'s most sophisticated features STL provides an incredible amount.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
25th Nov, 1999 LHCb Event Data Model Pavel Binko, LHCb / CERN 1 LHCb Software Week LHCb Event Data Model Pavel Binko LHCb / CERN.
Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.
Mac MestayerFeb. 24, 2008CLAS OTWG: Status Report Members: me, Franz Klein, Dennis Weygand Projects: –improve tracking work of Henry Juengst, with Dennis.
Hall–D Level-1 Trigger Commissioning Part II A.Somov, H.Dong Jefferson Lab 12 GeV Trigger Workshop, July 8, 2010  Play Back Test Vector in Hall-D commissioning.
Big picture: What’re the sub-topics of the software framework? What’s the relationship of them? How to arrange data pipe? 1.
Calibration algorithm and detector monitoring - TPC Marian Ivanov.
BES III Software: Beta Release Plan Weidong Li 19 th October 2005.
October 19, 2010 David Lawrence JLab Oct. 19, 20101RootSpy -- CHEP10, Taipei -- David Lawrence, JLab Parallel Session 18: Software Engineering, Data Stores,
Outline: - Building the reconstruction software template - Data flow example - What’s next? - Example “results” PHENIX Upgrade Detectors: Reconstruction.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
David Lawrence JLab May 11, /11/101Reconstruction Framework -- GlueX Collab. meeting -- D. Lawrence.
DANA David Lawrence Oct. 21, D. Lawrence, JLab GlueX Software Workshop Oct Outline Requirements Philosophy Overview of Features Open Questions.
Pi of the Sky off-line experiment with GLORIA Ariel Majcher National Centre for Nuclear Research Warsaw, Poland 10th INTEGRAL/BART Workshop, April.
Hall-D Software Status September 10, 2004 D. Lawrence JLab.
The DANA Analysis Framework David Lawrence Jlab Jan. 19,
Online Software Status
Data Quality Monitoring of the CMS Silicon Strip Tracker Detector
Workflow materials models: template 1
CMS Pixel Data Quality Monitoring
OO-Design in PHENIX PHENIX, a BIG Collaboration A Liberal Data Model
Project name and logo Workflow materials models: template 1
CMS Pixel Data Quality Monitoring
Statistical Process Control
Lattice Motivation: Maintaining relationships between elements of two
Zhangxy Zhangxm Huangxt Dec 17 ,2003
BES III Software: Short-term Plan ( )
Statistical Process Control
Presentation transcript:

“How do I analyze the data?” -- everyone who’s ever analyzed data “How do I access the data?” Analysis Framework

Analysis Framework Defines how packages: Access data needed for input Publish data for output Read in and write out events Access calibration constants (database) Event Level Run Level

Analysis Framework Raw Data (crate, slot, channel, value) FCAL Hits (row, col, E id,t) Clusters (x, y, E, t)

DEventLoopDEvent DEventProcessor (called every event) DFactory (data on demand) C++: Object Oriented Framework keeps track of run number and calls “brun” routinesAll Analysis Software is Implemented in DFactory Objects

Data Access and Storage in DANA Use STL vector STL=Standard Template Library vector = “smart” array Use const pointers Factories delivery read-only data eliminating cross-factory data corruption Use templates Provides type safety removing need to “cast” pointers which can lead to difficult errors.

Important Goal: The analysis framework should be designed to provide a very shallow learning curve for new users. One should NOT need to be a C++ expert to analyze Hall-D data!

A Real Life Example: vector cdchits; eventLoop->Get(cdchits); for(int i=0; i<cdchits.size(); i++){ float x = cdchits[i].x; float y = cdchits[i].y; }

BMS: Build Management System

Summary

Other Active, General Use Software Projects Package Management Online (CMsg) 3D Event Viewer UPV simulation Tracking FCal Reconstruction Ed Brash Elliott Wolin Matt Bellis Alexander Ostrovidov David Lawrence Craig Bookwalter