DST data structures: Status report M. Moulson, CP working group 25 October 2001.

Slides:



Advertisements
Similar presentations
Status reports/Discussion items S. DellAgnello DC geometry review DC wire sag measurements P. de SimoneDC s-t relations with new sag model S. Miscetti.
Advertisements

Status reports Trigger simulationM. Palutan, B. Sciascia DC GeometryA. Antonelli, S. Dell’Agnello DC wire sag measurementS. Dell’Agnello, C. Forti DC s-t.
“L3” Jeff Landgraf. In July, Hank sent me a message asking if I had any talks for this meeting. “No, but I have some issues that could be discussed.”
Michigan State University 4/15/ Simulation for Level 2 James T. Linnemann Michigan State University NIU Triggering Workshop October 17, 1997.
KLOE GM Capri May 2003 K charged status report DE/Dx development vs PiD (next talk by E.De Lucia) →K e3 studies: initial design of efficiency measurement.
Offline Status Report M. Moulson, 20 December 2001 Summary presentation for KLOE General Meeting Outline: Processing of 2001 data History of datarec executable.
Measurement of the absolute BR(K  +  -  + ) : an update Patrizia de Simone KLOE Kaon meeting – 21 May 2009.
Work finished M. Antonelli ISR and f decay simulation M. MoulsonBank-reduction code for DST’s M. Palutan et al.Trigger simulation parameters S. GiovannellaGEANFI.
SVAC/ISOCInstrument Analysis Meeting, April 14, 2006 Anders W. Borgland 1 The LAT In Every Which Way You Want It! Anders W. Borgland Science Verification,
Offline Code for Next Beam Test Jianchun Wang 08/06/01.
GLAST LAT ProjectGLAST Flight Software IDT, October 16, 2001 JJRussell1 October 16, 2001 What’s Covered Activity –Monitoring FSW defines this as activity.
CalRecon Moments Analysis Studies I Tracy Usher1/17 A Brief History of Glast Release GR (Friday, July 15) –Effectively, the first DC-2 2M all-gamma.
Notes on offline data handling M. Moulson Frascati, 29 March 2006.
Status of Onboard Filter & Ground Software Integration Work done by Navid Golpayegani Steve Ritz J.J. Russell David Wren SLAC Ground Software Workshop:
KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.
Simulations Progress at Regina ➔ Event generation with genr8 – output in ascii format ➔ Conversion to either HDFast input (stdhep) or HDGeant input (hddm)
Offline Discussion M. Moulson 22 October 2004 Datarec status Reprocessing plans MC status MC development plans Linux Operational issues Priorities AFS/disk.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: “DOM MB to Event Builder”
Realistic, large-scale MC production M. Moulson, 20 December 2002 Summary presentation for KLOE General Meeting Outline: Production proposal Refinements.
Status reports M. Antonelli ISR and f decay simulation S. Dell’AgnelloDC geometry review P. de SimoneDC s-t relations with new sag model A. AntonelliDC.
MC/Offline Planning M. Moulson Frascati, 21 March 2005 MC status Reconstruction coverage and data quality Running time estimates MC & reprocessing production.
Offline/MC status report M. Moulson 6th KLOE Physics Workshop Sabaudia, May 2006.
KLOE Computing Update Paolo Santangelo INFN LNF KLOE General Meeting University of Rome 2, Tor Vergata 2002, December
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
Progress on BR(K L  p + p - ) using a double-tag method A. Antonelli, M. Antonelli, M. Dreucci, M. Moulson CP working group meeting, 25 Feb 2003.
Monitoring of background events in 2010 run Giuseppe Zito 06/11/2015 PFG/MIG Topical meeting on beam background.
E. De LuciaNeutral and Charged Kaon Meeting – 7 May 2007 Updates on BR(K +  π + π 0 ) E. De Lucia.
DST status Ready for production Analysis of sample ksl DST’s in progress for ~1 week ksl DST event size: 2.8 MB/nb GB for 200 pb -1 Other streams.
K  group activities K + K - retracking features New vs Old : resolution future planning. Conclusion and outlook K + K - retracking features New vs Old.
V.Patera – KLOE GM – Otranto – 10 June 2002 K  reconstruction status K + K - retracking features New vs Old : resolution New vs Old : efficiencies Conclusion.
Update on MC-04(05) –New interaction region –Attenuation lengths vs endcap module numbers –Regeneration and nuclear interaction –EMC time resolution –
Status of the KLOE experiment M. Moulson, for the KLOE collaboration LNF Scientific Committee 23 May 2002 Data taking in 2001 and 2002 Hardware and startup.
The KLOE computing environment Nuclear Science Symposium Portland, Oregon, USA 20 October 2003 M. Moulson – INFN/Frascati for the KLOE Collaboration.
Dead or alive ??!! … Erika & Patrizia …. … this story begins when … … we were trying to produce the KMP dst’s for 2004 data … reproduce the List oh the.
Status of OPAL data Matthias Schröder
Offline meeting  Status of MC/Datarec  Priorities for the future LNF, Sep
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
1 L.Didenko Joint ALICE/STAR meeting HPSS and Production Management 9 April, 2000.
Technical Validation The Technical Validation is a testing framework of the AUGER offline to monitor the code development process. It is not a validation.
Offline Status Report A. Antonelli Summary presentation for KLOE General Meeting Outline: Reprocessing status DST production Data Quality MC production.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Forward Carriage Commissioning CLAS Collaboration Meeting 6/19/2015CLAS12 CalCom Status Update1 ECAL PCAL FTOF Panel 1A FTOF Panel 1B Detector Status PMT.
Work finished M. Antonelli ISR and f decay simulation M. MoulsonBank-reduction code for DST’s.
David Stickland CMS Core Software and Computing
Offline Status Review M. Moulson, P. Valente, for the Offline Group 16 March 2001 Outline: Status update FILFO: new developments (G. Finocchiaro) Questions.
Offline resource allocation M. Moulson, 11 February 2003 Discussion Outline: Currently mounted disk space Allocation of new disk space CPU resources.
Overview of PHENIX Muon Tracker Data Analysis PHENIX Muon Tracker Muon Tracker Software Muon Tracker Database Muon Event Display Performance Muon Reconstruction.
Tuning of trigger simulation parameters (Bossi, Moulson, Palutan, Sciascia) Calorimeter trigger thresholds calibration using prompt photons from K S 
P latform stability and track-fit problems M. Moulson, T. Spadaro, P. Valente Tracking Meeting, 18 Jul 2001.
An Example of {AND, OR, Given that} Using a Normal Distribution By Henry Mesa.
Status report on analysis of BR(K S  p + p - p 0 ) A. Antonelli, M. Moulson, Second KLOE Physics Workshop, Otranto, June 2002.
1 Reminder: Why reprocess? data Reconstruction: DBV DSTs: DBV data DBV-19 for reconstruction & DSTs, Run < DBV-20 for.
Comments on #3: “Motivation for Regional Analysis Centers and Use Cases” Chip Brock 3/13/2.
KLOE general meeting December 2002 Tor Vergata K charged status report DST production status New analysis items:  K + K - cross section/  line.
M. Martemianov, ITEP, October 2003 Analysis of ratio BR(K     0 )/BR(K    ) M. Martemianov V. Kulikov Motivation Selection and cuts Trigger efficiency.
Agenda: Status, progress reports and the overall schedule –L3: Status –L3 control code delivered 10 events to the working nodes L3 Filter modules –Leave.
Status Report on Data Reconstruction May 2002 C.Bloise Results of the study of the reconstructed events in year 2001 Data Reprocessing in Y2002 DST production.
Status of the measurement of K L lifetime - Data sample (old): ~ 440 pb -1 ( ) - MC sample: ~125 pb -1 ( mk0 stream ) Selection: standard tag (|
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
MC/OFFLINE meeting  Status  Request by Ke2 group  aob LNF
Update on the false-dead DC wire problem
Developments of the PWG3 muon analysis code
Loops BIS1523 – Lecture 10.
Migration of reconstruction and analysis software to C++
SCT readout limitation estimate with data
MC ’04-’05 objectives                                                       
Large scale MC production II
Offline Report Outline: Status update DST Proposal P. de Simone
KLOE General Meeting - LNF March,
SNoW & FEX Libraries; Document Classification
Presentation transcript:

DST data structures: Status report M. Moulson, CP working group 25 October 2001

DST proposal Compressed YBOS format Produced from datarec output kpm, ksl, rpi, rad One output DST per run and stream Exception: rad stream (charged and neutral DST’s) Subset of banks and event tags Raw banks to be dropped after initial period of debugging

Task list Banks and data structures TriggerPalutan, Patera, Bossi, Moulson CalorimeterMiscetti TrackingMoulson Scripting, DB, recall spaceBloise, Sfiligoi Verification w/ analysis groups Moulson, Valente, all analysis groups

Bank list and data structures LRID, EVCLEvent headers T0GLGlobal t 0 TDSTTrigger summaryEssential info from TPIE, TMON, TCAF CTRGSector-to-cluster CSPSCalorimeter hitsReplaces CELE, CWRK CPLS, CLLSCalorimeter clustersCLUO exists but not significantly advantageous QCAE, QWRKQCAL hits DCNHDC hit counts DTFSFitted tracksBanks shortened; hit lists dropped DVFSFitted vertices TCLOTrack-to-cluster ECLS, ECLOEvent classification KNVO, VNVO, INVONeutral vertices

Data structure related tasks I dentify banks to drop Write A/C module to: Create new summary banks if needed Modify existing banks if needed Write transparent PROD2NTU subroutine: Read new (DST) or old (normal YBOS) banks indifferently Fill as many Ntuple variables as possible if only DST banks exist Communicate changes to A/C path for DST production

Tracking banks Banks dropped: DTCE, DHRE, DPRS, DHSP, DCHD New banks: DCNH– total hits in DC Total hits, hits used by PR, TF Big and small cells Banks modified: DTFS– hit lists deleted Status: A/C module and PROD2NTU code done, in library

Trigger banks Banks dropped TPIE, TMON, TCAF– replaced by TDST TELE, PZZA– replaced by CTRG MOKA– emulation not needed for DST New bank: TDST B/E/W multiplicities for LET and Cosmic series TDC’s for T1C, T1D, T2D, injection, and fiducial Number of T2 hits from CAFFE Status: A/C module and PROD2NTU code done, in library

Example UIC for ksl DST’s use eclsfilt emcdbini clurec clufixene t0_find clufixtim clu2trig track_dst trig_dst talk eclsfilt sel kltag yes klcrash yes intertag yes ksneut yes ksemil yes klppp yes kl3p0 yes ret ret filter eclsfilt on output select events/filter=eclsfilt output select drop **** output select kept LRIDEVCLT0GLTDSTCTRGCSPSCPLSCLLSQCAEQWRKDCNH DTFSDVFSTCLOECLSECLOKNVOVNVOINVO output zip 5

Results KB/Input EvtStage ksl events, Run 19059, no compression 4.4 Bank list adjusted 2.6 Compressed (zip level 5) 0.72 KSTAG rejected (364 events) DST volume estimate for 200 pb -1 : 2001 average ksl occupancy: 2.5M Evt/pb pb -1 × 2.5M Evt/pb -1 × 0.72 KB/Evt = 360 MB Volume estimate doubles if raw banks retained