Tag based analysis Ziyan DENG

Data Analysis Model Raw data on disk (All, Bhabha, Dimu., Random trigger ……) .raw Raw data on tapes Detector Calibration Index generation Detector Simulation Offline Reconstruction (DST Production) .idx .rtraw, ROOT .dst, ROOT Background Mixing (with random trigger events) Physics Skimming(nprong, DTag, …) .raw .dst, ROOT database Reconstruction User Analysis .dst, ROOT 2

探测器的击中信息 MDC: EMC: MUC: 单元编号 飞行时间 漂移时间 漂移距离 击中位置 …… 晶体编号 沉积能量 击中位置 击中时间 …… MUC: 击中时间 击中位置 沉积能量 动量，方向 …… 3个1GeV/c的π/μ在探测器里的不同行为

Gaudi Framework Provides standard interfaces for the common components necessary for data processing and analysis ISvcLocator ApplicationMgr IDataProviderSvc IAlgorithm IProperty EventDataSvc Concrete Algorithm IDataProviderSvc DetectorDataSvc IHistogramSvc HistogramSvc Obj_A Obj_B MessageSvc IMessageSvc IParticlePropertySvc ParticlePropertySvc

Gaudi Architecture Object Diagram Converter Algorithm Event Data Service Persistency Data Files Transient Event Store Detec. Data Transient Detector Store Message JobOptions Particle Prop. Other Services Histogram Transient Histogram Store Application Manager

Set properties, add converters RootCnvSvc Set properties, add converters RootEvtSelector Get next event ID RootAddress Root Tree names, branch names, and EntryNr RootInterface Open ROOT file, reading/writing tree RootEventBaseCnv TObjectToDataObject, DataObjectToTObject RootCnvSvc Digi/ Mc/ MdcTrackCnv MdcKalTrackCnv Rec/ MdcDedxCnv Dst/ TofTrackCnv EvtRec/ EmcTrackCnv …… ……

Current data processing Data production job: Recon. Algs file1.raw file1.dst Physics analysis job: RhopiAlg Analyzing full dst files (1) file1.dst, … ntuple data skim job file1.dst file1_skim.dst Analyzing skimmed dst Or (2) Physics analysis job: RhopiAlg file1_skim.dst, … ntuple

Tag based analysis TAG DST TagWriterAlg Input for analysis Size of TAG file is ~1/700 of DST file DST file directory/name event 0 entry runId eventId Total_charged event 1 ... … event 2 …… event N DST event 0 MdcTrackCol TofTrackCol …… event 1 event 2 event N TagWriterAlg Production job Input for analysis Users set tag selection criteria (“B>=2 && C=1……”) through TagFilterSvc RootCnvSvc: Read each entry in TAG file, and using TagFilterSvc to choose which DST event should read.

Initialize Algorithms OfflineEventLoopMgr::initialize Setup Event Selector Setup Services OfflineEventLoopMgr::getEventRoot RootEvtSelector::next set eventId RootEvtSelector::createAddress RootEventBaseCnv::createObj RootInterface::setBranchAddress OfflineEventLoopMgr::nextEvent RootAddress:setEntryNr(eventId) Event loop RootInterface::getBranchEntry RootEventBaseCnv::TObjectToDataObject OfflineEventLoopMgr::executeEvent Algorithms::execute Finalize Algorithms OfflineEventLoopMgr::finalize Release Event Selector Release Services

RootInterface::currentFileName New file ? Old file ? Read new tag file Get next entry of tag file Return eventId Get the first entry of tag file The end of tag file? no yes RootInterface::setEOF Return eventId The end of input file list? yes no No more input New file

Performance test All (analyzing full dst files) 3 dst files as input Skim (analyzing skimmed dst files) Skim events with totalCharged=2 from full dst files Tag (tag based analysis) Only read events with totalCharged=2 through tag all skim tag CPU time (test 1) 402 s 170 s 177 s CPU time (test 2) 377 s 270 s CPU time of tag based analysis is similar with directly analyzing skimmed DST files, much less than analyzing full DST files. Tag based analysis can get exactly the same result as analyzing skimmed DST files

Tag based analysis jobOptions #include "$ROOTIOROOT/share/jobOptions_ReadRec.txt" #include "$VERTEXFITROOT/share/jobOptions_VertexDbSvc.txt" #include "$MAGNETICFIELDROOT/share/MagneticField.txt" #include "$ABSCORROOT/share/jobOptions_AbsCor.txt" #include "$RHOPIALGROOT/share/jobOptions_Rhopi.txt" TagFilterSvc.tagFiles = { "tag_run_0009947_All_file001_SFO-1.root", "tag_run_0009947_All_file001_SFO-2.root", "tag_run_0009947_All_file002_SFO-1.root" }; TagFilterSvc.Criteria = "[4]==2"; EventCnvSvc.selectFromTag = 1; Input TAG files Pre-selection criteria Turn on tag based analysis

Discussions User interface One TAG file for each DST file, can be produced during or after reconstruction Physics groups or individual users can define the tag files Location of DST file saved in the corresponding TAG file Specify only tag files in analysis job Performance Size of TAG file is ~1/700 of DST file, depending on what saved in TAG CPU time: similar with analyzing skimmed DST files How many users will use this? Pre-selection(2 prong, 4 prong, ……), replace skimmed data

Data processing with TAG Data production job: Recon. Algs + TagWriterAlg file1.raw file1.dst, file1.tag DST and TAG files can be produced together in one job Tag select job: TagWriterAlg file1.tag, file2.tag… file1_s.tag, file2_s.tag… Physics analysis job: RhopiAlg Analyzing dst files with tag file1.dst, file2.dst… ntuple file1_s.tag, file2_s.tag… input output

Data processing with TAG Data production job: Recon. Algs file1.raw file1.dst Tag writer job: TagWriterAlg file1.dst, file2.dst… file1.tag, file2.tag… DST and TAG files can be produced seperately Tag select job: TagWriterAlg file1.tag, file2.tag… file1_s.tag, file2_s.tag… Physics analysis job: RhopiAlg file1.dst, file2.dst… ntuple file1_s.tag, file2_s.tag…

Tag based analysis jobOptions #include "$ROOTIOROOT/share/jobOptions_ReadRec.txt" #include "$VERTEXFITROOT/share/jobOptions_VertexDbSvc.txt" #include "$MAGNETICFIELDROOT/share/MagneticField.txt" #include "$ABSCORROOT/share/jobOptions_AbsCor.txt" #include "$RHOPIALGROOT/share/jobOptions_Rhopi.txt" // Input REC or DST file name EventCnvSvc.digiRootInputFile = { "/besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file001_SFO-1.dst", "/besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file001_SFO-2.dst", "/besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file002_SFO-1.dst" }; EventCnvSvc.tagInputFile = { "sel_tag_run_0009947_All_file001_SFO-1.root", "sel_tag_run_0009947_All_file001_SFO-2.root", "sel_tag_run_0009947_All_file002_SFO-1.root" EventCnvSvc.selectFromTag = 1; // Set output level threshold (2=DEBUG, 3=INFO, 4=WARNING, 5=ERROR, 6=FATAL ) MessageSvc.OutputLevel = 5; // Number of events to be processed (default is 10) ApplicationMgr.EvtMax = -1; ApplicationMgr.HistogramPersistency = "ROOT"; NTupleSvc.Output = { "FILE1 DATAFILE='rhopi.root' OPT='NEW' TYP='ROOT'"}; Input DST files Input TAG files Flag to switch on/off tag based analysis

Performance test: Skim vs Tag All (Analyzing full dst files) Input files of all.txt -rw-r--r-- 1 offline physics 543118149 Aug 7 2013 /besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file001_SFO-1.dst -rw-r--r-- 1 offline physics 540516509 Aug 7 2013 /besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file001_SFO-2.dst -rw-r--r-- 1 offline physics 561185351 Aug 7 2013 /besfs2/offline/data/664-1/jpsi/dst/090612/run_0009947_All_file002_SFO-1.dst Skim (Analyzing skimmed dst files) Skim events with otalCharged = 2 from the above 3 dst files, and output another 3 skimmed dst files Input files of flt.txt [dengzy@lxslc601 TestRelease]$ ls /besfs/users/dengzy/tag/filter/ -al -rw-r--r-- 1 dengzy physics 154819029 Mar 23 11:02 f_run_0009947_All_file001_SFO-1.dst -rw-r--r-- 1 dengzy physics 155643513 Mar 23 11:03 f_run_0009947_All_file001_SFO-2.dst -rw-r--r-- 1 dengzy physics 163040637 Mar 23 11:04 f_run_0009947_All_file002_SFO-1.dst Tag (tag based analysis) Input files of tag.txt Input files of all.txt + tag files Size of TAG file is 1/740 of DST file, information included in TAG ROOT file entry, run_number, event_number, total_charged, total_neutral, total_tracks [dengzy@lxslc601 test]$ tail all.txt.bosslog 402.555u 5.716s 7:02.05 96.7% 0+0k 7696+69992io 71pf+0w [dengzy@lxslc601 test]$ tail flt.txt.bosslog 170.829u 2.029s 3:05.98 92.9% 0+0k 5792+29240io 26pf+0w [dengzy@lxslc601 test]$ tail tag.txt.bosslog 177.372u 3.356s 3:22.94 89.0% 0+0k 5464+29224io 19pf+0w CPU time of tag based analysis is similar with directly analyzing skimmed DST files, much less than analyzing full DST files.

Performance test: Skim vs Tag All (analyzing full dst files) [dengzy@lxslc601 test]$ tail all.txt.bosslog 377.597u 5.108s 6:42.43 95.0% 0+0k 6056+69872io 36pf+0w Skim (analyzing skimmed dst files) [dengzy@lxslc601 test]$ tail flt.txt.bosslog 270.437u 2.789s 4:54.09 92.9% 0+0k 4576+29120io 6pf+0w Tag (tag based analysis) [dengzy@lxslc601 test]$ tail tag.txt.bosslog 167.323u 3.059s 3:11.37 89.0% 0+0k 5872+29184io 20pf+0w

Performance test: Skim vs Tag [dengzy@lxslc601 test]$ tail tag.txt.bosslog total number: 64131 nGood==2, nCharge==0: 20816 nGam>=2: 6487 Pass Pid: 4250 Pass 4C: 513 Pass 5C: 394 J/psi->rho0 pi0: 105 ApplicationMgr INFO Application Manager Finalized successfully ApplicationMgr INFO Application Manager Terminated successfully 177.372u 3.356s 3:22.94 89.0% 0+0k 5464+29224io 19pf+0w [dengzy@lxslc601 test]$ tail flt.txt.bosslog 170.829u 2.029s 3:05.98 92.9% 0+0k 5792+29240io 26pf+0w