1 Laser Monitoring in ECAL DB Toyoko Orimoto ECAL Databases Meeting 18 September 2007 Status of ECAL laser objects Performance improvements Next steps.

Slides:



Advertisements
Similar presentations
SYMBOL TABLES &CODE GENERATION FOR EXECUTABLES. SYMBOL TABLES Compilers that produce an executable (or the representation of an executable in object module.
Advertisements

Multi-granular, multi-purpose and multi-Gb/s monitoring on off-the-shelf systems TELE9752 Group 3.
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology, on behalf of the CMS ECAL Group 10th ICATPP Conference on Astroparticle,
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology, on behalf of the CMS ECAL Group High-resolution, high-granularity.
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology On behalf othe CMS ECAL Collaboration High-resolution, high-granularity.
Boost Write Performance for DBMS on Solid State Drive Yu LI.
Reconstruction and Analysis on Demand: A Success Story Christopher D. Jones Cornell University, USA.
ECAL Testbeam Meeting, Rome 28 March 2007 Toyoko Orimoto Adolf Bornheim, Chris Rogan, Yong Yang California Institute of Technology Lastest Results from.
1 Laser Monitoring: Databases and Offline Transparency Correction in CMSSW Toyoko Orimoto Caltech 02 Aug 2007.
1 Laser Monitoring: Offline Transparency Correction in CMSSW Toyoko Orimoto Caltech 13 July 2007.
Security Architecture Dr. Gabriel. Security Database security: –degree to which data is fully protected from tampering or unauthorized acts –Full understanding.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
Agenda Journalling More Embedded SQL. Journalling.
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
C. Seez Imperial College November 28th, 2002 ECAL testbeam Workshop 1 Offline software for ECAL test beam The pre-processing model The offline software.
September 6 th -8 th, 2011, Istanbul, Turkey 21 th Meeting of the Advisory Group PMA AC Regional database on Pollution September 6-8, 2011 Istanbul, Turkey.
Security Architecture
Extents, segments and blocks in detail. Database structure Database Table spaces Segment Extent Oracle block O/S block Data file logical physical.
Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London.
1099 Why Use InterBase? Bill Todd The Database Group, Inc.
PHENIX Simulation System 1 December 7, 1999 Simulation: Status and Milestones Tarun Ghosh, Indrani Ojha, Charles Vanderbilt University.
Web application for detailed real-time database transaction monitoring for CMS condition data ICCMSE 2009 The 7th International Conference of Computational.
MC/Offline Planning M. Moulson Frascati, 21 March 2005 MC status Reconstruction coverage and data quality Running time estimates MC & reprocessing production.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
Detector Diagnostics Calibration Analysis Ped/LED/Laser RadDam Analysis Detector Optimization Lumi Detector Performance Monitoring DQM On/Offline Prompt.
Database Security and Auditing: Protecting Data Integrity and Accessibility Chapter 1 Security Architecture.
RPC DQA but also Monitoring for the DCS group: status and prospective for Marcello Bindi RPC L1MU Barrel DQM - 08/05/2013.
1 Construction Chapter Key Concepts Be familiar with the system construction process. Understand different types of tests and when to use Understand.
17-Aug-00 L.RistoriCDF Trigger Workshop1 SVT: current hardware status CRNowFinal Hit Finders64242 Mergers31616 Sequencers2312 AMboards4624 Hit Buffers21212.
Database Monitoring Requirements Salvatore Di Guida (CERN) On behalf of the CMS DB group.
MS Access: Database Concepts Instructor: Vicki Weidler Assistant: Joaquin Obieta.
1 N. BrunerUniv. of New Mexico MuTr Software  Online  Calibration  Offline.
Stephanie Allison LCLS Controls Software Meeting Dec 6, 2007 How To Set Up for the Event System on an IOC with an EVR(s) Assumes.
DOE Review Adi Bornheim California Institute of Technology July 25, 2007 CMS ECAL Status, Test Beams, Monitoring and Integration.
A New Tool For Measuring Detector Performance in ATLAS ● Arno Straessner – TU Dresden Matthias Schott – CERN on behalf of the ATLAS Collaboration Computing.
Database Security and Auditing: Protecting Data Integrity and Accessibility Chapter 1 Security Architecture.
Session 07 Module 13 - Collections. Collections / Session 7 / 2 of 32 Review  A delegate in C# is used to refer to a method in a safe manner.  To invoke.
MICE Configuration DB Janusz Martyniak, Imperial College London MICE CM39 Software Paralell.
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
DEX 7 – Operational Feedback Business Need Introduction This exchange enables the transmission of information on the condition and usage of a supported.
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
S t a t u s a n d u pd a t e s Gabriella Cataldi (INFN Lecce) & the group Moore … in the H8 test-beam … in the HLT(Pesa environment) … work in progress.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut
Structure of the presentation ► Background of LLP eGovernance Project ► Existing Features ► Future Plans ► Walk-through of the system.
Online/offline integration - Aart Heijboer - sector/soft - Cern june 2002 Integration Online and Offline software Run Control Ligier (dispatcher) Data.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut Zeuthen Collaboration Meeting.
1 Bringing it all together: Exploring the EVB Today: First Hour: Bringing it all together by exploring the EVB –Section of Huang’s Textbook.
LHCbDirac and Core Software. LHCbDirac and Core SW Core Software workshop, PhC2 Running Gaudi Applications on the Grid m Application deployment o CVMFS.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
Preservation of LEP Data There is still hope Is there? Marcello Maggi, Ulrich Schwickerath, Matthias Schröder, , DPHEP7 1.
GeoElections and Voter Focus Interoperability 14 th Annual GeoElections User Conference GeoElections Voter Registration System.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
The Database Project a starting work by Arnauld Albert, Cristiano Bozza.
TOTEM Collaboration Meeting 13/12/06 Fabrizio Ferro-INFN-Ge 1 T1 SW status.
CDF SAM Deployment Status Doug Benjamin Duke University (for the CDF Data Handling Group)
HCAL Database Goals for 2009
Real Time Fake Analysis at PIC
Key-Value Store.
SuperB and its computing requirements
Chapter 6 - Database Implementation and Use
CMS High Level Trigger Configuration Management
POOL persistency framework for LHC
Optimizing SQL Queries
Data, Databases, and DBMSs
Lecture 5 – Improved Monte Carlo methods in finance: lab
DQM for the RPC subdetector
Presentation transcript:

1 Laser Monitoring in ECAL DB Toyoko Orimoto ECAL Databases Meeting 18 September 2007 Status of ECAL laser objects Performance improvements Next steps

2 Laser (Offline) Database Records CondFormats/EcalObjects Three objects required for laser transparency correction: EcalLaserAlphas EcalLaserAPDPNRatiosRef EcalLaserAPDPNRatios: APD/PN pairs and time stamp pairs Beginning with 1_6_0_pre7 Note: means we had to delete all of our pre-existing database tables, because these tables were made with old maps to uint32_t… struct EcalLaserTimeStamp{ uint32_t t1; uint32_t t2; }; struct EcalLaserTimeStamp{ edm::Timestamp t1; edm::Timestamp t2; }; uint32_t changed to edm::Timestamp format to be consistent with what is expected for Monte Carlo

3 Performance Improvements Efforts in ECAL software side to optimize performance, including DB aspects Performance with laser correction in 1_6_0 Time to make the calib RecHits for each event increased by x4 (with trivial conditions, ie no real database access) EcalRecHitProducer w/o vs w/ correction: 0.8 msec  ~3 msec Increase due to maps used for accessing records… (?) typedef std::map EcalLaserAlphaMap; typedef std::map ::const_iterator EcalLaserAlphaMapIterator; Each value associated with one xtal via DetId std::map is very time-consuming and should be avoided During database access *and* during reconstruction Move to use std::vector instead of std::map

4 Changes for std::map to std::vector Summary of min. changes to migrate from maps to vectors: typedef in CondFormats/EcalObjects/interface constructor in CondFormats/EcalObjects/src to initialize size of vector (to total number of xtal hashedIndex’s) Dictionary classes in CondFormats/EcalObjects/src/classes.h and CondFormats/EcalObjects/src/classes_def.xml Trivial cond retriever in CalibCalorimetry/EcalTrivialCondModules Use hashedIndex() to associate DetId with position in vector New tool in EcalDetId to monotonically number xtals EB: xtal index (1 to 1700) + (1700 * iSM) EE: increases in rows ix and iy, with “hole” mapped Change find() methods to use vectors with hashed index alpha = laserAlphaMap[hi]; hi = EBDetId(xid).hashedIndex(); // EB case hi = EEDetId(xid).hashedIndex() + EBDetId::MAX_HASH + 1 // EE case

5 Performance Improvement Results Changes completed, tested, and committed for laser records Tested fully: Read/write from a local sqlite file and ORCOFF (cms_ecal_off_test) in cms_orcoff_int2r. Ecal trivial conditions & laser correction module OK Changes committed to HEAD for CondFormats/EcalObjects CalibCalorimetry/EcalTrivialCondModules CalibCalorimetry/EcalLaserCorrection CondTools/Ecal Performance checked with old maps vs. new vectors: Generated and reco'd small sample of events with Configuration/ReleaseValidation with trivial conditions Checked the CPU usage reported by TimeModule for EcalRecHitProducer in 1_7_0_pre1 Before: 3.9ms --> After: 1.9ms (~50% improvement)

6 Next steps Laser database values for CSA07 One payload with runnumber IOV from 1 until endOfTime Will produce a “trivial” laser correction factor of 1 Laser database values for testing in 1_7_0 Will be a real test of payload/IOV Need runnumbers/timestamps in MC so we can properly define IOV and APD/PN timestamp values O2O We would like to implement corrections to our laser data during the O2O process (Jan Veverka) Is POPCON the right thing to look to for this? Just getting started, much to learn…

7 Summary Efforts to improve performance Changes completed, tested, and committed to migrate from maps to vectors for laser database objects Thanks to Federico, Francesca, Vladlen, Zhen, for help Next to fill DB for CSA07 and testing of 170 code Then focus on moving on to online and O2O issues for laser monitoring