1 Laser Monitoring: Databases and Offline Transparency Correction in CMSSW Toyoko Orimoto Caltech 02 Aug 2007.

Slides:



Advertisements
Similar presentations
Testing Relational Database
Advertisements

Special SC readout Dears Dave, Philippe and Irakli, I was told by Reyes that end of June there will be a meeting to finalize the trigger.
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology, on behalf of the CMS ECAL Group 10th ICATPP Conference on Astroparticle,
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology, on behalf of the CMS ECAL Group High-resolution, high-granularity.
NMED 3850 A Advanced Online Design February 25, 2010 V. Mahadevan.
CSC1016 Coursework Clarification Derek Mortimer March 2010.
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology On behalf othe CMS ECAL Collaboration High-resolution, high-granularity.
Paolo Meridiani - INFN Roma11 ECAL perfomance: lessons learned and future plans P. Meridiani & C. Seez Physics Days 17/01/2007.
ECAL Testbeam Meeting, Rome 28 March 2007 Toyoko Orimoto Adolf Bornheim, Chris Rogan, Yong Yang California Institute of Technology Lastest Results from.
Thoughts on ECAL ‘calibration stream’ D. del Re, P.Meridiani, R. Paramatti, Sh. Rahatlou, F. Santanastasio.
Database Design Concepts INFO1408 Term 2 week 1 Data validation and Referential integrity.
1 Laser Monitoring: Offline Transparency Correction in CMSSW Toyoko Orimoto Caltech 13 July 2007.
1 Laser Monitoring in ECAL DB Toyoko Orimoto ECAL Databases Meeting 18 September 2007 Status of ECAL laser objects Performance improvements Next steps.
ExitTOC Run & Route Directions 2003 Editing Run and Route Directions Edulog.nt v9.2 Use the buttons to navigate the training package First PagePreviousNextLast.
X.Dong, USTC/LBNL Feb. 20th, 04, STAR Collaboration Meeting 1 TOF Software Progress Xin Dong, for TOF Group  TOF detectors in Run IV  Online software.
DAT702.  Standard Query Language  Ability to access and manipulate databases ◦ Retrieve data ◦ Insert, delete, update records ◦ Create and set permissions.
DB Audit Expert v1.1 for Oracle Copyright © SoftTree Technologies, Inc. This presentation is for DB Audit Expert for Oracle version 1.1 which.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
C. Seez Imperial College November 28th, 2002 ECAL testbeam Workshop 1 Offline software for ECAL test beam The pre-processing model The offline software.
Reports from DESY Satoru Uozumi (Staying at DESY during Nov 11 – 25) Nov-21 GLDCAL Japan-Korea meeting.
1 HCAL Upgrade TP simulation studies Jane Nachtman (Iowa) – for the HCAL group Trigger Upgrade meeting April 28, 2010.
B. IlleWACH /11/20021 WELCOME to WACH I am happy to introduce this ‘Workshop Analysis Calorimetry H4’ dedicated to M0’ data analysis and the.
DBMS Spring 2014 Database Integrity Sources: Security in Computing, Pfleeger and Pfleeger, Prentice Hall, 2003 Lecture Slides, CSE6243, MSU, Rayford B.
Management Information Systems MS Access MS Access is an application software that facilitates us to create Database Management Systems (DBMS)
Request username and password if you don’t already have one.
ISV Innovation Presented by ISV Innovation Presented by Business Intelligence Fundamentals: Data Cleansing Ola Ekdahl IT Mentors 9/12/08.
IT:Network:Applications.  “Business runs on databases…” ◦ Understatement!  Requirements  Installation  Creating Databases  SIMPLE query ◦ Just enough.
MS Access 2007 Management Information Systems 1. Overview 2  What is MS Access?  Access Terminology  Access Window  Database Window  Create New Database.
JDBC Java and Databases. RHS – SOC 2 JDBC JDBC – Java DataBase Connectivity An API (i.e. a set of classes and methods), for working with databases in.
Detector Diagnostics Calibration Analysis Ped/LED/Laser RadDam Analysis Detector Optimization Lumi Detector Performance Monitoring DQM On/Offline Prompt.
Pointers. What is pointer l Everything stored in a computer program has a memory address. This is especially true of variables. char c=‘y’; int i=2; According.
Calibration of the CMS Electromagnetic Calorimeter with first LHC data
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER Charles Leggett Interval of Validity Service IOVSvc ATLAS Software Week May Architecture.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
DOE Review Adi Bornheim California Institute of Technology July 25, 2007 CMS ECAL Status, Test Beams, Monitoring and Integration.
Finding a PersonBOS Finding a Person! Building an algorithm to search for existing people in a system Rahn Lieberman Manager Emdeon Corp (Emdeon.com)
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
Offline Status Report A. Antonelli Summary presentation for KLOE General Meeting Outline: Reprocessing status DST production Data Quality MC production.
Session 1 Module 1: Introduction to Data Integrity
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
Guide to Assignment 3 and 4 Programming Tasks 1 CSE 2312 Computer Organization and Assembly Language Programming Vassilis Athitsos University of Texas.
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
TTF - ECAL Plenary in CMS week ECAL Stability Contacts: Marc Dejardin, Julie Malcles (laser)
JDBC Java and Databases. SWC – JDBC JDBC – Java DataBase Connectivity An API (i.e. a set of classes and methods), for working with databases in.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
PrimEx Analysis Status Mark Ito November 19, 2005 ● Accomplishments ● In progress ● Anomalies ● Next steps ● Bias.
Day in the Life (DITL) Production Operations with Energy Builder Copyright © 2015 EDataViz LLC.
Валидация TRT DCS CONDITIONS SERVICE Евгений Солдатов, НИЯУ МИФИ “Physics&Computing in ATLAS” – 22/09/2010.
Announcements Assignment 2 Out Today Quiz today - so I need to shut up at 4:25 1.
INFORMATION TECHNOLOGY DATABASE MANAGEMENT. A database is a collection of information organized to provide efficient retrieval. The collected information.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
BTM 382 Database Management Chapter 8 Advanced SQL Chitu Okoli Associate Professor in Business Technology Management John Molson School of Business, Concordia.
TOTEM Collaboration Meeting 13/12/06 Fabrizio Ferro-INFN-Ge 1 T1 SW status.
M.D. Nov 27th 2002M0' workshop1 M0’ linearity study  Contents : Electronic injection Laser injection Beam injection Conclusion.
UPDATE ON FLASH FINDING, TRACK MATCHING, COSMIC REJECTION Ben jones, MIT.
David Lange Lawrence Livermore National Laboratory
Check of Calibration Hits in the Atlas simulation. Assignment of DM energy to CaloCluster. G.Pospelov Budker Institute of Nuclear Physics, Novosibirsk,
Data Integrity & Indexes / Session 1/ 1 of 37 Session 1 Module 1: Introduction to Data Integrity Module 2: Introduction to Indexes.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
CT-PPS DB Info (Preliminary) DB design will be the same as currently used for CMS Pixels, HCAL, GEM, HGCAL databases DB is Oracle based A DB for a sub-detector.
Bitwise Operations C includes operators that permit working with the bit-level representation of a value. You can: - shift the bits of a value to the left.
Chapter 6 - Database Implementation and Use
CMS High Level Trigger Configuration Management
DPG Activities DPG Session, ALICE Monthly Mini Week
CDS comments on supporting note
Remaining Online SW Tasks
Conditions Data access using FroNTier Squid cache Server
Slope measurements from test-beam irradiations
Laser Software Status and Comments on Concerns
CMPE/SE 131 Software Engineering March 7 Class Meeting
Presentation transcript:

1 Laser Monitoring: Databases and Offline Transparency Correction in CMSSW Toyoko Orimoto Caltech 02 Aug 2007

2 CSA07 & CMSSW_1_6_0 We’re in! Code for offline database records and offline transparency correction will be in 1_6_0, for CSA07 Calibration Exercise Developed and tested for 1_6_0_pre6: V CondCore/EcalPlugins V CondFormats/EcalObjects V CalibCalorimetry/EcalLaserCorrection V CalibCalorimetry/EcalTrivialCondModules V CalibCalorimetry/Configuration V RecoLocalCalo/EcalRecProducers The overall structure of things has not changed since our last meeting, though many of the details have been filled in.. Will discuss some of these details and outstanding issues in the next slides… Database objects Offline correction “Trivial” values Calib. RecHits

3 EcalObjects The General “Offline” Picture EcalLaserCorrectionService Event EcalLaserDbService EcalRecHitsProducer EcalLaserAPDPNRatios EcalLaserAPDPNRatiosRef EcalLaserAlphas ORCOFF Database SQLITE EcalTrivial CondModules

4 Laser Database Records CondFormats/EcalObjects Essentially the same as before, but change in timestamp format, which I will describe more later EcalLaserAlphas EcalLaserAPDPNRatiosRef EcalLaserAPDPNRatios uint32_t changed to edm::Timestamp format to be consistent with what is expected for Monte Carlo This means we had to delete all of our pre-existing database tables, because these tables were made with old maps to uint32_t… Otherwise we couldn’t write to the same DB --> OK, we can remake struct EcalLaserTimeStamp{ uint32_t t1; uint32_t t2; }; struct EcalLaserTimeStamp{ edm::Timestamp t1; edm::Timestamp t2; };

5 Offline Transparency Correction CalibCalorimetry/EcalLaserCorrection EcalLaserDbRecord: Dependent record to hold Ecal Laser DB records EcalLaserDbService: Given pointers to DB records (alpha, APD/PN, timestamps, etc) + xtal DetId + Timestamp of event will compute the transparency correction Interpolation using two EcalLaserTimeStamp values Outputs multiplicative correction factor EcalLaserCorrectionService: ESProducer which will access the database and produce the values for alpha, reference, APD/PN ratios and timestamps Will produce new values for every update in IOV EcalLaserCorrectionService Event EcalLaserDbService Event Setup Transparency Correction ORCOFF DB

6 Offline Transparency Correction (II) CalibCalorimetry/EcalTrivialCondModules Provides “trivial conditions”, ie, values for records without actually accessing the database By default, gives APD/PN = (1,1), APD/PN_ref = 1, alpha=1.55, TimeStamps are (1, “endOfTime”) CalibCalorimetry/Configuration/data/Ecal_FakeConditions.cff CSA07 Exercise should also test database access/load Will need to fill offline DB with values to give “null” corrections (ie, non-changing APD/PN values), similar to “trivial conditions” Fill with timestamps which correspond with values in MC Will also need to be careful of how we define the IOVs for the DB records.. If the IOVs don’t “match” well with what is in MC, then it will not test the database load properly.. Also, can define IOV by timestamp or by runnumber

7 Timestamps in Monte Carlo Official time format in CMSSW is Timestamp DataFormats/Provenance/interface/Timestamp.h Essentially two 32-bit numbers (unsigned int): timeLow & timeHigh: A while back, timestamps in MC were nonsensical, but we’ve been promised “meaningful” timestamps in CSA07 MC For instance looking at sample from official production: /DrellYan_ll_10-40/CMSSW_1_4_4-CSA /GEN-SIM (Total, 4k events) RowRuneventtimeHightimeLow … You see that timeLow is increasing incrementally with each event However, It appears that for this particular sample, timestamp is unique only with *each run* --> If this is case, will use IOVs defined by runnumber rather than timestamp!

8 Preliminary Testing & Performance RecoLocalCalo/EcalRecProducers Laser correction is compute “on the fly” for every RecHit.. Very basic testing: producing and reconstructing samples of 10 “single neutrino gun” events using trivial conditions Checked reconstructed energy before correction, with null correction, with non-null correction --> everything checks out. Will do more detailed testing: must be careful since this correction will be applied to every calibrated RecHit… Performance Time to make the calib RecHits for each event increased by factor of 4 (with trivial conditions, ie no real database access) EcalRecHitProducer: Without  With laser correction: sec  sec Increase in time perhaps largely due to maps used for accessing DB records… These will eventually be changed to linear vectors. Will try to improve performance Regardless, these are just milliseconds we are talking about…

9 Light Monitoring Module Numbering Mentioned last time: need to map crystals light monitoring modules because we plan to store only one timestamp per light monitoring module For now, I’ve hardcoded a mapping for EB and EE in EcalLaserCorrection::EcalLaserDBService However, a more appropriate place: Geometry/EcalMapping: deals with electronics mapping for ECAL Thanks to Emmanuelle Perez, the mapping that I described last meeting is now in this package Tag: V , will be in 1_7_X For future: EcalLaserCorrection in 1_6_X uses the hardcoded internal mapping, but for next update will use this new mapping NB: this is important not just for offline correction code, but also in future for database code, DQM, etc etc…

10 Next Steps Further testing: reconstruction with corrections computed from database.. Determining values to place in the official CSA07 database: main issue is timestamps Utilizing the new light-monitoring mapping in Geometry/EcalMapping Performance issues: try to improve, if possible Any such improvements will go into 1_7_X THE END

11 One detail: Mapping of Light Monitoring Modules In Offline DB, store timestamps according to light monitoring modules, so we don’t have duplication of numbers In EB, straightforward correspondence between SM, DCC, and Light Monitoring Module. In EE, there are two monitoring regions which are read out by two DCCs.. (see picture) In total for the EB+EE: 54 DCCs, 88 LMs and 92 LM readout. So we propose this numbering scheme: Geometry/EcalMapping: deals with electronics mapping for ECAL One caveat: ECAL DQM numbers things from EE->EB->EB->EE DCCLM LM- readout EB EB EE EE