Umesh Joshi Fermilab Phase 1 Pixel Upgrade Workshop, Grindelwald August 28 - 31, 2012 CMS Pixel & HCAL Databases (An Overview)

Slides:



Advertisements
Similar presentations
SDMX in the Vietnam Ministry of Planning and Investment - A Data Model to Manage Metadata and Data ETV2 Component 5 – Facilitating better decision-making.
Advertisements

Proposal: Model-Driven SAL for the OpenDaylight Controller
Service Oriented Architecture for Mobile Applications Swarupsingh Baran University of North Carolina Charlotte.
MS CRM Integration WhosOn Service Integration Presentation MS CRM User Group.
Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
1 IBM SanFrancisco Product Evaluation Negotiated Option Presentation By Les Beckford May 2001.
A Guide to Oracle9i1 Creating an Integrated Database Application Chapter 8.
Lecture Nine Database Planning, Design, and Administration
DB Audit Expert v1.1 for Oracle Copyright © SoftTree Technologies, Inc. This presentation is for DB Audit Expert for Oracle version 1.1 which.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Talend 5.4 Architecture Adam Pemble Talend Professional Services.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Chapter 9 Database Planning, Design, and Administration Sungchul Hong.
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
Overview of the Database Development Process
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Diagnostic & Troubleshooting Date 06/09/00, Page 1 Diagnostic & Troubleshooting s.
Carmen Maidantchik, Felipe Fink Grael, Kaio Karam, Kathy Pommès ATLAS detector construction/commissioning During the construction and commissioning activities,
W. Sliwinski – eLTC – 7March08 1 LSA & Safety – Integration of RBAC and MCS in the LHC control system.
Plant Engineering Workbench 5.3 New Features. 2 Workbench 5.3 ▼ New Features in 5.3 are: –New 3D Model Management module –Additions to the Admin module.
COMP 410 & Sky.NET May 2 nd, What is COMP 410? Forming an independent company The customer The planning Learning teamwork.
Reports from DESY Satoru Uozumi (Staying at DESY during Nov 11 – 25) Nov-21 GLDCAL Japan-Korea meeting.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
Institutional Responsibilities HEPHY – CMS Management Meeting June 20, 2013.
Introduction to MDA (Model Driven Architecture) CYT.
Stephen Booth EPCC Stephen Booth GridSafe Overview.
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.
Chapter 1 : Introduction §Purpose of Database Systems §View of Data §Data Models §Data Definition Language §Data Manipulation Language §Transaction Management.
Online Calibration of the D0 Vertex Detector Initialization Procedure and Database Usage Harald Fox D0 Experiment Northwestern University.
The european ITM Task Force data structure F. Imbeaux.
The Glance Project ATLAS Management January 2012.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
© 2007 IBM Corporation SOA on your terms and our expertise Software WebSphere Process Server and Portal Integration Overview.
Elizabeth Gallas August 9, 2005 CD Support for D0 Database Projects 1 Elizabeth Gallas Fermilab Computing Division Fermilab CD Grid and Data Management.
The IBM Rational Publishing Engine. Agenda What is it? / What does it do? Creating Templates and using Existing DocExpress (DE) Resources in RPE Creating.
3 Copyright © 2004, Oracle. All rights reserved. Working in the Forms Developer Environment.
Database Management Supplement 1. 2 I. The Hierarchy of Data Database File (Entity, Table) Record (info for a specific entity, Row) Field (Attribute,
Issues in Ontology-based Information integration By Zhan Cui, Dean Jones and Paul O’Brien.
UCSC August 12, 2008 U.S. Upgrade R&D Meeting: Strip Detector  Seiden.
9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Nov 1, 2002D0 DB Taking Stock1 Trigger Database Status and Plans Elizabeth Gallas – FNAL CD (with recent help from Jeremy Simmons, John Weigand, and Adam.
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
Rack Wizard LECC 2003 Frank Glege. LECC Frank Glege - CERN2/12 Content CMS databases - overview The equipment database The Rack Wizard.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
PDS4 Demonstration Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Jan 7, 2002E. Gallas/Trigger Db1 Trigger Database and Trigger Configurations and Trigger Issues Elizabeth Gallas, Jeremy Simmons (Fermilab - Computing.
The DCS Databases Peter Chochula. 31/05/2005Peter Chochula 2 Outline PVSS basics (boring topic but useful if one wants to understand the DCS data flow)
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
IBM Express Runtime Quick Start Workshop © 2007 IBM Corporation Deploying a Solution.
Interstage BPM v11.2 1Copyright © 2010 FUJITSU LIMITED INTERSTAGE BPM ARCHITECTURE BPMS.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
An Overview of the FPIX Detector Upgrade – CMS Experiment
Copyright Pte Ltd Installing iZeno SMS Module Version 1 for SugarCRM 6 updated on 25 Nov 2011 Benny Ng Director Business Development.
Vacuum Controls framework for the LHC and its injectors Sebastien Blanchard CERN TE-VSC Integration of controllers in SCADA using OPC Server Goal: Improve.
ATLAS Detector Resources & Lumi Blocks Enrico & Nicoletta.
CT-PPS DB Info (Preliminary) DB design will be the same as currently used for CMS Pixels, HCAL, GEM, HGCAL databases DB is Oracle based A DB for a sub-detector.
L1Calo DBs: Status and Plans ● Overview of L1Calo databases ● Present status ● Plans Murrough Landon 20 November 2006.
Databases and DBMSs Todd S. Bacastow January 2005.
HCAL Database Goals for 2009
Database Replication and Monitoring
CMS High Level Trigger Configuration Management
An Overview of the Pixel and HCAL Databases
HLT & Calibration.
Summary: Workshop on CMS Beam Conditions, Radiation Monitoring and Luminosity Systems Oliver Stein, May 2013, CERN.
Data, Databases, and DBMSs
Analysis models and design models
Overview of Database Framework for GEM Detector at CERN
Presentation transcript:

Umesh Joshi Fermilab Phase 1 Pixel Upgrade Workshop, Grindelwald August , 2012 CMS Pixel & HCAL Databases (An Overview)

Reminder The CMS Pixel and HCAL Databases are different physical instances of the same generic database design (details later) Our DB experience & ongoing activities FPix construction involved multiple institutions in different locations in the U.S. (track flow of parts) Pixel Online DB (ongoing): configuring the Pixel detector HCAL monitoring (ongoing): pedestals, laser, LED, radiation damage, etc. Current HCAL upgrades HO upgrade component testing: SiPM (silicon photomultiplier), mounting boards, control boards, bias boards, etc. HF upgrade component testing: multi-anode PMTs, new base boards, etc. We will be working on FPix upgrades Pixel and HCAL Databases: Short Background 2 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

Detector Components Store all detector components, control electronics, configuration electronics, etc. Track every component – wafers, ROCs, pixels, modules, etc. Store all related data “Build the detector in the DB” We’ve embraced the concept of detector building in the DB Use components stored in the DB to build devices o Fpix: plaquettes, panels, blades, half-disks, half-cylinders, detector Build the readout and control chains Map detector components to readout and control chains Detector configuration and monitoring becomes straightforward Store all configuration data Configuration data Configuration keys and aliases Store all monitoring data Track individual channels Construction DB: What Do We Do? 3 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

Pixel and HCAL databases are different entities, but share same design Database consists of two schema groups Global (can be used for any detector) CORE_CONSTRUCT CORE_ATTRIBUTE CORE_COND CORE_MANAGEMNT CORE_IOV_MGMNT Detector Specific PIXEL_COND PIXEL_CONSTRUCT Each schema contains multiple tables CORE_CONSTRUCT & CORE_ATTRIBUTE o together used to store detector components o component attributes, e.g. ROC posn on wafer, ROC posn on module, etc. PIXEL_COND: to store detector test, configuration, and monitor data CORE_COND: interfaces detector components (CORE_CONSTRUCT) and data (PIXEL_COND) CORE_MANAGEMNT: for tracking components across different institutions CORE_IOV_MGMNT (deployed only for Pixels): for manipulation and tracking of Pixel configuration keys DB Schemas: a Brief Description 4 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

Our most critical & time consuming task: interfacing with detector experts Need to have very close interaction between experts building & testing detector and the DB group This interaction is what drives the design of DB tables, XML templates for loading data, and WBM pages The development process involves the use of 4 instances of a database, e.g. for Pixel DB o Template DB instance: currently in Fermilab (used for building the DB Loader) o Development DB: in CERN IT(INT2R) o Integration DB: in P5(CMSINTR) o Production DB: in P5(OMDS) Once agreed upon, the tables are deployed in the Template DB and the Development DB The DB Loader is built using the template DB in a dedicated machine, currently cmshcal05.cern.ch How Do We Function? 5 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

How Do We Function? (cont) The generated DB Loader is deployed in a development machine, currently pcuscms34.cern.ch, and loading to the development DB enabled Data from the various tests are written out in the XML formats (provided), zipped, and copied to a spool area where the DB Loader picks it up and loads the data in the DB A cronjob is setup to periodically wake up and look for zipped XML files. When a file is found, the loader reads the data and loads it in the DB For each user table deployed (in PIXEL_COND schema), a XML template has to be generated. A one-to-one map between a XML template and a user DB table exists We will provide all XML templates to the experts building and testing detector components We prefer that the experts testing the devices take on the responsibility of generating the XML files and copy them (zipped copies) to the spool area. Work on deployment of WBM pages (as agreed upon) is also initiated. 6 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

Once the data loads successfully in the development DB, tables are deployed in the integration and production databases in P5, and DB Loaders are installed in designated machines. If the data loads successfully in the integration DB, one is assured that data will load in the production DB and can proceed. The process of loading data in production can be automated. (This is what we currently do for HCAL monitoring data in P5) Data loaded in the development DB can be viewed using the development WBM page, e.g. Data loaded in the production can be viewed using the production WBM page, e.g. How Do We Function? (cont) 7 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi

8

9

10

We currently have a group working on HCAL and Pixel databases. Our focus has currently been on HCAL. We are starting to think about Pixels The group members are Zhen Xie (Princeton University) Based in CERN Currently working with HCAL Offline DB, Lumi DB, and Trigger DB Main DB contact for Pixels Valdas Rapsevicius (US CMS) Based in Vilnius Currently working on Run Registry (designed & developed), all WBM applications for HCAL Main contact for HCAL & Pixel WBM applications Dmitry Vishnevskiy (US CMS) Based in CERN Currently working on HCAL monitoring, detector diagnostics, and DB Main DB contact for HCAL Umesh Joshi (Fermiab) Based in Fermilab Contact person for HCAL & Pixels DB Group Members 11 Pixel Upgrade Workshop, Grendelwald 8/29/2012, Umesh Joshi