STAR C OMPUTING STAR Computing Infrastructure Torre Wenaus BNL STAR Collaboration Meeting BNL Jan 31, 1999.

Slides:



Advertisements
Similar presentations
Luna imaging, inc hayden ave bldg. one culver city, ca ph fax Insight User Group Meeting.
Advertisements

Provenance-Aware Storage Systems Margo Seltzer April 29, 2005.
Intermediate Access: Center for Teaching Advancement and Assessment Research On Creating a Database from Scratch.
Database Planning, Design, and Administration
March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
IE 423 – Design of Decision Support Systems Introduction to Data Base Management Systems and MS Access.
Granularity of Locks and Degrees of Consistency in a Shared Data Base John LaFontaine Haixuan Sun.
3-1 Chapter 3 Data and Knowledge Management
“DOK 322 DBMS” Y.T. Database Design Hacettepe University Department of Information Management DOK 322: Database Management Systems.
BUSINESS DRIVEN TECHNOLOGY
Compe 301 ER - Model. Today DBMS Overview Data Modeling Going from conceptual requirements of a application to a concrete data model E/R Model.
CSC 351 FUNDAMENTALS OF DATABASE SYSTEMS
Offline Trigger Software Update Akio Ogawa STAR Collaboration Meeting 2003 Feb 28 BNL.
Chapter 7: The Object-Oriented Approach to Requirements
Main challenges in XML/Relational mapping Juha Sallinen Hannes Tolvanen.
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
Database Design for DNN Developers Sebastian Leupold.
 Introduction Introduction  Purpose of Database SystemsPurpose of Database Systems  Levels of Abstraction Levels of Abstraction  Instances and Schemas.
STAR C OMPUTING Maker and I/O Model in STAR Victor Perevoztchikov.
STAR C OMPUTING ROOT in STAR Torre Wenaus STAR Computing and Software Leader Brookhaven National Laboratory, USA ROOT 2000 Workshop, CERN February 3, 2000.
DATABASE. A database is collection of information that is organized so that it can easily be accessed, managed and updated. It is also the collection.
Database Technical Session By: Prof. Adarsh Patel.
Database Design - Lecture 2
1 Introduction to Database Systems. 2 Database and Database System / A database is a shared collection of logically related data designed to meet the.
Software Requirements Engineering CSE 305 Lecture-2.
Architecture for a Database System
Some notes on ezTree and EMC data in MuDst Marco van Leeuwen, LBNL.
DAT305 Boost Your Data-Driven Application Development Using SQL Server Centric.NET Code Generator Pascal Belaud Microsoft France.
Lecture2: Database Environment Prepared by L. Nouf Almujally & Aisha AlArfaj 1 Ref. Chapter2 College of Computer and Information Sciences - Information.
1 Data Warehouses BUAD/American University Data Warehouses.
PHENIX Simulation System 1 December 7, 1999 Simulation: Status and Milestones Tarun Ghosh, Indrani Ojha, Charles Vanderbilt University.
Event Data History David Adams BNL Atlas Software Week December 2001.
(Spring 2015) Instructor: Craig Duckett Lecture 10: Tuesday, May 12, 2015 Mere Mortals Chap. 7 Summary, Team Work Time 1.
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
ATLAS Detector Description Database Vakho Tsulaia University of Pittsburgh 3D workshop, CERN 14-Dec-2004.
CS370 Spring 2007 CS 370 Database Systems Lecture 1 Overview of Database Systems.
INFO1408 Database Design Concepts Week 15: Introduction to Database Management Systems.
DIMENSIONAL MODELING MIS2502 Data Analytics. So we know… Relational databases are good for storing transactional data But bad for analytical data What.
1 GCA Application in STAR GCA Collaboration Grand Challenge Architecture and its Interface to STAR Sasha Vaniachine presenting for the Grand Challenge.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
STAR Event data storage and management in STAR V. Perevoztchikov Brookhaven National Laboratory,USA.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
STAR C OMPUTING STAR Analysis Operations and Issues Torre Wenaus BNL STAR PWG Videoconference BNL August 13, 1999.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
Grand Challenge in MDC2 D. Olson, LBNL 31 Jan 1999 STAR Collaboration Meeting
STAR C OMPUTING Plans for Production Use of Grand Challenge Software in STAR Torre Wenaus BNL Grand Challenge Meeting LBNL 10/23/98.
1 fileCatalog, tagDB and GCA A. Vaniachine Grand Challenge STAR fileCatalog, tagDB and Grand Challenge Architecture A. Vaniachine presenting for the Grand.
Microsoft Access Database Creation and Management.
STAR C OMPUTING Introduction Torre Wenaus BNL May ‘99 STAR Computing Meeting BNL May 24, 1999.
Business Intelligence Training Siemens Engineering Pakistan Zeeshan Shah December 07, 2009.
Simulation Status for Year2 Running Charles F. Maguire Software Meeting May 8, 2001.
Magda Distributed Data Manager Prototype Torre Wenaus BNL September 2001.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
Summary of Workshop on Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Computing Day February 28 th 2005.
Star Database Tutorial Package Design & Objectivity Discussion Interface Questions – What do you want? -> making requests – What do you get? -> data container.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
1 Lecture1 Introduction to Databases Systems Database 1.
1 The Relational Data Model David J. Stucki. Relational Model Concepts 2 Fundamental concept: the relation  The Relational Model represents an entire.
Magda Distributed Data Manager Torre Wenaus BNL October 2001.
James A. Senn’s Information Technology, 3rd Edition
(Winter 2017) Instructor: Craig Duckett
Physical Data Model – step-by-step instructions and template
The COMPASS event store in 2002
Dr. Awad Khalil Computer Science Department AUC
Nuclear Physics Data Management Needs Bruce G. Gibbard
OO-Design in PHENIX PHENIX, a BIG Collaboration A Liberal Data Model
Database Design Hacettepe University
Dr. Awad Khalil Computer Science Department AUC
Offline framework for conditions data
Presentation transcript:

STAR C OMPUTING STAR Computing Infrastructure Torre Wenaus BNL STAR Collaboration Meeting BNL Jan 31, 1999

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 Purpose Not an attempt at a comprehensive infrastructure overview -- infrastructure will be addressed 4-6pm tomorrow Addressing only a few issues of my choice! (Anticipating that this talk may be bumped off the Sunday agenda entirely)

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 Tag Database! Seems to be generating a lot of confusion and uncertainty! It really isn’t very complicated ---  ‘tag’ components of the event store are of the same nature as other components, with some different characteristics driven by the particular requirements for tags l Compact, for convenient disk storage and fast access, where ‘compact’ is to be defined by the tag users l Easily redefined and updated; notions of what should be in physics tags expected to change frequently l 100% disk resident (if in active use) with fast access performance and direct histogramming access at a premium  the ‘tag database’ is not a distinct entity from the event store; it is part of the STAR event store  the ‘tag database’ and the Grand Challenge query index are completely different entities; the latter is a subset of the former, and reads the former to build the query index

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 More on Tags  The event consists of many tag components, added to the event at different stages of processing, and coming from different parts of the analysis l Tags with online, DAQ, trigger information added to the event store when an event collection (run) and event are initially created in the online environment l Reconstruction tags: QA info to evaluate reconstruction performance, DST summary tags, PWG tags summarizing info uniquely relevant to PWGs and available at reconstruction time l Analysis tags: more refined PWG tags created at DST analysis time (a summary of the uDST, if useful)  Tag components should be highly granular, ie. don’t combine the needs of different groups in the same tag, to minimize interference when tags are redefined or updated. QA tags should be distinct tags.  Tag components are not, in general, histograms. They are typically C structs. Including histograms in some ROOT-based tags has been discussed.

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 Tag Implementation Tags in MDC1 were the tag-like components of the DST:  event_summary, dst_monitor_soft, dst_monitor_hard  not all filled, not all strictly tag info (database info; run conditions parameters)  In XDF files, stored together with all the rest of the DST (ie. Not as tags)  In the Objectivity event store, stored separately from the DST data itself, permanently on disk (ie. As real tags) For MDC2, priority is to define PWG tags built from the DST to use for GC query index definition, then usable for GC-based queries  Online/DAQ/trigger tags will be sorted out after MDC2  QA tags would be nice too! (QA info will be there in one form or another -- Maker-associated histograms) For MDC2, tags will be implemented both in Objy and in ROOT  redundantly; just to try both  Objy implementation essentially the same as MDC1  MDC2 ROOT event storage will support distinct disk-resident storage of tags

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 StEvent Implementation CVS version of StEvent includes  full class set as per Thomas’ design diagrams  table loader constructors to build StEvent for an event from MDC1 DST tables  an interim standalone makefile; integration into A reader, StRoot/StEventReaderMaker, is in CVS which  Reads DST events from MDC1 XDF files (working) or Objectivity (untested) and builds StEvent  Driver chain currently in ~wenaus/workdir/readEvent.C  Sample analysis maker StAnalysisMaker to access and use StEvent exists and will be filled out to be more illustrative this week Much thrashing against template problems in all of this, thanks to Sun  Customizations remain to go into official Makefiles This stuff is usable today on a ‘sit down with Thomas or Torre and set it up’ basis; should be end-user ready within a week.

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 ROOT News FNAL organizing a ROOT workshop for US users in March  STAR will be there  Address how needs of STAR, RHIC, Run II can be addressed in unified ROOT project; how our mods can be incorporated and how our design and prioritization input will be considered ROOT adopted as the analysis framework in ALICE  It is ‘in the door’ as a LHC experiment tool No change in CERN’s official position on ROOT; no support  Rumors of ‘change in ‘99’  Better, I suppose, than rumors of ‘no change in ‘99’, but can’t read into it more than that. We’ll see.

STAR C OMPUTING Torre Wenaus, BNL Collaboration meeting 31/1/99 Objectivity News Reading the Objy hypernews forum of BaBar is worrisome  Locking problems with multiple (11) concurrent writers in production; DB hangs  DB with concurrent production writers can hang when someone browses an unrelated part of the federation In talking to them last week, word is that problems are understood and being resolved, but, it gives one pause. BaBar’s Objy usage mode is much more aggressive than ours, making them much more susceptible to such problems, but the fact remains we have not tested concurrent usage performance of our usage mode yet at all While there is concern, as always, there doesn’t seem to be any backing away from Objy yet by BaBar, RD45 The schema evolution Objy supports seems to be fundamentally unusable by HENP: old executables cannot be run against an evolved schema DB  So it’s ‘roll your own’ class versioning