HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.

Slides:



Advertisements
Similar presentations
March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
Advertisements

1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.
Task Manager Software Engineering: CS 673 Spring 2009 John Spencer, Parag Shah, Rich Moffitt, Hassan Sobhie May 4, 2009.
Database Infrastructure for Application Development Designing tables and relations (Oracle Designer) Creating and maintaining database tables d0om - ORACLE.
ALICE Data Acquisition Ben Shepherd MaRS Group ASTeC STFC Daresbury Laboratory.
May 14, 2001E. Gallas/Trigger Database1 Status of the Trigger Database Elizabeth Gallas, Rich Wellner, Vicky White Fermilab - Computing Division See my.
Mokka and integration of the geometry AIDA kick-off meeting WP2 session: Common software tools 17 February 2011 – CERN Paulo Mora de Freitas and Gabriel.
SVX Software Overview Sasha Lebedev VTX meeting 09/07/ SVX Software web page:
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
Copyrighted material John Tullis 9/17/2015 page 1 04/08/00 Team Projects John Tullis DePaul Instructor
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
ALCPG Software Tools Jeremy McCormick, SLAC LCWS 2012, UT Arlington October 23, 2012.
M1G Introduction to Database Development 6. Building Applications.
This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC Michigan State.
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Project Overview Graduate Selection Process Project Goal Automate the Selection Process.
Configuration Database MICE Collaboration Meeting 28, Sofia David Forrest University of Glasgow Antony Wilson Science and Technology Facilities Council.
High Impact Technology February It’s Awesome!
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
DB-based DAQ monitoring and Physics analysis tools Emiliano Barbuto European Emulsion Group (LNGS May 2003)
Project Overview How to get here…. Half Way to the Test Run October 18, 2012HPS Project Overview2 …starting from here? John Jaros HPS Collaboration Meeting.
Web application for detailed real-time database transaction monitoring for CMS condition data ICCMSE 2009 The 7th International Conference of Computational.
Project Overview Graduate Selection Process Project Goal Automate the Selection Process.
The Glance Project ATLAS Management January 2012.
Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
Postgraduate Computing Lectures Applications I: Overview 1 Applications: Overview Symbiosis: Theory v. Experiment Theory –Build models to explain existing.
Database Monitoring Requirements Salvatore Di Guida (CERN) On behalf of the CMS DB group.
Configuration Database David Forrest 15th January 2009 CM23, HIT, Harbin.
Computing Division Requests The following is a list of tasks about to be officially submitted to the Computing Division for requested support. D0 personnel.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Online Software 8-July-98 Commissioning Working Group DØ Workshop S. Fuess Objective: Define for you, the customers of the Online system, the products.
Jan 28, 2005Elizabeth_Gallas D0_Trigger_Database 1 D0 Trigger Database Status Elizabeth Gallas Fermilab CD/D0CA Margherita Vittone, Vijay Murthi, and Steve.
LCIO A persistency framework and data model for the linear collider CHEP 04, Interlaken Core Software, Wednesday Frank Gaede, DESY -IT-
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Detector Description in LHCb Detector Description Workshop 13 June 2002 S. Ponce, P. Mato / CERN.
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
New COOL Tag Browser Release 10 Giorgi BATIASHVILI Georgian Engineering Center 23/10/2012
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Configuration database status report Eric van Herwijnen September 29 th 2004 work done by: Lana Abadie Felix Schmidt-Eisenlohr.
Mokka, main guidelines and future P. Mora de Freitas Laboratoire Leprince-Ringuet Ecole polytechnique - France Linear collider Workshop 2004, Paris.
Software Tools for Layout Optimization (Fermilab) Software Tools for Layout Optimization Harry Cheung (Fermilab) For the Tracker Upgrade Simulations Working.
The ATLAS DAQ System Online Configurations Database Service Challenge J. Almeida, M. Dobson, A. Kazarov, G. Lehmann-Miotto, J.E. Sloper, I. Soloviev and.
Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)
Examine Overview D0 Online Workshop June 3, 1999 Jae Yu Outline 1. What is an Examine? 2. How Many Examines? 3. How does it work? 4. What are the features?
GlueX Computing GlueX Collaboration Meeting – JLab Edward Brash – University of Regina December 11 th -13th, 2003.
Configuration & Management for Joachim Flammer Integration Team EGEE is a project funded by the European Union under contract IST JRA1 all-hands-meeting,
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
Maria del Carmen Barandela Pazos CERN CHEP 2-7 Sep 2007 Victoria LHCb Online Interface to the Conditions Database.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
1 SLAC simulation workshop, May 2003 Ties Behnke Mokka and LCDG4 Ties Behnke, DESY and SLAC MOKKA: european (france) developed GEANT4 based simulation.
9 Copyright © 2004, Oracle. All rights reserved. Getting Started with Oracle Migration Workbench.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
David Lawrence JLab May 11, /11/101Reconstruction Framework -- GlueX Collab. meeting -- D. Lawrence.
Computing and Software – Calibration Flow Overview
Database Replication and Monitoring
Online Monitoring : Detector and Performance check
Google Web Toolkit Tutorial
CLAS12 Commissioning with Cosmincs
slicPandora: slic + pandoraPFANew
HEP detector description supporting the full experiment life cycle
Conditions System Update and Discussion
Andrea Valassi Pere Mato
9/8/ :03 PM © 2006 Microsoft Corporation. All rights reserved.
Presentation transcript:

HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans

2 Overview HPS Collaboration Meeting 2013 Conditions DB Subdetectors Beam Monitoring Integrated app Sub-detector tools Data catalog Will not discuss DAQ and triggering. Should be well- covered by other talks.

3 Existing Conditions System HPS Collaboration Meeting 2013 org.lcsim File system based Conditions attached to a specific detector version e.g. “HPS-TestRun-v3” Simple to access and easy to add new data Just add a new text file to a directory All detector data contained in hps-detectors XML detector descriptions Conditions associated with that detector model Test run conditions actually moved to resources in hps- java, easily accessible via Java code using built-in methods getClass().getResourceAsStream(“/name/of/resource.txt”);

4 Deficiencies in Current Conditions System HPS Collaboration Meeting 2013 No access of conditions by time validity range No tagging of conditions by version separate from detector geometry Not an online system Not a proper DB What we have is not really a conditions system!

5 Conditions System Requirements HPS Collaboration Meeting 2013 Should probably use existing conditions API Assign time validity to sets of data Tag data with version Viewable on the web APIs for inserting, updating, retrieving Proper database backend Single instance (or mirrored copies) that are publically accessible Possibly accessible (read only) from languages other than Java e.g. from ROOT analysis macros

6 Conditions DB Proposal HPS Collaboration Meeting 2013 Use database structure suggested by SLAC EXO group TagStartEnd svt_calibrations:id:1Jan XXXXJan XXXX Validity Table Data Table => svt_calibrations IdPedestal ……

Conditions DB Proposal (contd) Mock-up coded by SLAC computing staff Conforms to current conditions API in org.lcsim But not really tested or used Existing web interface allows browsing conditions tables Validity by run number, but can be changed to use time range Q: Does this proposed structure cover our needs or do we want to roll our own? Or use/extend some other existing system? Q: Should we use time validity rather than run number? Non-HPS SLAC personnel can contribute to effort, but we must provide a clear set of requirements. HPS Collaboration Meeting

Conditions Data SVT Calibrations Alignment Initial survey, then using tracks. Temperatures (???) ECAL Calibrations Alignment Muon Same as ECAL Beam Data from EPICS Energy, luminosity, beam profile, etc. HPS Collaboration Meeting

Monitoring Broad/general topic Immediate view of subdetector (or other) data and status Integrated monitoring Convert EVIO to LCIO on-the-fly and plot reconstruction data hps-java monitoring packages provide full application Sub-detector tools SVT and ECAL groups have own low-level tools to monitor their systems, based on direct access to DAQ. Completely separate from integrated tool. Beam JLab tools HPS Collaboration Meeting

hps-java Monitoring tools Java GUI application Attaches stations to ET ring providing the data stream Connection details configurable Address, port, etc. of the ET server Displayed plots are not hard-coded. Select an lcsim steering file that can perform reconstruction and plot results. Seemed to work well during test run. HPS Collaboration Meeting

hps-java Monitoring Example HPS Collaboration Meeting

Monitoring Discussion Q: What additional features are needed in the hps-java monitoring tool? Q: Can we cut down the number of separate tools to a minimum set? Understood subdetector groups will have own monitoring tools, but a large number could be hard to manage. Q: Are additional monitoring tools needed? For instance, app showing graphical status and/or data flow of all systems. Q: What additional tools not covered by the hps-java Monitoring Application are needed? esp. want to hear from DAQ groups HPS Collaboration Meeting

Data Catalog Currently have no real online data catalog. Useful for tagging data with metadata as well as allowing easy access to experimental collaborations. SLAC has a “generic” data catalog we could use. HPS Collaboration Meeting