VdM analysis framework status and plans 14 April 2015 Monika Grothe (Wisconsin) 1 14 April 2015 VdM analysis Framework status.

Slides:



Advertisements
Similar presentations
compilers and interpreters
Advertisements

Prepared by Abdullah Mueen and Eamonn Keogh
Outlook Contacts Export Guideline Powered by DonorCommunity TM DonorCommunity eLearning Series v1.2, September 2012 Outlook Contacts Export Guideline Outlook.
MapReduce in Action Team 306 Led by Chen Lin College of Information Science and Technology.
9/13/2007 Nodal COMS Extracts & Reports Market Requirements Review SDAWG Jackie Ashbaugh ERCOT ***NOTE: All information contained in this presentation.
Alford Academy Business Education and Computing1 Advanced Higher Computing Based on Heriot-Watt University Scholar Materials Implementation and Testing.
Offline Code for Next Beam Test Jianchun Wang 08/06/01.
Data Quality Assurance Linda R. Coney UCR CM26 Mar 25, 2010.
Experimental Facilities Division ANL-ORNL SNS Experimental Data Standards (Status) Richard Riedel SNS Data Acquisition Group Leader.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
Target Online Software J. Leaver 01/12/ /06/2015Imperial College 2 Target Controller Software Software for Stage 1 upgrade nearing completion –Hardware.
Runtime alignment system SOFTWARE DESIGN IDEAS Wed 4 th May 2005 P Coe.
Pulser Tool Peter Renkel, SMU. Just a reminder. Need to have some tool for L1Cal diagnostics and debugging, when there is NO beam. What we want to get.
1 G4MICE Malcolm Ellis SciFi Tracker Meeting, KEK Thursday 31st March 2005.
Status: VdM analysis framework Lumi DPG December Monika Grothe (Wisconsin) Jan VdM analysis Framework.
Responsibility on Next Beam Test Jianchun Wang Syracuse University BTeV meeting 06/27/01.
CapMx ® - FORM 3921 – COPY A – ELECTRONIC FILING Tax Year 2012.
RIMS II Online Order and Delivery System Tutorial on Downloading and Viewing Multipliers.
Completing the Form PLAINTIFF’S CLAIM FORM 07A. On the Plaintiff’s Claim (FORM 07A) change your FORM STATUS by clicking once on the white box. A dropdown.
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
Start the slide show by clicking on the "Slide Show" option in the above menu and choose "View Show”. or – hit the F5 Key.
Comparative Law Spring 2003 Professor Susanna Fischer FRENCH CIVIL PROCEDURE March 20, 2003.
DE&T (QuickVic) Reporting Software Overview Term
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
SVX Software Overview Sasha Lebedev VTX meeting 09/07/ SVX Software web page:
This power point presentation will: Define the purpose of a cover letter Describe how to differentiate a cover letter Outline a good structure Describe.
RTSUG 04Feb2014: Beyond Directory Listings in SAS By: Jim Worley.
06/03/06Calice TB preparation1 HCAL test beam monitoring - online plots & fast analysis - - what do we want to monitor - how do we want to store & communicate.
DC12 Commissioning Status GOALS: establish operating conditions, determine initial calibration parameters and measure operating characteristics for the.
Event Data History David Adams BNL Atlas Software Week December 2001.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
Analysis of HF optimization scan data 21 July 2015 Monika Grothe (Wisconsin) 1 21 July 2015 HF optimization scan analysis.
R MoeserCorrelator f2f Meeting1 MCAF (Metadata Capture and Formatting) Rich Moeser.
IR Homework #3 By J. H. Wang May 4, Programming Exercise #3: Text Classification Goal: to classify each document into predefined categories Input:
Marine Core Service MY OCEAN Service Desk and Data Access Web Portal – A Presentation for MyOcean Users Simon J. Keogh Met Office 22 nd September 2009.
MapReduce. What is MapReduce? (1) A programing model for parallel processing of a distributed data on a cluster It is an ideal solution for processing.
SL1Calo Input Signal-Handling Requirements Joint Calorimeter – L1 Trigger Workshop November 2008 Norman Gee.
Online Reconstruction 1M.Ellis - CM th October 2008.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
Integrate, check and share documents Module 3.3. Integrate, check and share documents Module 3.3.
Project 3: Ticket Printer
Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.
Export/Import of TurningPoint Session Files II: Exporting.tpz (Session) Files to csv Files Ready for Import into D2L Tanya Joosten and Gerald Bergtrom.
October Test Beam DAQ. Framework sketch Only DAQs subprograms works during spills Each subprogram produces an output each spill Each dependant subprogram.
Workflows and Data Management. Workflow and DM Run3 and after: conditions m LHCb major upgrade is for Run3 (2020 horizon)! o Luminosity x 5 ( )
1 Project 2: Sorting Cats. Write a C++ console application to read a text file containing information about cats and output the information to the screen.
Post Data. Post Data to AQS 2 Production Tables – Production Status Legend AQS Batch Data Input Flowchart Post End Raw Stats CR Post Staging Tables Production.
1 Project 3: Farey Sequences. 2 Farey Sequences Further details about Farey sequences, and more examples, can be found in the Wikipedia article:
1V EPRI/SPP/Baylor Web Tutorial on Synchrophasor Data Analysis and Event Detection Mack Grady, Andrew Mattei, David Jonsson Baylor University Friday,
BI Offline Algorithm Framework Some Examples of What It Can Do for Us.
Overview of PHENIX Muon Tracker Data Analysis PHENIX Muon Tracker Muon Tracker Software Muon Tracker Database Muon Event Display Performance Muon Reconstruction.
Home Screen Grade Book Setup Before setting up the grade book, we need to setup the preferences. Select Preferences.
Straw VME Data Monitoring M. Koval Straw WG meeting
Online Recruiting System Hiring Manager Presentation This presentation will take about 15 minutes. Click on your mouse to go to the next slide OR click.
Scientific data storage: How are computers involved in the following?
Advanced Higher Computing Science
Procurement Desktop Defense (PD²) Contract Closeout
Customer Online Ordering
CMS Feedback on the High pileup (PU) Fill
Summary: Workshop on CMS Beam Conditions, Radiation Monitoring and Luminosity Systems Oliver Stein, May 2013, CERN.
Tuning AUTCLN for editing
M434/534 Numerical Linear Algebra MATLAB Tutorial Session (Fall 2010)
Project Directions You can use the links on the next slide if you are in Show mode (just hit the F5 key to enter Show mode). Otherwise you can copy and.
Tax Card Online for students
Blackboard Tutorial (Student)
Use this for your Banner Template.
APE EAD3 introduction - DARIAH - Brussels
ATLAS full run-2 luminosity combination
Challenge Guide Grade Code Type Slides
Presentation transcript:

VdM analysis framework status and plans 14 April 2015 Monika Grothe (Wisconsin) 1 14 April 2015 VdM analysis Framework status

Documentation work work In particular VdM framework tutorial: /Tutorial_April2015.pdf 14 April 2015 VdM analysis Framework status2

Preamble The VdM analysis framework proper is ready – Can run with HFlumi and pixel-cluster-counting – Can run with all corrections known from 2012 VdM scans – Can run with all fits used in 2012 Work is needed on the data preparation stage that provides the input data in a format that the VdM framework can handle 14 April 2015 VdM analysis Framework status3

Summary on work on dataPrep stage so far 14 April 2015 VdM analysis Framework status4 For the VdM dry run in Feb, Zhen prepared code that wrote out to csv files this info: – runnum, lsnum, nbnum, timestampsec, timestampmsec, wholeBeamIntensity_1, wholeBeamIntensity_2, avgBunchIntensities_1, avgBunchIntensities_2 will not be needed in a separate csv file because will be part of the data files written for each luminometer – runnum, lsnum, nbnum, timestampsec, timestampmsec, acqflag, beam,ip,scanstatus, plane,step, progress, nominal_separation, read_nominal_B1sepPlane, read_nominal_B1xingPlane, read_nominal_B2sepPlane, read_nominal_B2xingPlane, set_nominal_B1sepPlane, set_nominal_B1xingPlane, set_nominal_B2sepPlane, set_nominal_B2xingPlane – This info was written into 2 different csv files For data, agreement with Zhen what data contents will be written, see next slide

Summary on work on dataPrep stage (II) 14 April 2015 VdM analysis Framework status5 See hypernews posting: il-LumiDaq-commissioning/44/1/1/1/1/1.html il-LumiDaq-commissioning/44/1/1/1/1/1.html Agreement with Zhen on processor output format for BRILDAQ: – per channel aggregated histograms; for more detailed studies – raw, uncalibrated lumi value per lumi nibble (or whatever the readout time unit is during VdM scans) and bcid; this would be the data input for the dataPrep stage

Needed to write the dataPrep code for run-II 14 April 2015 VdM analysis Framework status6 Need to understand from Zhen: – Where can I find the DIP/luminometer data ? Can I copy them over from the online cluster within a certain time window after a VdM scan ? After that time window, where can I find the DIP/luminometer data ? – How many luminometer data files will be written during a VdM scan ? Will all data for a single scan point (i.e. between acquisition flag going to 1 and flag going back to zero) be contained in a single file or more than 1 file ? – How can I identify which luminometer data file belongs to the VdM scan ? – What is the naming convention for data files for each luminometer, meaning how do I find BCM1F as opposed to PLT etc ? – Will the luminometer data files also contain the FBCT (3654 values per beam) and the DCCT (one value per beam) current values ? Can I get some real data files to play around with, preferably examples from each luminometer ? – I have verified that I can read files in hdf5 format.

Needed to write the dataPrep code for run-II (II) 14 April 2015 VdM analysis Framework status7 HFlumi was the only online luminometer and set the standard for run-I Whom should I contact about HFlumi for run-II ? Olga ? Need to understand for HFlumi : – Can we come to a similar agreement as for other BRIL luminometers as to content of data files: data files should contain raw luminosity per nibble (or whatever the readout time unit is for VdM scans) and per bcid ? – Where can I find the HFlumi data ? Can I copy them over from the online cluster within a certain time window after a VdM scan ? After that time window, where can I find the HFlumi data ? – How many HFlumi data files will be written during a VdM scan ? Will all data for a single scan point (i.e. between acquisition flag going to 1 and flag going back to zero) be contained in a single file or more than 1 file ? – How can I identify which HFlumi data file belongs to the VdM scan ? – Will the HFlumi data files also contain the FBCT (3654 values per beam) and the DCCT (one value per beam) current values ? Can I get some real HFlumi data files to look at – Will they also use the hdf5 format or something else ?

Needed to write the dataPrep code for run-II (II) 14 April 2015 VdM analysis Framework status8 Need to understand from Chris: – What is the format of the pixel cluster counting files ? Where can I find them ? What is their naming convention ? How can I identify the PCC data that belong to a single scan point ? Can I please get some example files to work with ?

Summary 14 April 2015 VdM analysis Framework status9 The VdM analysis framework proper is ready Needed now: Write code for the data preparation stage such that data formats of run-II can be handled – The luminometer groups either need to provide data files that contain raw, uncalibrated lumi values per nibble (or per 4 nibbles ?) and bcid or need to provide code that extract the raw uncalibrated lumi values per nibble (or per 4 nibbles ?) and per bcid – I urgently need example input data files