Offline Software A. Dobbs CM43 30th October 2015.

Slides:



Advertisements
Similar presentations
MAUS Update Adam Dobbs, MICE Project Board, 16 th April 2015.
Advertisements

Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Data Quality Assurance Linda R. Coney UCR CM26 Mar 25, 2010.
1Malcolm Ellis - Video Conference - 7th December 2006 Data Challenge Report  Disclaimer  Data Challenge definition(s)  Software status u G4MICE u GRID.
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
Online Reconstruction Update Linda R. Coney UCR Dec 17, 2009.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
1Malcolm Ellis - Software Meeting - 31st May 2006 Data Challenge Requirements  First list of requirements, based on Yagmur’s document: u
1 G4MICE Analysis of KEK Test Beam Aron Fish Malcolm Ellis CM15 10th June 2006.
1 G4MICE TOF Reconstruction & KEK Test Beam Analysis Update Aron Fish Tracker Phone Conference May 25, 2006.
Tracker Software Update Adam Dobbs, MICE CM37 7 th Nov 2013.
SOFTWARE & COMPUTING Durga Rajaram MICE PROJECT BOARD Nov 24, 2014.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
Offline Software Summary 1M.Ellis - CM25 - 6th November 2009  Release Schedule  Simulation and Analysis Update  Detector software: u CKOV u EMR u KL.
MdcPatRec Tracking Status Zhang Yao, Zhang Xueyao Shandong University.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Update on the new reconstruction software F. Noferini E. Fermi center INFN CNAF EEE Analysis Meeting - 14/09/20151.
Simulation & Reconstruction Durga Rajaram IIT, Chicago MICE Project Board 29 April 2014.
PHENIX Simulation System 1 December 7, 1999 Simulation: Status and Milestones Tarun Ghosh, Indrani Ojha, Charles Vanderbilt University.
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
Y.Fisyak, BNL - STAR Upgrade workshop, 12/2/ Integrated Tracker – STAR tracking framework of the future update on  status and  perspective IT(TF)
October 8, 2002P. Nilsson, SPD General Meeting1 Paul Nilsson, SPD General Meeting, Oct. 8, 2002 New tools and software updates Test beam analysis Software.
Online Reconstruction 1M.Ellis - CM th October 2008.
25/06/2014A. Dobbs, Tracker Software: How To2 25/06/2014A. Dobbs, Tracker Software: How To3.
Integrated Tracker (progress, status, plans) Y. Fisyak.
LM Feb SSD status and Plans for Year 5 Lilian Martin - SUBATECH STAR Collaboration Meeting BNL - February 2005.
1M. Ellis - NFMCC - 31st January 2007 MICE Analysis.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
1ECFA/Vienna 16/11/05D.R. Ward David Ward Compare these test beam data with Geant4 and Geant3 Monte Carlos. CALICE has tested an (incomplete) prototype.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
M. Ellis - MICE Video Conference - 30th August Software Report Recent progress:Recent progress: –Start of code to read DATE format (two parts) One.
26 Oct 2010PC Physics Requirements of Software from Chris R ~19 Oct. My.
GLAST LAT Project CU Beam Test Workshop 3/20/2006 C. Sgro’, L. Baldini, J. Bregeon1 Glast LAT Calibration Unit Beam Test Status Report on Online Monitor.
Software Tools for Layout Optimization (Fermilab) Software Tools for Layout Optimization Harry Cheung (Fermilab) For the Tracker Upgrade Simulations Working.
MICE CM39 St Catherine’s, Oxford, 26 June 2014 Paul Soler Instrumentation Global Commissioning Plan.
1 Software Workshop Report Malcolm Ellis MICE Video Conference Wednesday 9 th November 2005.
Overview of PHENIX Muon Tracker Data Analysis PHENIX Muon Tracker Muon Tracker Software Muon Tracker Database Muon Event Display Performance Muon Reconstruction.
ch/~bdl/lepc/lepc.ppt 1 MICE Status and Plans Rikard Sandström Université de Geneve International Scoping Study CERN,
STAR Simulation. Status and plans V. Perevoztchikov Brookhaven National Laboratory,USA.
MICE Tracker Software A. Dobbs CM32 9 th Feb 2012.
M. Ellis - MICE Collaboration Meeting - Wednesday 27th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Linda Coney MICO June 6, 2011 MICE Online Report.
Tracking, Computing & other Stuff. Correlation of detector hits The track segments of inner and outer MDCs are matched on Cluster level The track segments.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
MAUS Status and Plans Chris Rogers, ASTeC, Rutherford Appleton Laboratory.
Global Track Matching and Fitting
Beam Energy-Loss measurement
MICE Computing and Software
MICE Step IV Lattice Design Based on Genetic Algorithm Optimizations
MCproduction on the grid
Field-on measurement of multiple scattering
MICE event viewer status - Mihailo Savic - CM 45
ALICE analysis preservation
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
v4-18-Release: really the last revision!
Muon stopping target optimization
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
MICE Collaboration Meeting
Global PID MICE CM43 29/10/15 Celeste Pidcott University of Warwick
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
How to turn on MICE Step IV
Individual Particle Reconstruction
Presentation transcript:

Offline Software A. Dobbs CM43 30th October 2015

Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking Event Viewer Deployment Current Issues and Remaining Step IV Work Offline Software, A. Dobbs, CM43 30/10/2015

MAUS Overview Mice Analysis User Software Provides simulation and reconstruction of the MICE beamline and detectors Map – Reduce based framework (Python wrapping C++) GEANT4 based simulation G4BeamLine upstream beam simulation Data persistency and analysis from ROOT Online data reconstruction Distributed via Bazaar and Launchpad, as well as tarballs of releases Website: http://micewww.pp.rl.ac.uk/projects/maus/wiki Offline Software, A. Dobbs, CM43 30/10/2015

MAUS Development Subgroups Core MAUS and API (A. Dobbs) Geometry and CDB (R. Bayes) Detectors: Global Tracking (M. Uchida) CKOV (A. Liu) Monte Carlo (C. Rogers) EMR (F. Drilesma) Online Reconstruction (C. Rogers) KL (M. Bogomilov) Unpacking (Y. Karadzhov) TOF (D. Rajaram) … … Tracker (P. Kyberd) G4BeamLine (J. Nugent) Offline Software, A. Dobbs, CM43 30/10/2015

Infrastructure API has now been completed (including for Reducers) Only MAUS::Data* objects passed between modules (no string conversions) factor 60 to 75 speed up! Data processed faster than can be taken. Main memory leak now fixed! GRID running working again New online reconstruction framework currently being tested Support for C++11 now enabled (multithreading, smart pointers, auto, lambdas…) Offline Software, A. Dobbs, CM43 30/10/2015

Geometry and CDB CDB geometry has undergone a lot of improvements (TOF, KL, Tracker…), almost ready to replace the legacy as the MAUS default Still finding and resolving bugs Tracker configuration files now accessible from CDB MAUS CDB interface has been updated Almost ready to restart GRID MC running New geometry releases will be announced Offline Software, A. Dobbs, CM43 30/10/2015

Detectors: CKOV Rapid progress thanks to new team member Ao Liu Offline analysis of recent runs Rapid progress thanks to new team member Ao Liu Previously missing MC Digitiser now in place Geometry implementation updated Real data reconstruction producing results Currently not working with Stage4.dat legacy geometry (fix on the way) Offline Software, A. Dobbs, CM43 30/10/2015

Detectors: EMR Position and PID variable code completed – supplies coordinates for hits, muon tracks and decay products, charge deposition and various other PID variables Interface to CDB to access calibration and geometry completed Reducer for Online Reconstruction added Only a few jobs left: New calibration file for single anode PMTs Data quality flag Documentation Currently a break in unit tests, fix on the way Offline Software, A. Dobbs, CM43 30/10/2015

Offline Software, A. Dobbs, CM43 30/10/2015

Detectors: KL Functional, stable code base Reducer in place Online Reconstruction plot from recent running Functional, stable code base Reducer in place Global coordinate system output in place Data quality flag in place Possible bug, very low number of events providing good global coordinate output Offline Software, A. Dobbs, CM43 30/10/2015

Detectors: TOF TOF code stable – longest standing functional detector code Geometry bug recently found and fixed (showed up on comparison with tracker) Global coordinate system output added MC trigger issue remains (needs a person…) e µ  Offline Software, A. Dobbs, CM43 30/10/2015

Detectors: Tracker Tracker tested with full MICE beam for the first time – data looking pretty good Bugs found and fixed e.g. plane ordering in mapping file Tracker configuration files now in CDB, script in MAUS to access them Zero suppression code updated MC noise algorithm updated Efficiency studies underway – initial results look good Kalman fit – in use, but still a number of high priority issues to fix: pz recon not good, 40MeV offset vs TOF calculation sign flips and / or rotations seen in Global Tracking and Event Viewer Online Reconstruction plots in place, more requested Offline Software, A. Dobbs, CM43 30/10/2015

Kalman Fit Residuals: MC and Real Data Pt Pz Resolution vs Pt Offline Software, A. Dobbs, CM43 30/10/2015

Global Tracking Global Tracking: integrate data from all detectors to give best possible track fit and PID through the beamline PID analysis now using data from all detectors except CKOV (on its way) PID framework complete excepting CKOV PID efficiency and purity MC analyses underway Tracking done in two parts: track matching and track fitting Runge-Kutta integration (RK4), which propagates tracks for track matching, now complete, under testing Track matching functional, undergoing optimisation Track fitting method not yet chosen (Kalman and Runge-Kutta contenders) Offline Software, A. Dobbs, CM43 30/10/2015

Event Viewer Original work by V. Blackmore, lots of additional progress under M. Savic Considering various extension options, HepRApp currently favoured Code: https://code.launchpad.net/mice-event-viewer Offline Software, A. Dobbs, CM43 30/10/2015

Deployment MLCR for live online reconstruction (miceonrec02 and miceonrec03) Fast offline reconstruction (miceoffrec01) GRID offline reconstruction and MC simulation Many local university / lab installations, batch clusters, personal laptops… Various Linux flavours: SL6, CentOS, Ubuntu Offline Software, A. Dobbs, CM43 30/10/2015

Current Issues Tracker final fit pz recon #1782 Tracker final fit coordinate system issues, etc Fix CKOV operation with legacy geometry #1781 Fix EMR unit tests Investigate KL very low # of events with good global coordinate output #1779 Finalise CDB geometry, validate by running recon, and make default Investigate slow MC running #1785 Offline Software, A. Dobbs, CM43 30/10/2015

Remaining Step IV Work Finish final tracker track fit Sort out any remaining issues with geometry and coordinate system translations Finish Global tracking code and perform efficiency and purity studies Complete efficiency and performance study of tracker software and publish Finish CKOV work Add data quality check flags for all detectors Complete Event Viewer and possibly add to MAUS as a third party Expand tests (focus on integration tests) Finish new Online Reconstruction framework Fix remaining bugs (e.g. previous slide) Post Step IV will need to consider DEMO (correlated noise, new geometry, …) Offline Software, A. Dobbs, CM43 30/10/2015

Questions Offline Software, A. Dobbs, CM43 30/10/2015

Backup: Possible Future Upgrades Upgrade version control and distribution: move from Launchpad and Bazaar to Git and GitHub (Bazaar going the way of BetaMax and HD DVD) Upgrade build system (SCons slow and less favoured, CMake used by ROOT, GEANT4…) Offline Software, A. Dobbs, CM43 30/10/2015