Software Summary 1M.Ellis - CM23 - Harbin - 16th January 2009  Four very good presentations that produced a lot of useful discussion: u Online Reconstruction.

Slides:



Advertisements
Similar presentations
90 DAY PLAN.
Advertisements

User Board - Supporting Other Experiments Stephen Burke, RAL pp Glenn Patrick.
10 Aug 2010PC Analysis PC Schedule Tuesdays fortnightly Provisional dates 10 Aug 24 Aug 7 Sept 21 Sept But it’s holiday season so they may vary –
1 Simulation Status/Plans Malcolm Ellis Sci Fi Tracker Meeting Imperial College, 10 th September 2004.
1Malcolm Ellis - Tracker Meeting - 18th May 2006 Reconstruction Plans  Staged process of building up Reconstruction over the rest of this year  Will.
Irish Butterfly Monitoring Scheme Tutorial for online system
Introduction  Jobcentre Plus is introducing a new service called Employer Direct online  You can post and manage your jobs 24 hours a day, 7 days a.
Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Tracker Software 1M.Ellis - CM23 - Harbin - 15th January 2009  Four key areas that currently need some work: u Digitisation u Decoding files u Unpacking.
M. Bonesini - VC TOF status M. Bonesini Sezione INFN Milano Bicocca.
Data Quality Assurance Linda R. Coney UCR CM26 Mar 25, 2010.
1Malcolm Ellis - Video Conference - 7th December 2006 Data Challenge Report  Disclaimer  Data Challenge definition(s)  Software status u G4MICE u GRID.
1 Configuration Database David Forrest University of Glasgow MICO Meeting 13/10/2008
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
1 Configuration Database Review David Forrest University of Glasgow RAL :: 1 st June 2009.
CM23 Harbin January 2009TOF Reconstruction1 TOF reconstruction Mark Rayner CM23 Harbin.
Computing Panel Discussion Continued Marco Apollonio, Linda Coney, Mike Courthold, Malcolm Ellis, Jean-Sebastien Graulich, Pierrick Hanlet, Henry Nebrensky.
Online Reconstruction Update Linda R. Coney UCR Dec 17, 2009.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
Software Parallel Intro 1M.Ellis - CM23 - Harbin - 15th January 2009  Focus this CM continues to be on needs for analysis of data and use of G4MICE online.
Alain Blondel MICE VC 9 september 2010 Spokesmouse report o VC 22nd April o 12th-13th May posters for IPAC (Vittorio Palladino) o VC 20th May o IPAC May.
Henry Nebrensky – CM26 – 24 March 2010 Computing Panel Discussion: SSH Bastion Henry Nebrensky Brunel University 1.
CM23 Harbin January 2009TOF Emittance Measurement1 Beam Characterization with the TOFs Mark Rayner CM23 Harbin.
CM26 March 2010Jean-Sebastien GraulichSlide 1 Online Summary o The heplnw17 case o DAQ o CAM o Online Reconstruction o Data Base o Data Storage Jean-Sebastien.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
Henry Nebrensky - MICE VC May 2009 MICE Data and the Grid 1  Storage, archiving and dissemination of experimental data: u Not been a high priority.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
1 G4MICE Design Iteration Malcolm Ellis MICE Video Conference 21 st April 2004.
Offline Software Summary 1M.Ellis - CM25 - 6th November 2009  Release Schedule  Simulation and Analysis Update  Detector software: u CKOV u EMR u KL.
Grid Update Henry Nebrensky Brunel University MICE Collaboration Meeting CM23.
1 Instant Data Warehouse Utilities Extended (Again!!) 14/7/ Today I am pleased to announce the publishing of some fantastic new functionality for.
Nick Brook Current status Future Collaboration Plans Future UK plans.
Configuration Database MICE Collaboration Meeting 28, Sofia David Forrest University of Glasgow Antony Wilson Science and Technology Facilities Council.
New perfSonar Dashboard Andy Lake, Tom Wlodek. What is the dashboard? I assume that everybody is familiar with the “old dashboard”:
1M. Ellis - MICE Tracker PC - 19th October 2007 Station QA Analysis (G4MICE)  For details of software see my previous talk here: u
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
ALMA Archive Operations Impact on the ARC Facilities.
1M. Ellis - MICE VC - 1st November 2007 Cosmic Ray Test Preparations  The cosmic ray test was initially planned to be held in R12, but this proved to.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
Configuration Database David Forrest 15th January 2009 CM23, HIT, Harbin.
Mtivity Client Support System Quick start guide. Mtivity Client Support System We are very pleased to announce the launch of a new Client Support System.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
Online Reconstruction 1M.Ellis - CM th October 2008.
MICE CM January 2009Jean-Sébastien GraulichSlide 1 Detector DAQ Issues o Achievements Since CM23 o Detector DAQ o Trigger o Online Software o Front End.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
Henry Nebrensky – MICE DAQ review - 4 June 2009 MICE Data Flow Henry Nebrensky Brunel University 1.
Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
G4MICE’s DataQualityCheck application G4MICE’s DataQualityCheck application: Preliminary thoughts Mark Rayner 23 rd February 2010.
LHCbDirac and Core Software. LHCbDirac and Core SW Core Software workshop, PhC2 Running Gaudi Applications on the Grid m Application deployment o CVMFS.
1 Software Workshop Report Malcolm Ellis MICE Video Conference Wednesday 9 th November 2005.
Software Overview 1M. Ellis - CM21 - 7th June 2008  Simulation Status  Reconstruction Status  Unpacking Library  Tracker Data Format  Real Data (DATE)
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
Configuration Database David Forrest University of Glasgow.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Online – Data Storage and Processing
MICE Computing and Software
Bulk production of Monte Carlo
Database High-Level Overview
Software Session Introduction
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Data Management and Database Framework for the MICE Experiment
SRM2 Migration Strategy
Global PID MICE CM43 29/10/15 Celeste Pidcott University of Warwick
Offline framework for conditions data
Presentation transcript:

Software Summary 1M.Ellis - CM23 - Harbin - 16th January 2009  Four very good presentations that produced a lot of useful discussion: u Online Reconstruction u TOF Reconstruction u Database u GRID  Did not hear about the control room UI as Tom has had to stop working on that.  Focus continues to be on the code needed for online reconstruction/analysis.  Will be re-starting the software phone meetings as weekly 30 minute calls, most likely afternoon UK time – contact me if you wish to attend and have preferences or times to avoid!

Online Reconstruction – D. Adey  Started by replicating Online Monitoring Histograms in G4MICE.  This tests the unpacker (common to both) and the G4MICE specific code that holds the hits.  TDCs working, fADCs almost working.  GUI allows easy selection of histograms.  Once fADCs are working and comparison with OM complete, focus will move to use of actual reconstruction (e.g. TOF).  Reconstruction will result in points, tracks, emittance, etc which will also be stored as histograms with a similar GUI.  Expect a request from David for what should be shown! 2M.Ellis - CM23 - Harbin - 16th January 2009

Online Reconstruction – D. Adey 3M.Ellis - CM23 - Harbin - 16th January 2009 Select Channel by Name Draw

TOF Reconstruction – M. Rayner  New applications in development (but already useful!): u TofMonitor s Space point/time-of-flight/momentum reconstruction at a glance s Are all the PMTs broken and how/correctly cabled? u TofCalibration s Calibrating the TOFs for cable length and testing this calibration s Plane-plane time-walk and station-station calibration in development u TofEmittance s Plot x-x’ and y-y’ trace space s Calculate emittance  These are uploaded to G4MICE and easy to use u Histograms automatically thrown to the screen and fill up as you run u How to run them: s./Executable cards.in datafiles –./TofCalibration cards.in M.Ellis - CM23 - Harbin - 16th January 2009

TOF Reconstruction – M. Rayner 5M.Ellis - CM23 - Harbin - 16th January 2009 First MICE Muons!

Database – D. Forrest  See David’s talk for more technical details.  Key points: u Development versions of the DB have been setup on heplnw17. u Currently awaiting a fix to a network problem and then will start testing access of the DB remotely through a G4MICE application. u Considering the implementation of an API as an interface between the DB and users (G4MICE, DAQ, Web, GRID, etc). u MICE Note 228 released after CM22. u It is deliberately provocative, but so far only one response (thanks JSG!!!). 6M.Ellis - CM23 - Harbin - 16th January 2009

Database – D. Forrest  Questions that still have no answers and some new questions: u What form will detector calibrations take (the TOF was discussed in the parallel session, but so far no news from CKOV, KL or EMR). u Will you want to query the database? u If so, what kinds of information are you likely to want? u As stated in past meetings, consider the kinds of things you would like to do with the MICE data: s What information do you think you will need? s Where do you think you will get it from? u If you aren’t sure what the correct answer is to the second question, get in touch with us, because you may have discovered something that we have not considered!  Please read MICE Note 228 and comment! 7M.Ellis - CM23 - Harbin - 16th January 2009

GRID – H. Nebrensky  10 UK Sites + Sofia support MICE.  9 UK Sites + RAL Tier 1 provide storage for data.  Job submission: 2 each at Glasgow & RAL.  Even though we don’t need to ask for resources yet, does everyone know who their local point of contact is when the time comes? And how long does it take?  G4MICE is now in regular use (~1000 simulation jobs a day).  MICE Note on submitting jobs by D. Forrest coming soon.  GRID interface to CASTOR at RAL has been deployed.  Space unused – we currently have 1 TB of disk and 5 TB tape.  Won’t ask for more until we can actually use it.  Long term request is for the same in disk and 100 TB tape.  u Route any requests through Paul Kyberd. 8M.Ellis - CM23 - Harbin - 16th January 2009

GRID – H. Nebrensky  File Catalogue: u Not enough time to go into this in detail. u We need to agree on a consistent namespace for the file catalogue that will allow us to store and retrieve files on GRID storage. u Henry has proposed a concept that was discussed in the software parallel session. u If you are interested, please read his talk and get in touch with us. u We will finalise this in the coming weeks.  Some more questions for the audience: u What calibration data (other than that taken as part of normal MICE physics data taking) will be taken? u What metadata will be needed for analysis? (i.e. What kinds of things will you like to be able to use to select a run or runs for a given analysis? u Momentum, step, emittance, MC or data, version of simulation,...??? u Does anyone have any preferences, views or suggestions as to where this meta-data should be stored? If so, read Henry’s talk and contact us!  Henry’s conclusion: “My laptop battery is flat” is no longer an excuse for not getting some simulation/analysis done! 9M.Ellis - CM23 - Harbin - 16th January 2009

Schools and Workshops  So far, I have the impression that those people who have attended and completed the software schools have found them to be very useful.  I am happy to continue running them if there are more people who are interested in performing simulations and/or analysis of MICE data.  The software group plans to continue running informal software workshops (similar to the last one held at RAL when TOF1 arrived) to focus on specific objectives every couple of months. 10M.Ellis - CM23 - Harbin - 16th January 2009

Conclusion: Major Open Issues  Testing and Releases: u We have not yet had a proper release cycle as originally planned. u The lack of testing and regular incremental releases has cost us a lot of time in the past few years. u If I can get a volunteer to help me with this process, I think we can make it work, which will be a big help to the software team.  Service Tasks: u There are a lot of important tasks that need to be done in order to support the end goal (i.e. Physics), however I am finding it increasingly difficult to find people who will do this work. u I think this is mostly because the vast majority of the software work is being done by a small set of students and post-docs, and their advisors/managers don’t want them “wasting time” on something that is not physics. u The problem is that without a lot of these things, the physics will never happen. u Mark’s results are an example of how it should work. He did a lot of important low level work that allowed him to write TOF reconstruction code which has produced the exciting results we have seen at this meeting. 11M.Ellis - CM23 - Harbin - 16th January 2009