Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham1 Software Review Calice Technical Board Open Session Comments on status relative to Feb. 2005 TB.

Slides:



Advertisements
Similar presentations
17 Sep 2009Paul Dauncey1 US DHCAL integration with CALICE DAQ Paul Dauncey.
Advertisements

HEP Data Sharing … … and Web Storage services Alberto Pace Information Technology Division.
1 © 2006 by Smiths Group: Proprietary Data Smiths Group Online Performance Review Tool Training.
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
INFSO-RI Enabling Grids for E-sciencE Update on LCG/EGEE Security Policy and Procedures David Kelsey, CCLRC/RAL, UK
1 Calice Meeting 20/9/06David Ward What did we learn from DESY 2005 run? DESY run May CERN run August Data/MC comparisons for ECAL.
Simulation Project Major achievements (past 6 months 2007)
31 May 2007LCWS R&D Review - Overview1 WWS Calorimetry R&D Review: Overview of CALICE Paul Dauncey, Imperial College London On behalf of the CALICE Collaboration.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
1Calice-UK Cambridge 9/9/05D.R. Ward David Ward Compare Feb’05 DESY data with Geant4 and Geant3 Monte Carlos. Work in progress – no definitive conclusions.
Lecture 2b: Software Project Management CSCI102 - Introduction to Information Technology B ITCS905 - Fundamentals of Information Technology.
Geant4-based Simulation Status and Plans Dhiman Chakraborty, Guilherme Lima, Jeremy McCormick, Vishnu Zutshi Calorimetry Working Group ALCPG 2004 Winter.
Calice Meeting DESY 13/2/07David Ward Guidelines for CALICE presentations Recently approved by the Steering Committee.
Runtime alignment system SOFTWARE DESIGN IDEAS Wed 4 th May 2005 P Coe.
An Introduction to the Hennepin County Hennepin County GIS Technical Advisory Group (eGTAG) 10/20/2009.
1Calice-UK WP1 review 9/9/05D.R. Ward David Ward WP1 covered the completion of the original Calice program as proposed in 2002, i.e. Beam tests (electrons.
When will our bugs be fixed? When will our new features be added? When will the next release come out? Is my server up-to-date? Users Committers Program.
The B A B AR G RID demonstrator Tim Adye, Roger Barlow, Alessandra Forti, Andrew McNab, David Smith What is BaBar? The BaBar detector is a High Energy.
1 Calice UK Analysis Meeting 23/1/07David Ward/Nige Watson UK Analysis tasks (WP1) David Ward Nige Watson TexPoint fonts used in EMF. Read the TexPoint.
1Calice NIU s/w review March D.R. Ward David Ward Recent Technical Board review included software. Summarise some of the main conclusions… Monte.
29 Mar 2007Tracking - Paul Dauncey1 Tracking/Alignment Status Paul Dauncey, Michele Faucci Giannelli, Mike Green, Anne-Marie Magnan, George Mavromanolakis,
1 Calice UK s/w meeting RHUL 24/1/06D.R. Ward David Ward Have previously reported on comparison of Feb’05 DESY data with Geant4 Monte Carlos. Issues with.
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
1 Calice UK Meeting 03/11/06David Ward/Nige Watson Analysis tasks David Ward Nige Watson TexPoint fonts used in EMF. Read the TexPoint manual before you.
Reports from DESY Satoru Uozumi (Staying at DESY during Nov 11 – 25) Nov-21 GLDCAL Japan-Korea meeting.
06/03/06Calice TB preparation1 HCAL test beam monitoring - online plots & fast analysis - - what do we want to monitor - how do we want to store & communicate.
Status of Hall C 6 GeV Analysis Software Robust Fortran/CERNLIB code, “ENGINE”, for analysis of HMS/SOS coincidence and single arm experiments that has.
1 G A A new Document Control System “A new system to manage LIGO documents” Stuart Anderson Melody Araya David Shoemaker 29 September, 2008
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Access Across Time: How the NAA Preserves Digital Records Andrew Wilson Assistant Director, Preservation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
8-Jul-03D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security (Report from the LCG Security Group) RAL, 8 July 2003 David Kelsey CCLRC/RAL, UK
1 Calice UK Meeting 27/03/07David Ward Plans; timescales for having analysis results for LCWS Status of current MC/data reconstruction Reconstruction status;
October 8, 2002P. Nilsson, SPD General Meeting1 Paul Nilsson, SPD General Meeting, Oct. 8, 2002 New tools and software updates Test beam analysis Software.
Knowledge Management Platform Communities of Practice User Guide for CoP users Copyright © 2010 Group Technology Solutions. All Rights Reserved.
Grid Security Vulnerability Group Linda Cornwall, GDB, CERN 7 th September 2005
Nigel Watson / BirminghamCALICE ECAL, UCL, 06-Mar-2006 Test Beam Task List - ECAL  Aim:  Identify all tasks essential for run and analysis of beam data.
19 July 2007Paul Dauncey - Software Review1 Preparations for the Software “Review” Paul Dauncey.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.
Firmware - 1 CMS Upgrade Workshop October SLHC CMS Firmware SLHC CMS Firmware Organization, Validation, and Commissioning M. Schulte, University.
1ECFA/Vienna 16/11/05D.R. Ward David Ward Compare these test beam data with Geant4 and Geant3 Monte Carlos. CALICE has tested an (incomplete) prototype.
CALICE ScECAL software development S. Uozumi Sep-3 rd 2010 Japan-Korea joint workshop.
Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.
Simulation of the CALICE Test Beams with MOKKA Fabrizio Salvatore Royal Holloway University of London.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Discussion session José Repond Argonne National Laboratory CALICE Collaboration Meeting DESY, Hamburg, Germany March 20 – 22, 2013.
Preparation for CERN TB - Erika Garutti1 Preparation for CERN test beam H6 test beam area in Prevessin.
Mokka, main guidelines and future P. Mora de Freitas Laboratoire Leprince-Ringuet Ecole polytechnique - France Linear collider Workshop 2004, Paris.
ScECAL Beam FNAL Short summary & Introduction to analysis S. Uozumi Nov ScECAL meeting.
Remote Institute Tasks Frank Filthaut 11 February 2002  Monte Carlo production  Algorithm development  Alignment, calibration  Data analysis  Data.
Predrag Buncic CERN Future of the Offline. Data Preparation Group.
Kati Lassila-Perini EGEE User Support Workshop Outline: – CMS collaboration – User Support clients – User Support task definition – passive support:
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
Software and Computing Status of Software development and MC production OpRoot-Fedra MC interface New CVS server Computing resources at CERN: present and.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
“Discovering institutions that work for poor people” APPP Sharepoint training 30 July – 1 August 2008: CDD, Accra, Ghana “Discovering institutions that.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
Analysis Model Zhengyun You University of California Irvine Mu2e Computing Review March 5-6, 2015 Mu2e-doc-5227.
1 Calice TB Review DESY 15/6/06D.R. Ward David Ward Post mortem on May’06 DESY running. What’s still needed for DESY analysis? What’s needed for CERN data.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
Configuration Management and Prince2
Systems Analysis and Design
THE STEPS TO MANAGE THE GRID
ProtoDUNE SP DAQ assumptions, interfaces & constraints
Technical Board – DCAL Software
ATLAS DC2 & Continuous production
Agenda SICb Session Status of SICb software migration F.Ranjard
Presentation transcript:

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham1 Software Review Calice Technical Board Open Session Comments on status relative to Feb TB Review David Ward Nigel Watson

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham2 Monte Carlo – Feb Recommendation Each detector group will have to be responsible for and maintaining the geometrical description of their detector within Mokka and for implementing the digitization (noise, crosstalk etc.) as and when necessary. We recommend the use of the DigiSimframework within MARLIN for digitization. Although detailed work may need to await the arrival of data, each group should consider whether the information stored by Mokka is sufficient for their needs. Status Not aware of any progress or any real problems. Main developments in Mokka have been directed towards global detector design studies; only significant change for test beam has been implementation of drift chambers by new collaborating institute (F.Salvatore, RHUL), already used in some test beam studies

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham3 Monte Carlo – Further remarks  RHUL, willing to simulate scintillators for next run  Similar ad hoc modelling required in future with different beam lines  Geant3 implementation of test beam by Alexei Raspereza  Useful alternative to Mokka, need to consider medium term plan for support  Even with limited data so far analysed, demonstrably sensitive to features of MC models  Need to get this aspect under control before HCAL run  Restock portfolio of other MC models  Consider alternative codes e.g. MCNPx (LANL), “Fluka style” input (suggestion Vasily Morgunov)  Revive standalone Fluka simulations (NKW), possibility of transferring this as working package to V.M./student at DESY

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham4 Analysis Framework – Feb Recommendation Status Progress slow, but finally ~20 ECAL runs were converted at DESY around the end of August. Believe the same software framework is being used for the HCAL module tests. Work on the lightweight “intelligent” decoding of the data into LCIO objects needs to start expeditiously (action P.D.Dauncey, G.Mavromanolakis, R.Pöschl, D.R.Ward). Aim to agree on data content by NIU Calice meeting, and have a first version of code by end March. We recommend the use of MARLIN as the analysis framework. Individual processing tasks, such as mapping, calibration, alignment, histogramming, should be packaged as separate MARLIN processors.

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham5 Database – Feb Recommendation Status DESY have set up a server machine (flccaldb01.desy.de) to hold the database. Can access from remote sites, after IP address registered at DESY (so far as I know, only Cambridge and Imperial have done so). This works. The use of the LCCD package to access a MySQLdatabase in the LCIO/MARLIN framework is recommended. A database manager will need to be appointed.  However, to keep learning curve for analysis as gentle as possible, ideally avoid routine access to database for “users”. Possible simple scheme would be to implement trigger status bits into event header – satisfactory for most users, more detailed studies closer to the data would need (+ be able to get) access as necessary  Definition of contents of database? Include e.g. conditions data such as readout of 3D stage

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham6 [R.Poeschl]

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham7 Data Storage – Feb Recommendation Status This has been done for the converted data. Files for runs have been registered in the Grid so far. Unless you have a DESY account, need to use Grid tools to access data (need to be member of the “calicevo”). Details announced to Calice-SW mailing list, 10-Oct by Roman P. Have managed (since yesterday) to copy the single file using grid tools, run analysis, accessing database etc. The system is just about there now! The data (native, raw LCIO and processed LCIO) will be stored in the dCachemass storage at DESY. All members of Calice need to be informed how they can access to these data. The preferred method of access being Grid-ftp. Write access needs to be restricted to a very small group of experts (to be identified)

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham8 Calice-SW Membership List members freel post, non-members only distributed after owner approval Web archive of postings [ addresses removed from web version of talk]

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham9 Data Storage – Further Remarks  Actions:  Facilitate entry to grid usage for Calice members  Make use of facilities in addition to data retrieval  Simulation  Data analysis  Conversion  Makes grid overhead more worthwhile for end users (cf. sftp)  Need a working example (for guinea pig testers), then open up  Investigate data storage logistics for TB if at CERN – someone to follow up, easier if we have CERN member of Calice??

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham10 Code Sharing – Feb Recommendation Status The data conversion code is all there; not much else yet. Perhaps because there’s not much to put there? Authors of code are strongly encouraged to store their work at the CVS repository recently established at DESY-Zeuthen.  Remember: after writing code, it will only be used/accepted if easy to do so, available, etc.  Single Marlin processor can be 1.cc, 1.hh, +readme +demo steering file  Code has to be “fit for purpose” – remember this is short- lived test beam project  If you need help with making your code available, please contact:

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham11 Code Sharing [G.Gaycken] [A.Raspereza] [G.Mavromanolakis] [C.Ainsley]

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham12 Documentation – Feb Recommendation This should remain an aspiration, which we will probably never achieve. We do at least have a Calice software web page. Documentation needs to be improved, and a central point of access to documentation (e.g. a web page) should be established. Status  Actions  Write a pedestrians guide, Calice-TB-HOWTO  Modifications to this Calice-SW web page, to  Signup to calice-sw mailing list -  Information sharing: use the mailing list  There is NO collaboration wide mailing list  Suggest that we set one up, a la calice-sw, with web archives  Proposet we use it, frequently (e.g. TB/SB news, collaboration wide requests for speakers, TB shifts, etc.)

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham13 SummarySummary  We just about have a working system along the lines recommended in February  DRW may be almost the only user at present outside DESY  George has been working with his independent system (most of which has been wrapped in a Marlin framework) and Götz has his own variant.  Would be more productive to converge here  “Natural” solution is to submit individual, independent processors to Calice CVS, allow users choose the parts of packages they need  Main risk – people won’t know how to use the tools when we next start taking data.  Too much expertise resides with one (very good) person (Roman)  We need people to look at the data as soon as possible after they have been recorded, in case of mistakes  Having much improved communication would help here  They are shared data, joint responsibility to ensure high quality  If we are all kept informed about data taking it becomes easier to contribute from afar.

Calice TB Review, 14-Oct-2005Nigel Watson / Birmingham14 CommentsComments  Need to ensure data conversion to LCIO for hcal is ready well in advance of combined TB at CERN  Useful to have systematic data storage at DESY dCache, but more benefit if running jobs on grid, otherwise just a complicated version of sftp  Need to ensure that scintillators planes are included in Mokka before test beam  Clear that would benefit from more people looking at data  Need to make s/w system pragmatic for data analysis  Remember that all of this is relatively short-lived code  “Fit for purpose” but no more