DPA follow-up review, Malargüe, Nov/2000 DPA Data Processing and Analysis Task Follow-up Review Malargüe, November 14, 2000.

Slides:



Advertisements
Similar presentations
31/03/00 CMS(UK)Glenn Patrick What is the CMS(UK) Data Model? Assume that CMS software is available at every UK institute connected by some infrastructure.
Advertisements

EUFORIA FP7-INFRASTRUCTURES , Grant JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.
Kondo GNANVO Florida Institute of Technology, Melbourne FL.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Auger FB review, Malargüe, October DPA – R. Shellard & S. J. Sciutto1 PIERRE AUGER OBSERVATORY Finance Board Review Data Processing and Analysis.
GLAST Science Support CenterJuly, 2003 LAT Ground Software Workshop Science Analysis Tools Design Robert Schaefer – Software Lead, GSSC.
Geant4-based Simulation Status and Plans Dhiman Chakraborty, Guilherme Lima, Jeremy McCormick, Vishnu Zutshi Calorimetry Working Group ALCPG 2004 Winter.
Lucia Silvestris, INFN Bari and CERN/CMC Status Report on CPT Project 23 March 2001, CERN Meeting del Consorzio INFN Status Reports on CPT Project, on.
1 Raw Event : ByteStream implementation Muon Workshop, April 2002 A. Nisati, for the Muon Trigger group.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
ROOT An object oriented HEP analysis framework.. Computing in Physics Physics = experimental science =>Experiments (e.g. at CERN) Planning phase Physics.
S. J. Sciutto (Auger Collaboration) - LISHEP2004, Rio de Janeiro, February International data management: The experience of the Auger Collaboration.
LCIO A persistency framework for LC detector simulation studies Frank Gaede, DESY, IT 4 th ECFA/DESY LC Workshop Amsterdam April 1 st -4 th 2003.
Software Common Task Group Report Akiya Miyamoto KEK ALCPG09 30 September 2009.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
Alexandre A. P. Suaide VI DOSAR workshop, São Paulo, 2005 STAR grid activities and São Paulo experience.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Fermilab User Facility US-CMS User Facility and Regional Center at Fermilab Matthias Kasemann FNAL.
MiniBooNE Computing Description: Support MiniBooNE online and offline computing by coordinating the use of, and occasionally managing, CD resources. Participants:
GRAPES-3 ROOT Framework Pravata K Mohanty Tata Institute of Fundamental Research On behalf of the GRAPES-3 collaboration Workshop on Astroparticle Physics,
GlueX Software Status April 28, 2006 David Lawrence, JLab.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
PHENIX Simulation System 1 December 7, 1999 Simulation: Status and Milestones Tarun Ghosh, Indrani Ojha, Charles Vanderbilt University.
DOE Rev of Run IIb Sep 24-26, 2002  Silicon software and simulation Scope:  Design and/or modify software tools for Run IIb silicon tracker simulation.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
Final Review of ITER PBS 45 CODAC – PART 1 – 14 th, 15 th and 16 th of January CadarachePage 1 FINAL DESIGN REVIEW OF ITER PBS 45 CODAC – PART 1.
NOVA Networked Object-based EnVironment for Analysis P. Nevski, A. Vaniachine, T. Wenaus NOVA is a project to develop distributed object oriented physics.
Status report from T2K-SK group Task list of this group discussion about NEUT Kaneyuki, Walter, Konaka We have just started the discussion.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
A portal interface to my Grid workflow technology Stefan Rennick Egglestone University of Nottingham
Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
19 November 98 1 Jürgen Knobloch ATLAS Computing ATLAS Computing - issues for 1999 Jürgen Knobloch Slides also on:
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
November 2013 Review Talks Morning Plenary Talk – CLAS12 Software Overview and Progress ( ) Current Status with Emphasis on Past Year’s Progress:
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
9-13/9/03 Atlas Overview WeekPeter Sherwood 1 Atlfast, Artemis and Atlantis What, Where and How.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
PHENIX Simulation System 1 January 12, 2000 Simulation: Status for VRDC Tarun Ghosh, Indrani Ojha, Charles Vanderbilt University.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
9/12/99R. Moore1 Level 2 Trigger Software Interface R. Moore, Michigan State University.
1 João Espadanal, Patricia Gonçalves, Mário Pimenta Santiago de Compostela 3 rd IDPASC school Auger LIP Group 3D simulation Of Extensive Air.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Thomas Jefferson National Accelerator Facility Page 1 Overview Talk Content Break-out Sessions Planning 12 GeV Upgrade Software Review Jefferson Lab November.
BESIII Offline Software Development Environment Ma qiumei * Development environment * Configuration & management tool * Software development.
ATLAS Distributed Computing perspectives for Run-2 Simone Campana CERN-IT/SDC on behalf of ADC.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Software Overview 1M. Ellis - CM21 - 7th June 2008  Simulation Status  Reconstruction Status  Unpacking Library  Tracker Data Format  Real Data (DATE)
September 16, 2005VI DOSAR – IFUSP/IFT – Philippe Gouffon Auger Project Computing Needs The Pierre Auger Observatory Auger data and processing Auger data.
1 SLAC simulation workshop, May 2003 Ties Behnke Mokka and LCDG4 Ties Behnke, DESY and SLAC MOKKA: european (france) developed GEANT4 based simulation.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
Management of the Data in Auger Jean-Noël Albert LAL – Orsay IN2P3 - CNRS ASPERA – Oct Lyon.
Online Monitoring : Detector and Performance check
US ATLAS Physics & Computing
Simulation and Physics
Muon Group Software Report
Use Case for controlling the Pierre Auger Observatory remotely
Presentation transcript:

DPA follow-up review, Malargüe, Nov/2000 DPA Data Processing and Analysis Task Follow-up Review Malargüe, November 14, 2000

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task overview Software development and management  Simulation  Reconstruction  Analysis Tools  Software Distribution system  Data Management system Site computing Wide area networking Regional computing centers

DPA follow-up review, Malargüe, Nov/ Data Processing and Analysis DPA Task overview Simulation Shower simulation  AIRES  CORSIKA SD simulation FD simulation  Detector simulation  Electronics simulation  Trigger simulation  Atmosphere simulation Shower detector interface

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview SD Simulation  Detector simulation  Electronics simulation  Trigger simulation Sub-task leader: John Swain Status: Agasim/Billoir simulation operational, are used in conjunction with FDsim Geant4 (Northeastern) in preparation, more flexible, allow inclusion of all physical effects realistically. Status for EA: Simulation of SD + FD, electronic simulation yet not integrated. Very basic trigger simulation only

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview SD Simulation (cont) Resources needed: Integration of electronics + noise + trigger Milestones: Output compatible with CDAS output (prototype at end of January) Inclusion of noise into sim ( ) Simulation of full array with Geant 4 (July)

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview FD Simulation  Detector simulation  Electronics simulation  Trigger simulation  Atmosphere simulation Sub-task leader: Ron Shellard Status : FORTRAN version C++ translation of FD_sim FDVC visualization package Integrated to AIRES ROOT format output Effect of cloud ceiling included Detailed sim of camera To be completed: detailed simulation of shower lateral distribution, atmosphere simulation Trigger sim still disconnected from sim Electronics sim not integrated yet

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview FD Simulation (cont) Status for EA : Simulation of SD +FD operational Need integration with trigger, noise + electronics Resources needed: Help to integrate noise and electronics into sim. As well as trigger. Milestones: Output compatible with CDAS output (prototype at end of January). Inclusion of “realistic noise” to generate reconstructions files (january) Simulation of detailed FD, with imperfections of mirrors + cameras + integration with Geant 4 surface array (July).

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Shower detector interface Sub-task leader: Pierre Billoir Status: Inteface exist in crude form, for connection between shower and SD+FD sim, not yet very user friendly. Status for EA: Operational. Needs some tunning. Using ROOT as intermediate steps Resources needed: Resources are sufficient for the moment Milestones: Operational interface (done) User friendly interface, isolating user from specific details (middle of the year)

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Reconstruction  SD Reconstruction  FD reconstruction  Hybrid reconstruction Sub-task leader: Pierre Billoir with help from Bruce Dawson and Brian Fick Status:  Prototype structures working for SD, FD and Hybrid. Needs a lot of tunning (in particular from the FD part)  Simulation+Reconstruction chain: Example working from Aires to SD+FD  ROOT interfaces with simulation working, but need to be streamlined. Start from pe. counting at detectors  Mixed Fortran and C++  Need isolate structure from algorithms Status for EA: Integrated (SD+FD) will be ready by the end of January

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Reconstruction (cont) Resources needed: Every physicist in collaboration! Milestones: Prototype of integrated SD+ FD (operating with two eyes) operational (end of January) Structure with stereo eyes (middle of the year) User friendly structure, isolating the user from nitty gritty I/O, from sequence of calling routines, focus only on physics arguments and algorithms (optimistically by the end of next year)

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Analysis Tools  Visualization tools  Common Software library  Documentation system Sub-task leader: Luis Prado Jr. Status:  Analysis environment: LINUX (recomend RedHat/Mandrake distribution)  Visualization tools defined: ROOT, QT, OpenGL (Mesa). Some examples worked out (FDVC) seehttp://  Common software library no concrete work yet (needs have still to be identified)  Documentation tools being tested: Doxygen

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Analysis Tools (cont) Status for EA: Some tools defined and prototypes implemented, but still needs lots of work to them tobecome effective. Input of needs from users are necessary. The number of tools will grow with demand. But basic structure is set. Resources needed: Computers experts with experience in Object Oriented Programing to improve the visualization tools. Milestones: Prototype of integrated visualization of SD+FD (middle of the year). ROOT analysis framework for non- experts, to do PAW-like analysis (middle of the year)

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview

Data Processing and Analysis DPA follow-up review, Malargüe, Nov/ DPA Task overview

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Software distribution  Software repository  Software build system  Software distribution system Sub-task leader: Luis Prado Jr. Status: Repositories defined (Regional Computing Centers). Directory structure for Auger is alsocreated. The build system is being created. Status for EA: Prototype distribution system will be operational be the end of January Resources needed: CVS expert to help. Milestones: Prototype available (end of january)

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview ~auger/phy/ ~auger/phy/sim/ ~auger/phy/sim/shw/ ~auger/phy/sim/shw/aires/pro -->./Aires2.2.1/ ~auger/phy/sim/shw/aires/Aires2.2.1/ ~auger/phy/sim/shw/aires/Aires2.2.0/ ~auger/phy/sim/shw/corsika/ ~auger/phy/sim/fd/ ~auger/phy/sim/fd/fdsim/pro -->./FDSim2.1.0/ ~auger/phy/sim/fd/fdsim/FDSim2.1.0/ /bin/ /demos/ /dev/ /doc/ /etc/ /include/ /lib/ /man/ /src/ ~auger/phy/sim/fd/fdsim/FDSim2.0.13/ ~auger/phy/sim/fd/fdsim/FDSim1.9.8/ ~auger/phy/sim/sd/ ~auger/phy/sim/sd/agasim/

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Data Management  Data Handling and storage  Database  Data Acquisition interface Sub-task leader: Status: Status for EA: Resources needed: Milestones:

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Offline monitoring and calibration  SD Detector  FD Detector  Atmosphere monitoring Sub-task leader: Status: Stand by, will derive from detector monitoring and calibration. Status for EA: Resources needed: Milestones:

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Site computing  Local area network  Local server  Computer facilities Sub-task leader: René Bilhaut, Sergio Sciutto Status: LAN defined, local server defined. Status for EA: Facilities for analysis available at the site. Resources needed: Server system (Brazil) Milestones: Installation of server (february), Upgrade, one year latter.

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Wide Area Network Sub-task leader: Status: Report by Sergio Sciutto Status for EA: Resources needed: Milestones:

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview Data Mirror Centers  Europe (IN2P3-Lyon) Sub-task leader: Alain Cordier  USA (Fermilab) Sub-task leader: Lukas Néllen  CERN Sub-task leader: Lucas Taylor (?)  Latin America (Buenos Aires) Sub-task leader: Sergio Sciutto Status: Lyon, Fermilab and CERN are operational. BAires is to be implemented Status for EA: OK! But has to get BA going. Resources needed: Site manager for CERN if Lucas is busy with other things. Milestones: Malargue data sitting at the centers (as soon as it is available!).

DPA follow-up review, Malargüe, Nov/2000 Data Processing and Analysis DPA Task Overview SUMMARY DPA EA WORKSHOP DPA EA WORKSHOP Rio de Janeiro, Rio de Janeiro, 22 to 26 January, to 26 January, 2001