Heather Kelly PPA Scientific Computing Apps LAT was launched as part of the Fermi Gamma-ray Space Telescope on June 11 th 2008.

Slides:



Advertisements
Similar presentations
Maria Grazia Pia, INFN Genova 1 Part V The lesson learned Summary and conclusions.
Advertisements

GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.
GLAST Science Support CenterJuly, 2003 LAT Ground Software Workshop Science Analysis Tools Design Robert Schaefer – Software Lead, GSSC.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test J. Panetta 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope:
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
Collaborative Tools Sharing Knowledge: Media Wiki and other collaborative tools -- Matt Bellis Sharing Code: Distributed version control and social development.
ATLAS Software Kaushik De University of Texas At Arlington based on a tutorial by P. Calafiura (LBNL) LHC Computing Workshop, Ankara May 2, 2008.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
GLAST Science Support CenterAugust 9, 2004 Implementation of the Standard Analysis Environment (SAE) James Peachey (HEASARC/GLAST SSC—GSFC/L3)
Fermi Large Area Telescope (LAT) Integration and Test (I&T) Data Experience and Lessons Learned LSST Camera Workshop Brookhaven, March 2012 Tony Johnson.
R.Dubois Science Tools Development Infrastructure 1/7 GLAST LAT ProjectSoftware Workshop July, SLAC SciTools Infrastructure Scope of Science Tools.
GLAST ADASS 2005 Oct 4 1/21 GLAST Large Area Telescope: LAT Science Analysis Software’s Use of Gaudi & ROOT Heather Kelly NASA Goddard Space Flight Center.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Introduzione al Software di CMS N. Amapane. Nicola AmapaneTorino, Aprile Outline CMS Software projects The framework: overview Finding more.
GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.
Root, GLAST, and IDL Heather Kelly NASA/GSFC Emergent Corporation.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
The Pipeline Processing Framework LSST Applications Meeting IPAC Feb. 19, 2008 Raymond Plante National Center for Supercomputing Applications.
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
ALCPG Software Tools Jeremy McCormick, SLAC LCWS 2012, UT Arlington October 23, 2012.
DANSE Diffraction Software for the SNS: DiffDANSE S.J.L. Billinge Dept. Physics and Astronomy Michigan State University.
T. Burnett, H. Kelly1 GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 9, 2002 SAS software: Code Development Infrastructure Technology.
Org.lcsim Reconstruction and Analysis framework for ILC Detectors Tony Johnson SLAC July 2006.
HERA/LHC Workshop, MC Tools working group, HzTool, JetWeb and CEDAR Tools for validating and tuning MC models Ben Waugh, UCL Workshop on.
Navigation and Ancillary Information Facility NIF Preview of a Web-based GUI Interface to SPICE “WebGeocalc” The NAIF and UCD Teams August 22, 2011 SPICE.
GLAST CHEP 03 March R.Dubois1/17 GLAST Large Area Telescope: Overview of GLAST Offline Software Richard Dubois Stanford Linear Accelerator Center.
Nick Brook Current status Future Collaboration Plans Future UK plans.
Update on the new reconstruction software F. Noferini E. Fermi center INFN CNAF EEE Analysis Meeting - 14/09/20151.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
The BESIII Offline Software Weidong Li Institute of High Energy Physics, Beijing Workshop on the cooperation of PRC-US in HEP 16 June 2006.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois1 SAS Overview Overall Data Flow Sim/Recon –Gleam –Recon rewrites –Calibrations Level.
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
1 Software tools for GLC studies Akiya Miyamoto KEK 20 April, 2004 Representing ACFA-Sim Group
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Java Analysis Studio and the hep.lcd class library Mike Ronan - LBNL Joanne Bogart, Gary Bower, Tony Johnson - SLAC Nick Sinev - Oregon Don Benton - U.
Mantid Stakeholder Review Nick Draper 01/11/2007.
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
SoLID simulation with GEMC Zhiwen Zhao 2015/03/26.
LCIO A persistency framework and data model for the linear collider CHEP 04, Interlaken Core Software, Wednesday Frank Gaede, DESY -IT-
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
GLAST LAT ProjectSAS PDR, Aug. 17, 2001 R.Dubois1 Schedule Balloon Science Tools, Analysis Platforms Calibrations Performance Tuning, Tracking Data Production.
GLAST LAT Project Science Tools - 12 June 2002 T. Burnett 1 The Science Analysis Software Development Environment -- for tools too! T. Burnett.
General requirements for BES III offline & EF selection software Weidong Li.
March 2004 At A Glance ITPS is a flexible and complete trending and plotting solution which provides user access to an entire mission full-resolution spacecraft.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
ATLAS Distributed Computing perspectives for Run-2 Simone Campana CERN-IT/SDC on behalf of ADC.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
GLAST LAT Project DC2 Software Workshop, GSFC, June 27-29, Analytical Objectives for Science Tools for DC2 for DC2 S. W. Digel Stanford Linear Accelerator.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
BESF Framework Development Weidong Li
Analysis Model Zhengyun You University of California Irvine Mu2e Computing Review March 5-6, 2015 Mu2e-doc-5227.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
Root I/O and the Gaudi Framework
MICE event viewer status - Mihailo Savic - CM 45
GLAST Large Area Telescope
Simulation and Physics
Software for Neutron Imaging Analysis
LAT Instrument Operations Center
Use Of GAUDI framework in Online Environment
Analyzing CLAS12 Data David Payette.
Presentation transcript:

Heather Kelly PPA Scientific Computing Apps LAT was launched as part of the Fermi Gamma-ray Space Telescope on June 11 th HEP Meets Astrophysics

Philosophy Reuse code from the community where possible. CLHEP, Geant4, ROOT, FITS, Gaudi, Xerces, MySQL Custom code is made non-Fermi specific when feasible. One central (SLAC) CVS repository Code Documentation via Doxygen User cookbook became our online workbook Flexibility - runtime customization ONE code system for simulation, test data analysis and flight Test, Test, Test, before flight Reviews (PDR, CDR), balloon flight, multiple test beam instruments, data challenges Validation via system tests Support both Linux and Windows

Automated Builds via RM Developer GUI: GoGui GUI Installer

Offline Software GlastRelease ScienceTools C++ Monte Carlo (Geant4) simulation with data-driven geometry and reconstruction software Gaudi framework Output file format: ROOT Utilized as part of the data processing pipeline. Builds via CMT RHEL4-32/gcc 3.4 Windows/VC Wired Event Display All software related to scientific analysis of Fermi LAT data Written in C++ with python interfaces via swig Most is publicly available through the Fermi Science Support Center (GSFC) Builds via SCons RHEL4-32/RHEL4-64/gcc3.4 RHEL5-32/RHEL5-64/gcc4.1 Snow Leopard gcc 4.2 Windows/VC++9 Obeys HEASARC/OGIP standards which implies FITS files and use of parfiles to provide user input.

Why Gaudi? By 1999 (pre-proposal) we had plenty of code: detailed Monte Carlo & prototype reconstruction with ASCII ntuple output. Gaudi provided a framework for our code Clear lines of division Separation of data from algorithms Standard interfaces for algorithms Basic Services: Event loop, Logging Transient Data Store (TDS) Job options, where input ASCII file contains job parameters We utilize the core functions of Gaudi Gaudi and G4 can play nice, despite that both want to control event loop. We usurp G4’s RunManager and instead use our custom interface to G4 to request one event at a time. Using Gaudi led us to CMT.

Why ROOT? ROOT provided more robust file format which could accommodate storage of MC data, as well as digitization and full reconstruction, as well as ntuples. Object Oriented I/O fit our OO design 5 star support Python interface (PyROOT) ROOT has grown substantially since we adopted it. Fortunately, it has remained modular. Certainly a learning curve for those wanting publication quality plots.

Challenges Changing build systems (CMT -> SCons) Maintaining multiple branches of MC/recon in CVS This is also a plus, in that L1 processing is shielded. Aging externals and the need to push ahead to modern versions of compilers and operating systems (OBF, Gaudi…) Brain Drain Successes Testing before flight paid off Early start provided ample time to write code and refactor Technical Writer produced Online Workbook Use of HepRep as our interface to Event Display Distributed, diverse group works well together Instant messaging, EVO, yearly face-to-face meetings In 2005, we had 25 developers spread over 9 time zones.