Simulation Project Overview (Very condensed) Torre Wenaus, BNL/CERN Simulation Project Leader LHCC Comprehensive Review.

Slides:



Advertisements
Similar presentations
Simulation Project Overview Based on the project plan submitted to and approved by the SC2 March 14, 2003 Torre Wenaus, BNL/CERN for the Simulation Project.
Advertisements

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Simulation Project Major achievements (past 6 months 2007)
GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Understand Application Lifecycle Management
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
Hadronic Models Problems, Progress and Plans Gunter Folger Geant4 Workshop, Lisbon 2006.
Geant4 Acceptance Suite for Key Observables CHEP06, T.I.F.R. Mumbai, February 2006 J. Apostolakis, I. MacLaren, J. Apostolakis, I. MacLaren, P. Mendez.
4 November Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Development, validation and.
LCG Applications Area Status Torre Wenaus, BNL/CERN LCG Applications Area Manager US ATLAS Physics and Computing Meeting August 28,
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
Apps Area General and Simulation ‘SC2 Preview’ Torre Wenaus, BNL/CERN LCG Applications Area Manager
LCG Generator, October 16 th 2003 Introduction to the October LCG Generator meeting Paolo Bartalini CERN.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
19 November 98 1 Jürgen Knobloch ATLAS Computing ATLAS Computing - issues for 1999 Jürgen Knobloch Slides also on:
Fabiola Gianotti, 31/8/’99 PHYSICS and SOFTWARE ATLAS Software Week 31/8/’99 Fabiola Gianotti Software requirements of physics groups What should Detector.
Fabiola Gianotti, 30/07/2003 ATLAS HO HB ECal Beam Line CMS LHCb ALICE Goals and plans Examples of work done so far and first results Examples of on-going.
Early Thinking on ARDA in the Applications Area Torre Wenaus, BNL/CERN LCG Applications Area Manager PEB Dec 9, 2003.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
Release Validation J. Apostolakis, M. Asai, G. Cosmo, S. Incerti, V. Ivantchenko, D. Wright for Geant4 12 January 2009.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LHCbComputing Manpower requirements. Disclaimer m In the absence of a manpower planning officer, all FTE figures in the following slides are approximate.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Firmware - 1 CMS Upgrade Workshop October SLHC CMS Firmware SLHC CMS Firmware Organization, Validation, and Commissioning M. Schulte, University.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
Computing Performance Recommendations #10, #11, #12, #15, #16, #17.
Simulation Project Status LHCC Comprehensive Review 2006 Gabriele Cosmo, PH/SFT.
Geant4 CPU performance : an update Geant4 Technical Forum, CERN, 07 November 2007 J.Apostolakis, G.Cooperman, G.Cosmo, V.Ivanchenko, I.Mclaren, T.Nikitina,
Fabiola Gianotti, 13/05/2003 Simulation Project Leader T. Wenaus Framework A. Dell’Acqua WP Geant4 J.Apostolakis WP FLUKA Integration A.Ferrari WP Physics.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
LCG CERN David Foster LCG WP4 Meeting 20 th June 2002 LCG Project Status WP4 Meeting Presentation David Foster IT/LCG 20 June 2002.
Calorimeter Simulation Infrastructure Norman Graf Arlington ‘03.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Simulation Project Status Witek Pokorski, PH/SFT
Physics Performance. EM Physics: Observations Two apparently independent EM physics models have led to user confusion: –Different results for identical.
Last update: 03/03/ :37 LCG Grid Technology Area Quarterly Status & Progress Report SC2 February 6, 2004.
LCG Applications Area Internal Review Response (preliminary and brief version) (main points are on last slide) Torre Wenaus, BNL/CERN LCG Applications.
Simulation Project Setup Status Torre Wenaus, BNL/CERN LCG Applications Area Manager PEB Meeting January 28, 2003.
Atlas Software May, 2000 K.Amako Status of Geant4 Physics Validation Atlas Software Week 10 May, Katsuya Amako (KEK)
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
Projects, Tools and Engineering Patricia McBride Computing Division Fermilab March 17, 2004.
D. Duellmann, IT-DB POOL Status1 POOL Persistency Framework - Status after a first year of development Dirk Düllmann, IT-DB.
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
LCG Persistency Framework Project Boundary Conditions and Overall Schedule Torre Wenaus, BNL/CERN.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
LHCb Simulation LHCC Computing Manpower Review 3 September 2003 F.Ranjard / CERN.
Generator Services planning meeting Witek Pokorski
LCG Applications Area Milestones
Simulation Project Structure and tasks
Physics Validation of LHC Simulations
Summary of the 7th Geant4 Collaboration Workshop
Simulation Framework Subproject cern
Priorities and contents of releases
Simulation and Physics
Simulation Project Structure and tasks
Simulation Project Structure and tasks
Presentation transcript:

Simulation Project Overview (Very condensed) Torre Wenaus, BNL/CERN Simulation Project Leader LHCC Comprehensive Review of the LCG November 25, 2003

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 2 Simulation Project  Generic simulation framework  Generic interface to multiple simulation engines (G4, FLUKA), building on existing ALICE work (VMC)  Incorporates longstanding CERN/LHC Geant4 work  Aligned with and responding to needs from LHC experiments, physics validation, generic framework  FLUKA team participating  Framework integration, physics validation  Simulation physics validation subproject very active  Assess adequacy of simulation and physics environment for LHC and provide the feedback to drive needed improvements  Generator services subproject also very active  Generator librarian; common event files; validation/test suite; development when needed (HEPMC, etc.) Andrea Dell’Acqua John Apostolakis Alfredo Ferrari Fabiola Gianotti Paolo Bartalini

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 3 Project Organization Simulation Project Leader Framework WP Geant4 WP FLUKA integration WP Physics Validation WP Shower Param Generator Services WP Subprojects Work packages Geant4 Project FLUKA Project Experiment Validation MC4LHC

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 4 Generic Framework – Short Term  Immediate priority: support the physics validation activities and test beam simulations  They can make immediate use of an infrastructure able to drive Geant4 and Fluka simulations off of one common geometry  Experiment full detector simulation interest is longer term  Agreed approach: set up a simulation infrastructure based on Geant4 and Fluka via Flugg (which uses the Geant4 geometry)  Existing G4 benchmarks/simulation packages can be run with Fluka with minimum fuss  Begin evaluation of the VMC, comparing functionality with Flugg  Reproduce G4+Fluka+Flugg based simulations with VMC and compare Now – 2004Q2

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 5 Generic Framework – Longer Term  Evaluate the VMC as soon as it provides a fully operational interface to Fluka (expected early in 2004)  Does it fulfill the requirements of the four experiments  Can development be carried forward collaboratively to meet any missing requirements  Need to converge from distinct geometry description mechanisms in the experiments into common geometry models useable by the simulation engines  Point of commonality at this point for the experiments not currently using VMC: they all provide G4 geometry descriptions  Provide mechanism to go from G4 geometry to VMC/ROOT geometry  (Help) develop a link between the ROOT geometry and G4  Initial approach: use a persistent stage, an exchange format, which G4 can write and ROOT can read 2004Q2+

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 6 Generic Framework – Immediate Goals  Complete a G4+FLUKA+FLUGG prototype to meet physics validation needs  Milestone for end 2003  Should have two workers in December (manpower has been major problem) and reasonable chance of delivering close to the milestone date  Establish a persistent exchange format and use it to link G4 and ROOT geometry  Such a format and tool exists, GDML, developed in G4  Development motivated by several uses: debugging, visualization, low-overhead geometry exchange, …  Can be generalized to cover geometry systems other than G4 (e.g. ROOT)  Proposal along these lines will be presented to the SC2 in December  Develop concrete milestones for a 2004 plan reflecting the program just presented  The program described makes maximum use of existing work and makes minimum new manpower demands  But manpower needs are non-zero, and manpower so far in this project has been very close to zero  Will improve in Jan when a new LCG hire will take this project as their first priority

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 7 Geant4  Responsible for CERN/LHC participation in Geant4  Focusing the CERN/LHC effort on LHC priorities  While supporting CERN’s long-standing and valuable role as the international ‘home’ of Geant4 with a leading role in management and infrastructure  Workplan is integrated with overall Geant4 plan  Infrastructure, management, coordination  Hadronic physics  Geometry, tracking, em physics  Employs substantial personnel resources (~9 FTEs)  ~3:3:1 distribution among management/infrastructure, hadronic physics, and the rest (geometry, tracking, em physics)  Strong cooperation with Physics Validation (to which ~1.5 FTEs were transferred)  Improvements, updates based on validation feedback  Working with the generic framework team on architecture and integration  Working on shared infrastructure (testing, portal) with SPI

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 8 The Geant4 ‘big picture’ for LHC users  Largest goals & activities in 2003  Cuts-per-region capability  Robustness improvements for production usage  Particularly geometry, hadronic physics  Support for urgent problems, questions  System testing and releases  Important goals  Development based on new requirements, and refining existing functionality  Investigating feedback from physics comparisons  Improving testing framework; system testing increasingly important  Collecting & analyzing new requirements

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 9 Geant4 Plans for 2004  ATLAS, CMS and LHCb will use Geant4 for production in 2004 (CMS already is)  Project plans reflect this  Support and maintenance  Will require an even larger portion of effort  Balance between development and support/maintenance will shift to the latter in 2004  Responding to feedback, supporting production usage of Geant4 in data challenges  Further improvements  Physics modeling refinements particularly in hadronic physics  Creating an acceptance suite  Pending requirements & requests  Addressing new requirements  for flexible restoring of physics tables  For capability to extend volume ‘stores’

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 10 Fluka Integration  Fluka development proper is not a project activity, though it has recently received strengthened support as a CERN activity  CERN effort supplied to Fluka team (1 FTE, recently started)  Fluka source code will be opened in ~12 months  Participation involves  Integration of Fluka as a simulation engine in the generic framework  FLUGG in the short term, VMC in the longer term  Expect very little new work needs to be done, thanks to existing work done by FLUKA-ALICE  Physics validation of Fluka  Working with the physics validation subproject – simple benchmarks, test beam (slow start due to low manpower)  Activity is led by the CERN-resident Fluka project leader, Alfredo Ferrari

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 11 Physics Validation  Validation based mainly on  Comparisons with LHC detector test beam data  Simulations of complete LHC detectors  “Simple benchmarks”: thin targets, simple geometries  Coordinates a lot of work being done in the experiments, G4, FLUKA  Plus some direct LCG effort to fill high priority cracks (~3 FTEs)  Foster cooperation, coherence, completeness  Output of the project  Certification that simulation packages and framework/environment are OK for LHC physics  Understanding strenghts/weaknesses/uncertainties of G4, Fluka  Contributions to systematic errors of measurements  Recommended optimized physics lists  Simulation benchmark suite for validation and performance monitoring  Final report summarizing the work

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 12 Physics Validation – So Far  Physics validation studies made by experiments revisited  Drive progress with G4 hadronic physics via validation results, e.g.  Improved pion shower profiles in the ATLAS HEC  Pion energy resolution in CMS ECAL+HCAL prototype  ATLAS-validated QGSP list being tried by CMS with test beam data  First cycle of EM physics validation completed  G4 at least as good or better than G3 in testbeam comparisons  First simple benchmark study completed  Predictive power of simulations rest on correct simulation of microscopic interactions: use simple benchmarks to probe this level  Double differential (p,xn) cross sections with G4, Fluka  Continuation of earlier ALICE work  Infrastructure for future benchmark studies established  Monthly meetings presenting and coordinating experiment and project work  Information, results gathering on web page

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 13 Physics Validation – Ongoing and Future Work  Two FLUKA activities starting – requiring the generic framework prototype  Update ATLAS tilecal testbeam simulation  Hadronic interactions in ATLAS pixel testbeam  Second simple benchmark study, pion absorption below 1 GeV  Radiation background studies in LHCb comparing G4, Fluka, GCALOR  Complete revisiting of simulation physics requirements  Complete testing of refined G4 physics lists in all experiments, and complete first cycle of hadronic physics validation  New extensive round of comparison results based on 2003 testbeams  Validation workshop in early 2004  Validation item by item across experiments  E.g. electron energy resolution, hadronic shower profile,…  First version of simulation test and benchmark suite in spring 2004  Physics validation document circa end 2004

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 14 Generator Services  Responsible for  Generator librarian services  Tuning and validation of event generators  Common generator event files, event database  Event storage, interface and particle services  Guided and overseen by the MC4LHC group of generator/physics analysis experts from all four experiments  Active program of broad monthly meetings  Useful input from the large MC generator workshop in July 03  Personnel (1-2 FTEs) from LCG (Russia)  Discussions underway with Italy, Spain on participation

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 15 Generator Services – So Far  GENSER generator package library (public since September)  Now includes all top priority packages  HERWIG, HIJING, ISAJET, PYTHIA  Starting to add the second tier (LHAPDF …)  Common central installation, distribution and documentation  agreed versions, all required patches, LCG-agreed platforms  Under test by ATLAS, ALICE, CMS  ATLAS will start using it soon, initially for one generator  Event storage, interfaces and particle services  Agreement on HepMC as MC truth interface  Agreement on two persistent event formats, specifics to be worked out  Low volume – XMLHEP  High volume production – POOL/ROOT  Common event files, event database  Agreement on MCDB as an event catalog and lookup tool  Tuning and validation  Report on a first HIJING validation being finalized  Bugs uncovered and a patched version provided in GENSER

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 16 Generator Services – Ongoing and Future Work  Continue to populate GENSER with requested generators  Add new generation (C++) generators to GENSER  Support GENSER integration and usage in experiments  Develop proposal for MCDB deployment in LHC environment  Evaluate MC-Tester and JetWeb validation/tuning tools  Finalize formats for generator event storage  Deploy MCDB and a generator event production infrastructure to build standard generator event library  Using experiment production infrastructure  Establish event generator validation framework and program  Find additional contributions to fulfill this program!  Specific milestones are on the web schedule

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 17 Concluding Remarks  Very active program in physics validation delivering results and conclusions  Coordinating and leveraging much experiment work, but with the LCG still filling priority voids in the work  First cycle of EM physics validation completed  Significant hadronic physics improvements driven by testbeam validation and simple benchmark results  Large Geant4 program well aligned towards LHC needs and experiment support, and working closely with other simulation/LCGAA projects  Increasing shift of focus and effort to supporting production application of Geant4 in experiment data challenges  Very active new program in generator services developing a common library of validated generators and planning a common generator event database  Generic simulation framework program now more concretely scoped to make maximal use of existing software and meet the reality of minimal available manpower  With a focus on delivering first, and quickly, for physics validation  Fluka team contributing and eager to contribute more, but Fluka integration/validation feeling effects of slow progress due to low manpower (physics validation, generic framework)

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 18 Simulation Project Major Milestones  2003/6: Generator librarian and first library version in place  2003/9: 1 st cycle of EM physics validation complete  2003/9: GENSER generator package library beta version released  2003/12: Generic framework prototype with G4, FLUKA engines  2003/12: Simulation physics requirements revisited  2004/2: 1 st cycle of hadronic physics validation complete  2004/4: Simulation test and benchmark suite available  2004/5: MCDB beta in production as generator event library  2004/10: First generic simulation framework production release  2004/12: Physics validation document complete

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 19 Pion Shower Profile in the ATLAS HEC  Improvement in pion shower profile after fixing 10% mismatch in σ π OldNew J.P. Wellisch, Physics Validation Mtg True geometry, simplified analysis

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 20 Pion Energy Resolution in CMS Pion Energy Resolution CMS ECAL prototype + HCAL V.D. Elvira, Physics Validation Mtg

Torre Wenaus, BNL/CERN LHCC Review, Nov 2003 Slide 21 A breakdown of simulation manpower Generic simulation framework1.30 Geant48.90 G4 activity subset FTEs of interest: Infrastructure, mgmt (approx)3.20 Hadronic physics effort (approx)4.25 Tracking, biasing, geom (approx)1.25 G4 support subset FTEs of interest: CERN staff4.20 CERN fellows, associates3.25 LCG0.45 Physics validation3.30 Generator services1.30 FLUKA integration0.00 Management0.25 ALICE VMC (non-project)1.60 Total As of Oct 1