SFT Group Review Introduction  Mandate  History and Organization  List of Projects  Today Resources September 30th, 20091.

Slides:



Advertisements
Similar presentations
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Advertisements

Simulation Project Major achievements (past 6 months 2007)
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
TILC09, April 2009, Tsukuba P. Mato /CERN.  Former LHCb core software coordination ◦ Architect of the GAUDI framework  Applications Area manager.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
SFT Group Meeting Feb 3 rd, 2006  SFT Group News John Harvey  News from PH management Michael Doser  Report from DTF Forum Andreas Pfeiffer  Main goals.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
The PH-SFT Group Mandate, Organization, Achievements Software Components Software Services Summary January 31st,
Offline Coordinators  CMSSW_7_1_0 release: 17 June 2014  Usage:  Generation and Simulation samples for run 2 startup  Limited digitization and reconstruction.
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
Common Application Software for the LHC experiments NEC’2007 International Symposium, Varna, Bulgaria September 2007 Pere Mato, CERN.
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
LHC Computing Review Recommendations John Harvey CERN/EP March 28 th, th LHCb Software Week.
SFT Group Review: Additional projects, future directions and overall planning  SPI project  (WP8) Multi-core  (WP9) Virtualization  Other projects.
1 PH/SFT Group Meeting John Harvey September 8 th, 2004.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Predrag Buncic (CERN/PH-SFT) WP9 - Workshop Summary
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
SFT Group Meeting July 3rd Group NewsPere Mato 2. Proposal for the new group web infrastructure Yves Perrin 3. Parallelizing Gaudi applications.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
LCG Applications Area Overview Applications Area Internal Review 30 March – 1 April 2005 Pere Mato/CERN.
LHCbComputing Manpower requirements. Disclaimer m In the absence of a manpower planning officer, all FTE figures in the following slides are approximate.
B. Hegner, P. Mato, P. Mendez CERN, PH-SFT Group 1 ST FORUM CERN 28-SEP-2015 THE QUALITY AND TESTING INFRASTRUCTURE OF PH-SFT.
Providing a coherent view of SFT products to potential new users Stefan Roiser PH/SFT.
WLCG Overview Board, September 3 rd 2010 P. Mato, P.Buncic Use of multi-core and virtualization technologies.
Applications Area Status WLCG-LHCC Review 16 th February 2010 Andrea Valassi (CERN/IT-ES) Thanks to Pere Mato and the AA project leaders for their contributions.
The LHC Computing Grid Project (LCG) and ROOT Torre Wenaus, BNL/CERN LCG Applications Area Manager John Harvey, CERN EP/SFT Group Leader
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
JRA2-brainstorming 4/1/2006, Lucie Linssen, slide 1 introduction to CERN in EUDET The CERN PH (physics) department participates in EUDET PH department:
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
SFT Group Meeting May 15th Group NewsPere Mato 2. The CernVM Infrastructure: Insights of a paradigmatic projectCarlos Aguado 3. The new Geant4.
- LCG Blueprint (19dec02 - Caltech Pasadena, CA) LCG BluePrint: PI and SEAL Craig E. Tull Trillium Analysis Environment for the.
Common R&D projects for the LHC upgrade and plans for irradiation facilities Outline: PH common R&D projects Working Group on future irradiation facilities.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
SEAL Project Status SC2 Meeting 16th April 2003 P. Mato / CERN.
November 27, 2001DOE/NSF review of US LHC S&C projects1 The Software and Computing Committee (SC2) in the LHC Computing Grid Project M Kasemann, FNAL.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
SFT Group Meeting October 24th SFT Group NewsPere Mato 2. Geant4 Workshop HighlightsAlberto Ribon 3. CernVM StatusPredrag Buncic 4. Experience.
SFT Summer Student Proposals 9 th February CERN Summer Student Programme  PH has been allocated 91 MS students (SFT quota 6-7)  submit request.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
LCG Applications Area Internal Review Response (preliminary and brief version) (main points are on last slide) Torre Wenaus, BNL/CERN LCG Applications.
News from EP SFT John Harvey FOCUS Meeting – October 3 rd 2003.
Simulation Project Setup Status Torre Wenaus, BNL/CERN LCG Applications Area Manager PEB Meeting January 28, 2003.
My Jobs at CERN April 2015 My Jobs at CERN2
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
Project Work Plan SEAL: Core Libraries and Services 7 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Predrag Buncic (CERN/PH-SFT) CernVM Status. CERN, 24/10/ Virtualization R&D (WP9)  The aim of WP9 is to provide a complete, portable and easy.
The HEP Software Foundation Initiative 5 th September 2014 John Harvey, Pere Mato PH-SFT, CERN.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
1 ALICE Summary LHCC Computing Manpower Review September 3, 2003.
Predrag Buncic (CERN/PH-SFT) Virtualization R&D (WP9) Status Report.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
SFT Group Meeting June 13th 2008
SFT Group Meeting July 13th , 2007
CernVM Status Report Predrag Buncic (CERN/PH-SFT).
Simulation Framework Subproject cern
SEAL Project Core Libraries and Services
Welcome and Introduction Pere Mato (CERN) June 2009
Presentation transcript:

SFT Group Review Introduction  Mandate  History and Organization  List of Projects  Today Resources September 30th, 20091

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s SFT Group Mandate The group develops and maintains common application software for the physics experiments in close collaboration with the PH experimental groups, the IT department and external HEP institutes The majority of the group is directly involved in projects organized as part of the Applications Area of the LHC Computing Grid Project In addition, several group members have direct responsibilities in the software projects of the LHC experiments September 30th, 20092

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s History The SFT group was created in autumn 2002 with software specialists from all LHC experimental groups and strong LCG funding (~7 FTE)  LCG Applications Area and responsibilities on LHC experiments PH-SFT and IT-API groups merge  Decision to bring both teams working in the LCG/AA under a common line management  Merger approved by directorate end February 2003 Manpower table on March 03 September 30th, 20093

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Group Organization The group activities are organized in a number of projects that are part of the Applications Area (AA) of the LHC Computing Grid (LCG) Project  No formal sections to avoid strong compartmentalization The Architects Forum (AF), with representation of each of the LHC experiments and IT, monitors and steers regularly these projects In addition, the Application Area is reviewed by ad-hoc internal reviews and by the LHCC September 30th, 20094

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Applications Area Organization AA Manager Alice Atlas CMSLHCb Architects Forum Application Area Meeting MBLHCC External Collaborations Geant4 ROOT Work plans Quarterly Reports Reviews Resources LCG AA Projects EGEE Chairs Decisions SIMULATION SPI WP1 WP2 ROOT WP3 WP1 POOL WP3 WP2 WP1 Subproject 1 IT-GD IT-FIO September 30th, 20095

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Simulation Project Development and validation of simulation software components. Bringing together developers with physicists working on simulating the real LHC detectors  Geant4. Development, maintenance and support of several modules, including the geometry and a number of physics models. Infrastructure for the collaboration for testing and releasing the software.  Generator Services (Genser). Provides validated MC generators for the theoretical and experimental communities at the LHC.  Physics validation. Comparisons of the main detector simulation engines for LHC (Geant4 and FLUKA) with experimental data. People today (10 FTE)  STAF: J. Apostolakis, G. Cosmo, G. Folger, A. Ribon (LD)  PDAS: M. Kosov, PJAS: V. Ivantchenko, V. Uzhinskiy  FELL: A. Dotti  TECH: V. Diez, G. Camellini September 30th, 20096

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s ROOT Project Development and maintenance of the ROOT framework and set of foundation and utility class libraries that are used as a basis for developing HEP application codes The main components are:  Utilities and extensions to C++, I/O system, interpreters (CINT, Python), data visualization (2D & 3D), graphical user interface, mathematical and data analysis libraries, etc.  PROOF enables distributed data sets to be analyzed in a transparent way. People today (8.5 FTE)  STAF: R. Brun, B. Bellenot, O. Couet, G. Ganis, L. Moneta, A. Naumann (LD), F. Rademakers  FELL: D. Gonzalez  PJAS/STAF: M. Tadel (50%) September 30th, 20097

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s SPI Project Provides a common software development infrastructure and delivers complete and validated set of software components to the LHC experiments  External libraries (open-source and public domain libraries)  Nightly build, testing and integration service  Collaborating tools (Hyper News, Savannah)  Infrastructure in general People (3 FTE)  STAF: Y. Perrin, S. Roiser (LD)  FELL: A. Gaspar September 30th, 20098

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Multi-core R&D (WP8) Parallelization of Software Frameworks to exploit Multi- core Processors  Investigate current and future multi-core architectures  Measure and analyze performance of current LHC physics application software on multi-core architectures  Investigate solutions to parallelize current LHC physics software at application framework level and also investigate solutions to parallelize algorithms Collaboration between LHC experiments, projects such as Geant4, ROOT and IT (OpenLab) People (1.5 FTE)  STAF: V. Innocente (50%)  FELL: E. Smith, D. Kruse September 30th, 20099

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Virtualization R&D (WP9) Portable Analysis Environment using Virtualization Technology  Evaluation of the available virtualization technologies (virtual appliances)  Development the “CernVM” virtual appliance common to all the experiments  Deployment of a read-only distributed file system with aggressive caching schema, as well as the pilot infrastructure to serve the software installation on demand Collaboration between LHC experiments (very strong with ATLAS) People (1.7 FTE)  STAF: P. Buncic (70%)  FELL: C. Aguado  DOCT: J. Blomer September 30th,

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Linear Collider Participation in core software developments for the linear collider physics/detector studies by providing common interfaces and software tools  common solutions for the exchange of detector descriptions, event models, I/O formats and digitization packages  adapt tools developed for LHC available to the linear collider community People (1 FTE)  FELL: A. Münnich September 30th,

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Other Projects and People Direct participation to experiments  CMS: J. Harvey (90%), V. Innocente (50%)  ALICE: F. Rademakers (15%), R. Brun (10%), P. Buncic (20%)  LHCb: P. Mato (10%)  ATLAS: [Dell’Acqua and Gallas transferred to ATLAS in 2007] Hosting a number of people from other Projects  RD51: R. Veenhof  MC-PAD: M. Tsagri Visitors from Geant4, Genser and ROOT collaborations  About 20 people spend some time during the year with us with some subsistence September 30th,

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Communication Channels To/From IT Department  SFT is represented at C5, Linux Certification, [Desktop Forum]  Common projects such as AA/PF, R&D activities, etc. To/From LHC Experiments  Architects Forum (AF), Librarians and Integrators (LIM), AA meetings, G4 Technical Forum, LCG Generator Services project planning, LCG Physics Validation meetings Workshops  R&D workshops, ROOT workshops, G4 workshops Experiments and IT  LCG MB and GDB (as Application Area manager)  Coming soon ITSR meetings September 30th,

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Manpower Facts Staff (17 people)  14.9 FTE on direct SFT projects (RCF+WP) + 1 FTE (PH-AGS)  By project: SIMU 4.0, ROOT 6.7, SPI 2.0, R&D 1.3, MGR 0.9  Fraction of non-staff/total is 45%  Fraction of LD/Staff is 18% Fellows (8 people)  3 baseline, 3 white paper, 1 LCD, 1 EU (MC-PAD) Averages PDAS ~1, FELL ~3, TECH ~2, DOCT ~1 Ratio of total FTEs today as compared to 2003 is 65% September 30th, Data in APT not really usable 

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Material Resources Group exploitation budget: 420 kCHF  ~60% subsistence (PJAS, TECH, Visitors,…)  ~20% travel (workshops, conferences, etc.)  ~12% investments WP8 exploitation budget: 50 kCHF WP9 exploitation budget: 80 kCHF September 30th,

Additional slides September 30th,

SFT S o F T w a r e D e v e l o p m e n t f o r E x p e r i m e n t s Group summary expenses – 2009 Allocations 2009 : SFT: 420 kCHF WP8, WP9: 50, 80 kCHF September 30th,