CPT Week, November 2002 4, 2002 Lassi A. Tuura, Northeastern University Core Framework Infrastructure Lassi A. Tuura Northeastern.

Slides:



Advertisements
Similar presentations
Physicist Interfaces Project an overview Physicist Interfaces Project an overview Jakub T. Moscicki CERN June 2003.
Advertisements

SEAL Developers 3, 2003 Lassi A. Tuura, Northeastern University CMS Components Plug-in Manager Lassi A. Tuura Northeastern University,
Ideas on the LCG Application Architecture Application Architecture Blueprint RTAG 12 th June 2002 P. Mato / CERN.
Vincenzo Innocente, BluePrint RTAGNuts & Bolts1 Architecture Nuts & Bolts Vincenzo Innocente CMS.
Technical Architectures
Core Application Software Activities Ian Fisk US-CMS Physics Meeting April 20, 2001.
GridScape Ding Choon Hoong Grid Computing and Distributed Systems (GRIDS) Lab. The University of Melbourne Melbourne, Australia WW Grid.
Usage of the Python Programming Language in the CMS Experiment Rick Wilkinson (Caltech), Benedikt Hegner (CERN) On behalf of CMS Offline & Computing 1.
Software Engineering Module 1 -Components Teaching unit 3 – Advanced development Ernesto Damiani Free University of Bozen - Bolzano Lesson 2 – Components.
ACAT Lassi A. Tuura, Northeastern University CMS Data Analysis Current Status and Future Strategy On behalf of CMS.
CHEP `03 March 24, 2003 Vincenzo Innocente CERN/EP CMS Data Analysis: Present Status, Future Strategies Vincenzo.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse 2.
Off-line Graphics Tools Ianna Osborne Northeastern University.
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
Zubanov Alexei, 2006 Aug 07 – Sep 28 QtROOT package extension with Coin3D lib.
Ianna Gaponenko, Northeastern University, Boston The CMS IGUANA Project1 George Alverson, Ianna Gaponenko, and Lucas Taylor Northeastern University, Boston.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
SWE 316: Software Design and Architecture – Dr. Khalid Aljasser Objectives Lecture 11 : Frameworks SWE 316: Software Design and Architecture  To understand.
Introduzione al Software di CMS N. Amapane. Nicola AmapaneTorino, Aprile Outline CMS Software projects The framework: overview Finding more.
IX International Workshop on Advanced Computing and Analysis Techniques in Physics Research KEK, Tsukuba, December 2003
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
LC Software Workshop, May 2009, CERN P. Mato /CERN.
Outline What is IGUANA IGUANA and Other Projects Architecture Framework ORCA Visualisation IGUANA at D0 GEANT4 Visualisation OSCAR Visualisation DDD Visualisation.
CPT Week, Apr Lassi A. Tuura, Northeastern University Software Quality with Ignominy Lassi A. Tuura Northeastern.
SEAL: Core Libraries and Services Project CERN/IT After-C5 Meeting 6 June 2003 P. Mato / CERN.
CE Operating Systems Lecture 3 Overview of OS functions and structure.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Kelly Davis and Tom Goodale Architecture of GAT Kelly Davis and Tom Goodale and
Frameworks CompSci 230 S Software Construction.
SEAL: Common Core Libraries and Services for LHC Applications CHEP’03, March 24-28, 2003 La Jolla, California J. Generowicz/CERN, M. Marino/LBNL, P. Mato/CERN,
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
LCIO A persistency framework and data model for the linear collider CHEP 04, Interlaken Core Software, Wednesday Frank Gaede, DESY -IT-
Plug-in Architectures Presented by Truc Nguyen. What’s a plug-in? “a type of program that tightly integrates with a larger application to add a special.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
5 Novembre 2001 Vincenzo Innocente AFT Agenda 1 AFT Tasks l Architecture l Framework l Framework specializations l Utility Toolkit l Graphics tools l Data.
Apache Web Server Architecture Chaitanya Kulkarni MSCS rd April /23/20081Apache Web Server Architecture.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Chapter 1 Basic Concepts of Operating Systems Introduction Software A program is a sequence of instructions that enables the computer to carry.
- LCG Blueprint (19dec02 - Caltech Pasadena, CA) LCG BluePrint: PI and SEAL Craig E. Tull Trillium Analysis Environment for the.
Giulio Eulisse, Northeastern University CHEP’04, Interlaken, 27th Sep - 1st Oct, 2004 CHEP’04 IGUANA Interactive Graphics Project:
The SEAL Component Model Radovan Chytracek CERN IT/DB, LCG AA On behalf of LCG/SEAL team This work received support from Particle Physics and Astronomy.
Vincenzo Innocente, CERN/EPUser Collections1 Grid Scenarios in CMS Vincenzo Innocente CERN/EP Simulation, Reconstruction and Analysis scenarios.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
From Use Cases to Implementation 1. Structural and Behavioral Aspects of Collaborations  Two aspects of Collaborations Structural – specifies the static.
Ianna Gaponenko, Northeastern University, Boston The CMS IGUANA Project1 George Alverson, Ianna Gaponenko and Lucas Taylor Northeastern University, Boston.
Geant4 User Workshop 15, 2002 Lassi A. Tuura, Northeastern University IGUANA Overview Lassi A. Tuura Northeastern University,
LCG/Blueprint RTAG 5-6, 2002 Lassi A. Tuura, Northeastern University CMS Components Generic Infrastructure Bits Lassi A. Tuura.
Plug-In Architecture Pattern. Problem The functionality of a system needs to be extended after the software is shipped The set of possible post-shipment.
Vincenzo Innocente, CERN/PH Core Application Software 30 November 2004, Minsk CMS RDMS Conference CMS Core Software for Physics Applications Vincenzo Innocente.
Project Work Plan SEAL: Core Libraries and Services 7 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
VI/ CERN Dec 4 CMS Software Architecture vs Hybrid Store Vincenzo Innocente CMS Week CERN, Dec
HEPVis May, 2001 Lassi A. Tuura, Northeastern University Coherent and Non-Invasive Open Analysis Architecture Lassi A. Tuura.
CHAP-1 OBJECT ORIENTED SYSTEM DESIGN (IT-703)
From Use Cases to Implementation 1. Mapping Requirements Directly to Design and Code  For many, if not most, of our requirements it is relatively easy.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
SEAL: Common Core Libraries and Services for LHC Applications
CSC 222: Object-Oriented Programming
GWE Core Grid Wizard Enterprise (
Project Status and Plan
Simulation Framework Subproject cern
SEAL Project Core Libraries and Services
From Use Cases to Implementation
Presentation transcript:

CPT Week, November , 2002 Lassi A. Tuura, Northeastern University Core Framework Infrastructure Lassi A. Tuura Northeastern University, Boston

November 4, 2002 Lassi A. Tuura, Northeastern University 2 Frameworks: Structure Federationwizards Detector/EventDisplay Data Browser Analysis job wizards Generic analysis Tools ORCA FAMOS LCGtools GRID OSCAR COBRA Distributed Data Store & Computing Infrastructure CMStools Consistent User Interface Coherent basic tools and mechanisms

November 4, 2002 Lassi A. Tuura, Northeastern University 3 Federation wizards Detector/Event Display Data Browser Analysis job wizards Generic analysis Tools ORCA FAMOS OSCAR Focus Of This Presentation Consistent User Interface Coherent basic tools and mechanisms LCGtools GRID CMStools Distributed Data Store & Computing Infrastructure COBRA

November 4, 2002 Lassi A. Tuura, Northeastern University 4 ODBMS GEANT 3 / 4 CLHEP PAW Replacement C++ Standard Library + Extension Toolkits C++ Standard Library + Extension Toolkits Frameworks: Layering Calibration Objects Calibration Objects Generic Application Framework Physics modules Grid-Uploadable BasicServices Adapters and Extensions Configuration Objects Configuration Objects Event Objects Event Objects (Grid-aware) Data-Products SpecificFrameworks Event Filter Reconstruction Algorithms Physics Analysis Data Monitoring

November 4, 2002 Lassi A. Tuura, Northeastern University 5 GEANT 3 / 4 Boost Classlib LCG Tools C++ Standard Library + Extension Toolkits C++ Standard Library + Extension Toolkits Tool Components Layer Calibration Objects Calibration Objects Generic Application Framework Physics modules Grid-Uploadable BasicServices Adapters and Extensions Configuration Objects Configuration Objects Event Objects Event Objects (Grid-aware) Data-Products SpecificFrameworks Event Filter Reconstruction Algorithms Physics Analysis Data Monitoring

November 4, 2002 Lassi A. Tuura, Northeastern University 6 Tool Components Focus v Unification r Gathering basic services within CMS projects into one place r Selection and merging where duplication exists r In co-operation with LCG tools project r Using existing high-quality 3rd party libraries where possible – Adaptation to CMS environment v Attention on quality improvements r Better documentation r More examples r More test cases (regression checked where possible) r Ensure consistent usage within CCS software

November 4, 2002 Lassi A. Tuura, Northeastern University 7Classification v Language extensions r Extended type info, reflection, … r Library utilities: hash maps, map iterators, … v Rich base of tools from simple to sophisticated r “Mini utilities” collection (signals, timers, environment, uuids, dns, users …) r Bits & numerics tools r Debugging, robustness, logging r System abstraction r I/O: basics; files, file systems; IPC; high-level streams r Compression, archives tools

November 4, 2002 Lassi A. Tuura, Northeastern University 8 GEANT 3 / 4 Qt Classlib Open Inventor Open Inventor C++ Standard Library + Extension Toolkits C++ Standard Library + Extension Toolkits Framework Components Layer Physics modules Grid-Uploadable Basic Services Adapters and Extensions SpecificFrameworks Event Filter Reconstruction Algorithms Physics Analysis Data Monitoring Calibration Objects Calibration Objects Generic Application Framework Configuration Objects Configuration Objects Event Objects Event Objects (Grid-aware) Data-Products

November 4, 2002 Lassi A. Tuura, Northeastern University 9Componentisation v Main technical focus: componentisation r COBRA and IGUANA already have fairly well developed component models r Focus on making those modules more clearly defined – Technically, components and dynamic loading can be orthogonal – Documentation, including how-to guides – Build infrastructure to be made more evident and convenient v Introduction of the plug-in architecture r More on this on subsequent slides… v Don’t forget the other important changes already going on! r See other presentations: – Transition to ROOT, POOL (LCG Persistency) – GRID/Production environment evolution – Mantis for OSCAR 2.x

November 4, 2002 Lassi A. Tuura, Northeastern University 10Modules v What’s a module? r An (extension) component to a framework (often dynamically loaded) r Framework knows only that a module extends a particular API (usually abstract interfaces), not how and what it needs to do so r Examples abound: Netscape plug-ins, Apache modules, Python and PERL modules, Illustrator and PhotoShop extensions, … r Already used in many ways in CMS projects: package builders, detector units, hit/digi readers and writers, and many algorithms are essentially extensions of APIs provided by COBRA, and “subframeworks” in ORCA v Why modules? r Eases management—framework doesn’t need to know lots of details about the modules, but can simply load them and gain additional capabilities r Helps to give symbolic names to capabilities and allow framework to reason about them: “here’s all you will need to read data product X” r Allows better services to external parties (Python, GRID, IGUANA, …) without having to put that knowledge into many applications

November 4, 2002 Lassi A. Tuura, Northeastern University 11 Plug-In Architecture v Moving the implementation from IGUANA to CMS core r We already have a couple of years of experience with these tools… v Major benefits ahead r Easier application composition: a logical component larger than a single library can be defined as a real module (building on SCRAM groups) r Separation of higher level concepts (e.g. data products) from technical implementation details (e.g. which libraries are involved, whether to use dynamic loading or statically built applications) r More flexible and dynamic application composition r Available to all high-level frameworks, not just COBRA or IGUANA r Gives us more breathing room with the ever faster development v Gradual introduction first into COBRA, then elsewhere r Starting with simple, easy to understand build and usage model r Rewriting the IGUANA how-to guides for more generic use r Hand in hand with improved core component definitions

November 4, 2002 Lassi A. Tuura, Northeastern University 12Summary v Exciting times ahead! v Amazing progress in many areas r Both CCS and PRS software v We are making sure we have a foundation that is able to sustain all these development with sufficient ease