Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBES Feasibility Study on a Common Analysis Framework for ATLAS & CMS.

Slides:



Advertisements
Similar presentations
Building a Knowledge Management System as a Life Cycle
Advertisements

Test Automation Success: Choosing the Right People & Process
Principles of Information Systems, Tenth Edition
Chapter 10 Schedule Your Schedule. Copyright 2004 by Pearson Education, Inc. Identifying And Scheduling Tasks The schedule from the Software Development.
Discovering Computers Fundamentals, 2011 Edition Living in a Digital World.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Eleventh Edition 1 Introduction to Information Systems Essentials for the Internetworked E-Business Enterprise Irwin/McGraw-Hill Copyright © 2002, The.
Awareness – a foundation for investigating inter- organizational collaboration in cadastral system?
Fundamentals of Information Systems, Second Edition
7.2 System Development Life Cycle (SDLC)
Computing Essentials 2014 Systems Analysis and Design © 2014 by McGraw-Hill Education. This proprietary material solely for authorized instructor use.
CHAPTER 9 DEVELOPING BUSINESS/IT STRATEGIES. IT Planning Planning an information system doesn’t start with bits, and bytes, or a Web site. It starts with.
Acquiring Information Systems and Applications
Introduction to Computer Technology
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES WLCG operations: communication channels Andrea Sciabà WLCG operations.
System design technique  System Development Life Cycle  Prototyping  Rapid Application Development.
Managing the development and purchase of information systems (Part 1)
Moving into Design SYSTEMS ANALYSIS AND DESIGN, 6 TH EDITION DENNIS, WIXOM, AND ROTH © 2015 JOHN WILEY & SONS. ALL RIGHTS RESERVED. 1 Roberta M. Roth.
Engineering, Operations & Technology | Information TechnologyAPEX | 1 Copyright © 2009 Boeing. All rights reserved. Architecture Concept UG D- DOC UG D-
Chapter 13: Developing and Implementing Effective Accounting Information Systems
The Challenge of IT-Business Alignment
1 ISA&D7‏/8‏/ ISA&D7‏/8‏/2013 Systems Development Life Cycle Phases and Activities in the SDLC Variations of the SDLC models.
©Ian Sommerville 2000, Mejia-Alvarez 2009 Slide 1 Software Processes l Coherent sets of activities for specifying, designing, implementing and testing.
Chapter 14 Information System Development
CLIC Cost & Schedule WG: mandate, organization, activities 2009 Ph. Lebrun CERN, Geneva, Switzerland TILC’09 Tsukuba, Japan.
Systems Development AIMS 2710 R. Nakatsu. Overview Why do IT projects succeed and fail? Two philosophies of systems development –Systems Development Life.
Role-Based Guide to the RUP Architect. 2 Mission of an Architect A software architect leads and coordinates technical activities and artifacts throughout.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Chapter 6: Systems Development Steps, Tools, and Techniques Management Information Systems for the Information Age.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES PhEDEx Monitoring Nicolò Magini CERN IT-ES-VOS For the PhEDEx.
Lecture 7: Requirements Engineering
Introduction to Systems Analysis and Design
ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Successful Common Projects: Structures and Processes WLCG Management.
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
CERN IT Department CH-1211 Geneva 23 Switzerland GT WG on Storage Federations First introduction Fabrizio Furano
Fundamentals of Information Systems, Second Edition 1 Systems Development.
Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.
Impact of end of EMI+EGI-SA3 April 2013: EMI project finishes EGI-Inspire-SA3 finishes (mainly CERN affected) EGI-Inspire continues until April 2014 EGI.eu.
CERN IT Department CH-1211 Geneva 23 Switzerland t GDB CERN, 4 th March 2008 James Casey A Strategy for WLCG Monitoring.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.
Chapter 6 CASE Tools Software Engineering Chapter 6-- CASE TOOLS
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
Construction of Computational Segment at TSU HEPI Erekle Magradze Zurab Modebadze.
CERN General Infrastructure Services Department CERN GS Department CH-1211 Geneva 23 Switzerland SMS CERN General Infrastructure.
CERN IT Department CH-1211 Geneva 23 Switzerland t A proposal for improving Job Reliability Monitoring GDB 2 nd April 2008.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
Design and implementation Chapter 7 – Lecture 1. Design and implementation Software design and implementation is the stage in the software engineering.
Summary of persistence discussions with LHCb and LCG/IT POOL team David Malon Argonne National Laboratory Joint ATLAS, LHCb, LCG/IT meeting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon GDB 12 th October 2011, CERN.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES The Common Solutions Strategy of the Experiment Support group.
CMS Experience with the Common Analysis Framework I. Fisk & M. Girone Experience in CMS with the Common Analysis Framework Ian Fisk & Maria Girone 1.
CERN IT Department CH-1211 Genève 23 Switzerland t EIS Section input to GLM For GLM attended by Director for Computing.
 System Requirement Specification and System Planning.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES IT-ES Group Meeting November 3 rd 2010.
MANAGEMENT INFORMATION SYSTEM
Information Systems Development
IS Development Methodology
Fundamentals of Information Systems, Sixth Edition
Principles of Information Systems Eighth Edition
for the Offline and Computing groups
Systems Analysis and Design
R&D for HL-LHC from the CWP
Information Systems Development
CLINICAL INFORMATION SYSTEM
PROCESS PERFECTION THROUGH ROBOTIC PROCESS AUTOMATION
Presentation transcript:

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Feasibility Study on a Common Analysis Framework for ATLAS & CMS Ian Fisk, Maria Girone, Alexei Klimentov

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Introduction This talk is about an initiative between IT-ES, CMS and ATLAS for investigating commonalities in analysis frameworks –Environment highly resource constrained and likely to be more so in the future –This, together with recent successes in the area of common solutions – in part funded by EGI-InSPIRE (finishing April 2013) – lead us to look for further synergies and savings ATLAS and CMS recognized that they benefit from a common solution IT-ES computing professionals play a key role in both experiments –Several years of work in software development and operations –People uniquely qualified to identify and implement common solutions Maria Girone, IT-ES2

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Potential Concept of providing more commonality is not new –What is different is that both experiments are looking at the long term development effort needs This seems perfectly aligned with the high level goal of EGI to work toward sustainable infrastructure IT-ES through EGI project support has a team of highly motivated people with expertise in both systems There have been several, admittedly more contained, examples of successful common services Maria Girone, IT-ES3

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Savings is not small Common development and maintenance reduces the number of people needed to complete the same task –Typically the WLCG Computing projects spend about 60% on people and 40% on hardware –Commonality does not necessarily mean fewer positions, but it does mean less duplicated effort and more effort for interesting development Maria Girone, IT-ES4

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Obstacles Experiments have discussed commonality before at the high level services –This effort might also not succeed Commonality suffers in two areas –“Not developed here” a distrust of code not developed in house, and what that means for continued development and support –“No disruption here” all experiments are in operations and working. Long Shutdown 1 is good timing Already the openness of the participants and the willingness to discuss collaboration is a source for optimism Maria Girone, IT-ES5

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Mandate We have performed a feasibility study to assess the potential for using common components for analysis in a distributed environment, based on elements from the PanDA and glideinWMS systems A small working group consisting primarily of technical experts in the current experiment systems was formed Weekly reports and steering by IT-ES, ATLAS and CMS management Technical results from this WG will be presented next, followed by discussion 6Maria Girone, IT-ES

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Feasibility Study Goals –Determine what elements of an analysis framework could be provided in common, and how to interface a common system with the existing experiment services Timeline: Deliver by CHEP 2012 a report describing the proposed use of common components and services –Proposal to build proof-of-concept prototype by Autumn 2012 –If successful a further implementation and deployment phase would follow during LS1  Resources: –Important to understand availability of needed expertise for all potential stages of the project up-front as well as long-term operational and support savings Maria Girone, IT-ES7

CERN IT Department CH-1211 Geneva 23 Switzerland t ES 8 A Three Step Process 8 Proof of Concept: Implement defined functionality to verify the initial conclusions of the feasibility study. Assess what we will be gaining/loosing in terms of functionality by introducing common elements Operations Study: Look at the cost of operating and sustaining various proposals. Development support can go down, but operations effort needs to be assessed also. Can be partially in parallel with the prototype development Feasibility Study: Look at CMS system with eye for introducing some common components with ATLAS. Where are the interfaces, what is reused, how much work is it? Primarily this is work for developers. Since people in IT-ES have experience with both systems, they are uniquely qualified

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Conclusions Feasibility Study proved that there are no show-stoppers to design a common analysis framework Needed functionality has a lot of overlap –Sometimes requires a careful evaluation to determine that the two experiments are talking about the same thing Specific actions to an experiment are rare and normally confined to a small area Maria Girone, IT-ES9

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Next Steps With the close of the feasibility study we will specify a program of work for a proof of concept prototype –Details in the next presentations As we move forward, we would also like to assess and document the process –This should not be the only common project, and looking at the make-up of the groups, what went well and badly, and how to improve will be helpful Maria Girone, IT-ES10