Amber Boehnlein, FNAL DO Computing Model Amber Boehnlein.

Slides:



Advertisements
Similar presentations
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Advertisements

Dynamic Task Assignment Load Index for Geographically Distributed Web Services PhD Research Proposal By: Dhiah Al-Shammary Supervised.
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
May 9, 2008 Reorganization of the OSG Project The existing project organization chart was put in place at the beginning of It has worked very well.
Software Parallel Intro 1M.Ellis - CM23 - Harbin - 15th January 2009  Focus this CM continues to be on needs for analysis of data and use of G4MICE online.
Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
Database Infrastructure Major Current Projects –CDF Connection Metering, codegen rewrite, hep w/ TRGSim++ – Dennis –CDF DB Client Monitor Server and MySQL.
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
What are the functions of an operating system? The operating system is the core software component of your computer. It performs many functions and is,
JIM Deployment for the CDF Experiment M. Burgon-Lyon 1, A. Baranowski 2, V. Bartsch 3,S. Belforte 4, G. Garzoglio 2, R. Herber 2, R. Illingworth 2, R.
18 Feb 2004Computing Division Project Status Report1 Project Status Report : SAMGrid  SAMGrid Management, Status, Operations – Merritt  SAMGrid Development.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
F Run II Experiments and the Grid Amber Boehnlein Fermilab September 16, 2005.
WORKFLOW IN MOBILE ENVIRONMENT. WHAT IS WORKFLOW ?  WORKFLOW IS A COLLECTION OF TASKS ORGANIZED TO ACCOMPLISH SOME BUSINESS PROCESS.  EXAMPLE: Patient.
HEPiX Catania 19 th April 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 19 th April 2002 HEPiX 2002, Catania.
HEPiX Orsay 27 th April 2001 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 27 th April 2001 HEPiX 2001, Orsay.
May 14, 2001E. Gallas/Trigger Database1 Status of the Trigger Database Elizabeth Gallas, Rich Wellner, Vicky White Fermilab - Computing Division See my.
What if you suspect a security incident or software vulnerability? What if you suspect a security incident at your site? DON’T PANIC Immediately inform:
S. Veseli - SAM Project Status SAMGrid Developments – Part I Siniša Veseli CD/D0CA.
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
- Iain Bertram R-GMA and DØ Iain Bertram RAL 13 May 2004 Thanks to Jeff Templon at Nikhef.
DOSAR VO ACTION AGENDA ACTION ITEMS AND GOALS CARRIED FORWARD FROM THE DOSAR VI WORKSHOP AT OLE MISS APRIL 17-18, 2008.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
SAMGrid “Addendum” Adam Lyon GDM / April 18, 2006.
SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
GridPP18 Glasgow Mar 07 DØ – SAMGrid Where’ve we come from, and where are we going? Evolution of a ‘long’ established plan Gavin Davies Imperial College.
DØ Computing Model & Monte Carlo & Data Reprocessing Gavin Davies Imperial College London DOSAR Workshop, Sao Paulo, September 2005.
ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.
Status of Grid-enabled UTA McFarm software Tomasz Wlodek University of the Great State of TX At Arlington.
26SEP03 2 nd SAR Workshop Oklahoma University Dick Greenwood Louisiana Tech University LaTech IAC Site Report.
CERN Physics Database Services and Plans Maria Girone, CERN-IT
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
16 September GridPP 5 th Collaboration Meeting D0&CDF SAM and The Grid Act I: Grid, Sam and Run II Rick St. Denis – Glasgow University Act II: Sam4CDF.
Elizabeth Gallas August 9, 2005 CD Support for D0 Database Projects 1 Elizabeth Gallas Fermilab Computing Division Fermilab CD Grid and Data Management.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
OSG Technology Area Brian Bockelman Area Coordinator’s Meeting February 15, 2012.
US ATLAS Tier 1 Facility Rich Baker Brookhaven National Laboratory Review of U.S. LHC Software and Computing Projects Fermi National Laboratory November.
GridPP11 Liverpool Sept04 SAMGrid GridPP11 Liverpool Sept 2004 Gavin Davies Imperial College London.
ALICE Pixel Operational Experience R. Santoro On behalf of the ITS collaboration in the ALICE experiment at LHC.
LTU Site Report Dick Greenwood LTU Site Report Dick Greenwood Louisiana Tech University 1 st DOSAR Workshop at Sao Paulo September 16-17, 2005.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
Feb. 14, 2002DØRAM Proposal DØ IB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) Introduction Partial Workshop Results DØRAM Architecture.
CD FY09 Tactical Plan Status FY09 Tactical Plan Status Report for Neutrino Program (MINOS, MINERvA, General) Margaret Votava April 21, 2009 Tactical plan.
Security Policy Update WLCG GDB CERN, 14 May 2008 David Kelsey STFC/RAL
The GridPP DIRAC project DIRAC for non-LHC communities.
Proposal for a Global Network for Beam Instrumentation [BIGNET] BI Group Meeting – 08/06/2012 J-J Gras CERN-BE-BI.
Computing Division FY03 Budget and budget outlook for FY04 + CDF International Finance Committee April 4, 2003 Vicky White Head, Computing Division.
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
Run II Review Closeout 15 Sept., 2004 FNAL. Thanks! …all the hard work from the reviewees –And all the speakers …hospitality of our hosts Good progress.
Jan 7, 2002E. Gallas/Trigger Db1 Trigger Database and Trigger Configurations and Trigger Issues Elizabeth Gallas, Jeremy Simmons (Fermilab - Computing.
PCAP Close Out Feb 2, 2004 BNL. Overall  Good progress in all areas  Good accomplishments in DC-2 (and CTB) –Late, but good.
Linear Colliders in the HSF Jan Strube (PNNL) 1. Introduction Large Data rates (comparable to Belle-II) ~ 18 PB / year raw data at nominal running at.
DPS/ CMS RRB-T Core Software for CMS David Stickland for CMS Oct 01, RRB l The Core-Software and Computing was not part of the detector MoU l.
Comments on #3: “Motivation for Regional Analysis Centers and Use Cases” Chip Brock 3/13/2.
The GridPP DIRAC project DIRAC for non-LHC communities.
McFarm Improvements and Re-processing Integration D. Meyer for The UTA Team DØ SAR Workshop Oklahoma University 9/26 - 9/27/2003
Towards deploying a production interoperable Grid Infrastructure in the U.S. Vicky White U.S. Representative to GDB.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Victoria A. White Head, Computing Division, Fermilab Fermilab Grid Computing – CDF, D0 and more..
Monitoring the Readiness and Utilization of the Distributed CMS Computing Facilities XVIII International Conference on Computing in High Energy and Nuclear.
DØ Computing Model and Operational Status Gavin Davies Imperial College London Run II Computing Review, September 2005.
DØ Grid Computing Gavin Davies, Frédéric Villeneuve-Séguier Imperial College London On behalf of the DØ Collaboration and the SAMGrid team The 2007 Europhysics.
5/12/06T.Kurca - D0 Meeting FNAL1 p20 Reprocessing Introduction Computing Resources Architecture Operational Model Technical Issues Operational Issues.
Project Status Report : SAMGrid
IEEE Std 1074: Standard for Software Lifecycle
DØ MC and Data Processing on the Grid
WHAT ARE THE ADVANTAGES AND CHALLENGES OF MICROSOFT SQL SERVER.
Presentation transcript:

Amber Boehnlein, FNAL DO Computing Model Amber Boehnlein

Amber Boehnlein, FNAL A different talk  The talk I’m about to give, I would will be short because I hope it will spur discussion. I wish, in fact that I could have been at Latech, to see the azaleas blooming and to have long discussions about these topics at leisure.

Amber Boehnlein, FNAL Recent SAM progress  JIM in use by Joel for production level requests  Functionality includes merging  'infrastructure efficiency' is nearly 100%. Fabulous progress towards milestone Thanks Joel very much for his cooperation and help!  SAM is in the process of testing the new dbserver with other servers upgraded to be compatible with it, and has successfully run projects in development.  The one-step SAM installation procedure which was developed with CDF effort and has been working for some time at CDF was debugged for a D0 installation last week by Adam Lyon and Art Kreymer. It is very close to being ready for general use, and we recommend that anyone installing or considering a station install wait till we have this declared ready for use, which should be just a couple of weeks.  SAMGrid will spend the week of April on documentation issues. Working groups will tackle user documentation, station admin documentation, and shifter documentation as well as other areas.

Amber Boehnlein, FNAL DO Computing Model  After many years of the work, the D0 computing model is substantially complete.  The model is the most complete and successful model currently existing  What does “successful imply”?  Operationally stable with no known scaling issues  Development coming to an end—features are either present or have been cut  Sufficient hooks are present to monitor and control resource consumption.  Operational model in place (SAM shifters)  What does “successful” not imply  Infinite resources. A successful model makes best use of the resources it has  Infinite development. Sometimes it’s time to cut bait.  Infinite involvement. The Computing Division is moving on, and more will fall to the experiment

Amber Boehnlein, FNAL What’s Next  Substantially done is not done  Tuning use of SAM-cache and replacing D0mino  Database and database server issues  Last major effort will be to get reprocessing effort using final tools  Runjob development (with CMS and CDF)  D0tools retooling  Introduction of JIM component of SAM in general use for “projection activities.  Major problems remain on the application side  Proposed cardfile database to at least track the GIGO problem with simulation  There is no long term analysis mode  Experiment proposed “production activities without understanding what production means  Most of these could be soldiered on with indefinitely, at the cost of poorly using hardware resources. That’s a shame, but the horse can only be lead to water  Of course, the experiment would be nuts to move away from a successful model—but that might not stop them.

Amber Boehnlein, FNAL What’s next  Grid workshop in London  Reprocessing issues are the focus  Other more general grid issues as well—but these are agendas in which DO is a pawn and a bargining chip.  What changes occur within D0 are going to depend as much on how much accommodation D0 has to make to maintain expert leave support as on what D0 “needs”.  D0 really, really needs stability and work on algorithm development

Amber Boehnlein, FNAL Question to DOSAR  What is the balance between D0 and SAR??  It’s very tempting for many groups to want a slice of the grid pie— but the “snake oil” days are over.  Establishing credentials means working with existing groups.  Homegrown might still fly on D0, but not in the grid community. As products transition to “real”, there is an increased value assigned to cost/benefit and operational models and stabilities.  D0SAR is major contributor to D0  UTA is major contributor of MC—and don’t underestimate the importance of that. It might not be “sexy”, but it puts dinner on the table.  D0SAR is contributing people to general efforts—Joel, D0 shifters.  D0SAR could contribute in other ways to D0  Take on a task that furthers the analysis model/model –Edmroot or other format issues –Code distribution –Contribution to runjob –Contribution to simulation cardfile database Such projects could give D0SAR analysis and computing credentials of LHC