Download presentation
Presentation is loading. Please wait.
Published byNeil Parker Modified over 9 years ago
1
US ATLAS – new grid initiatives John Huth Harvard University US ATLAS Software Meeting: BNL. 27-29 Aug 03
2
November 14-17, 2000 Name Title of this Talk 2 Outline Assume: ongoing efforts (iVDGL, LCG) are covered in other talks (Baker, Gardner, Wenaus) Missing pieces in computing model Open Sciences Grid DAWN proposal Relation with CERN PPDG years 4+5 funding General comments
3
November 14-17, 2000 Name Title of this Talk 3 Computing Model Reconstruction at CERN (Tier 0) High bandwidth connectivity to Tier 1 and Tier 2 centers Last mile connectivity Grid middleware Long term support, reliability Support for analyses Of course: core/application software
4
November 14-17, 2000 Name Title of this Talk 4 Missing pieces Robust, reliable grid operations LCG, Open Sciences Grid, EGEE (EU initiative) Support for analysis groups DAWN toolkit Collaborative tools (more than computing, of course) Resources for the Tier 0
5
November 14-17, 2000 Name Title of this Talk 5 Robust Grids Homogeneous versus interoperable model CERN: homogenous U.S.: interoperable Efforts to date have been production oriented – each experiment+region integrates middleware and home- brewed tools to run MC production Need for 24x7 robust support, single US grid
6
November 14-17, 2000 Name Title of this Talk 6 Open Sciences Grid $40M proposal to the DOE – white paper Timing for OMB FY05 submission process for FY 05 Federated grid, starts with US ATLAS/US CMS, new groups join – must bring resources Software engineering support Hardware: server hardware that enable a federated grid (not part of Research Program funds, iVDGL) BNL+FNAL main centers Common middleware
7
November 14-17, 2000 Name Title of this Talk 7 OSG Partnerships STAR and PHENIX (J. Lauret, B. Jacak) have contacted Nuclear funding agencies, very positive response For Fermilab: D0+CDF obvious candidates Computational biology? Astrophysics applications? Integration with LCG Relation to EGEE: in effect, a response to the EU
8
November 14-17, 2000 Name Title of this Talk 8 Concerns Sold as “Open Sciences”, but with very strong emphasis on the LHC. This raises eyebrows among our non-LHC colleagues. Stress on programs like PPDG – redistribution toward CDF/D0/BaBar in years 4+5?
9
November 14-17, 2000 Name Title of this Talk 9 DAWN: Supporting Analysis groups Dynamic workspaces in grid context Allow groups to configure resources, define themselves Data provenence Validation Reproducibility Back-trail to entire chain of production through analyses
10
November 14-17, 2000 Name Title of this Talk 10
11
November 14-17, 2000 Name Title of this Talk 11 DAWN Dynamic Analysis Workspace with kNowledge $15M Large ITR proposal Status: submitted end of March, still awaiting feedback, NSF is very late. Possibilities: funded as lower level, shared between CISE and MPS PI’s: J. Huth, L. Bauerdick, M. Livny (CS), M. Seltzer (CS), R. Stevens (CS) Collaboration of US ATLAS+ CMS, CS
12
November 14-17, 2000 Name Title of this Talk 12 DAWN Management proposed
13
November 14-17, 2000 Name Title of this Talk 13 Relation to CERN LCG-EGEE relation EGEE: “Enabling Grids for E-science in Europe” EGEE as main supplier for “high level” grid middleware US Supplies lower level: globus, VDT Highly decentralized model – concerns DAWN assumed as US contribution Tier 0 funding Shortfall – looking for contributions from countries Heavy lobbying for 400kCHF in FY 05+06 from US ATLAS US CMS – collaborative effort on data transfers – 400kCHF in 04-05 Research Program? Big investment in software, M+O, difficult OSG? What do our partners say? (I.e. US CMS)
14
November 14-17, 2000 Name Title of this Talk 14 CMS LCG-1 “pilot” diagram EDG Replica Manager RLS or Replica Catalogue EDG Workload Management System EDG L&B MDS (GLUE schema) LDAP? Publish Resource status Read data Write data Retrieve Resource status Data management operations Job assignment to resources Copy data MCRunJob + EDG plug-in JDL +scripts Job submission Input data location Job creation Fetch assignment data Experiment Software PACMAN? PACMAN DB? Software release SW download & installation Dataset Algorithm Specification Dataset Input Specification Dataset Definition New dataset request BOSS&R-GMA? BOSS-DB Job Monitoring Definition Job type definition Job output filtering Update dataset metadata Production monitoring EDG SE VDT Server Data EDG CE VDT server EDG UI VDT Client Push data or info Pull info EDT Monitor Resources monitoring
15
November 14-17, 2000 Name Title of this Talk 15 PPDG Years 4+5 Until now: Experiments (ATLAS, CMS, D0, STAR, BaBar, others) have funded independent efforts, plus CS areas Largely disjoint Present discussion: More coherent effort, no entitlements from year 3 Emphasis on multi-user support Non-LHC experiments lobbying for more support (response to OSG)
16
November 14-17, 2000 Name Title of this Talk 16 Comments New initiatives create opportunities Help make up for funding shortfalls Not without costs Must be appealing from a CS perspective but satisfying computing needs Collaboration in larger entities – CERN/CMS/CS/non-LHC Ultimately must have “value-added” from agency perspective
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.