DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.

Slides:



Advertisements
Similar presentations
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Advertisements

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Wofgang Thöne, Institute For Scientific Computing – EGEE-Meeting August 2004 Welcome to the User.
Grid for CBM Kilian Schwarz, GSI. What is Grid ? ● Sharing of distributed resources within one Virtual Organisations !!!!
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1 Grid services based architectures Growing consensus that Grid services is the right concept for building the computing grids; Recent ARDA work has provoked.
6/4/20151 Introduction LHCb experiment. LHCb experiment. Common schema of the LHCb computing organisation. Common schema of the LHCb computing organisation.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Assessment of Core Services provided to USLHC by OSG.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
OSG Grid Workshop in KNUST, Kumasi, Ghana August 6-8, 2012 following the AFRICAN SCHOOL OF FUNDAMENTAL PHYSICS AND ITS APPLICATIONS July 15-Aug 04, 2012.
High Energy Physics At OSCER A User Perspective OU Supercomputing Symposium 2003 Joel Snow, Langston U.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
DØSAR, State of the Organization Jae Yu DOSAR, Its State of Organization 7th DØSAR (3 rd DOSAR) Workshop University of Oklahoma Sept. 21 – 22, 2006 Jae.
DOSAR Workshop Sept , 2007 J. Cochran 1 The State of DOSAR Outline What Exactly is DOSAR (for the new folks) Brief History Goals, Accomplishments,
DOSAR VO ACTION AGENDA ACTION ITEMS AND GOALS CARRIED FORWARD FROM THE DOSAR VI WORKSHOP AT OLE MISS APRIL 17-18, 2008.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
DOSAR Workshop at Sao Paulo Dick Greenwood What’s Next for DOSAR? Dick Greenwood Louisiana Tech University 1 st DOSAR Workshop at the Sao Paulo, Brazil.
The ILC And the Grid Andreas Gellrich DESY LCWS2007 DESY, Hamburg, Germany
São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.
David Adams ATLAS ADA, ARDA and PPDG David Adams BNL June 28, 2004 PPDG Collaboration Meeting Williams Bay, Wisconsin.
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
LCG LHC Computing Grid Project – LCG CERN – European Organisation for Nuclear Research Geneva, Switzerland LCG LHCC Comprehensive.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
ISU DOSAR WORKSHOP Dick Greenwood DOSAR/OSG Statement of Work (SoW) Dick Greenwood Louisiana Tech University April 5, 2007.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Evolution of a High Performance Computing and Monitoring system onto the GRID for High Energy Experiments T.L. Hsieh, S. Hou, P.K. Teng Academia Sinica,
LCG ARDA status Massimo Lamanna 1 ARDA in a nutshell ARDA is an LCG project whose main activity is to enable LHC analysis on the grid ARDA is coherently.
EGEE MiddlewareLCG Internal review18 November EGEE Middleware Activities Overview Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as.
INFSO-RI Enabling Grids for E-sciencE Experience of using gLite for analysis of ATLAS combined test beam data A. Zalite / PNPI.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
15 December 2015M. Lamanna “The ARDA project”1 The ARDA Project (meeting with the LCG referees) Massimo Lamanna CERN.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Outline: ARDA services LHCb mini-workshop on Data Management and Production Tools Ph.Charpentier m The ARDA RTAG m The ARDA services m The proposed project.
SEE-GRID-2 The SEE-GRID-2 initiative is co-funded by the European Commission under the FP6 Research Infrastructures contract no
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
US ATLAS – new grid initiatives John Huth Harvard University US ATLAS Software Meeting: BNL Aug 03.
The ATLAS Strategy for Distributed Analysis on several Grid Infrastructures D. Liko, IT/PSS for the ATLAS Distributed Analysis Community.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
T3g software services Outline of the T3g Components R. Yoshida (ANL)
DOSAR Workshop IX, South Africa, April 6-8, 2010 Wrap-up and discussion of short- term goals and Action Items Pat Skubic OU.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
10-Feb-00 CERN HepCCC Grid Initiative ATLAS meeting – 16 February 2000 Les Robertson CERN/IT.
What is OSG? (What does it have to do with Atlas T3s?) What is OSG? (What does it have to do with Atlas T3s?) Dan Fraser OSG Production Coordinator OSG.
OSG All Hands Meeting P. Skubic DOSAR OSG All Hands Meeting March 5-8, 2007 Pat Skubic University of Oklahoma Outline What is DOSAR? History of DOSAR Goals.
DIRAC: Workload Management System Garonne Vincent, Tsaregorodtsev Andrei, Centre de Physique des Particules de Marseille Stockes-rees Ian, University of.
(Prague, March 2009) Andrey Y Shevel
EGEE Middleware Activities Overview
POW MND section.
I Brazilian LHC Computing Workshop Welcome
DOSAR: State of Organization
LCG middleware and LHC experiments ARDA project
Patrick Dreher Research Scientist & Associate Director
Leigh Grundhoefer Indiana University
Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002
Status of Grids for HEP and HENP
SEAL Project Core Libraries and Services
Presentation transcript:

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Outline Introduction to LCG List of LHC Tier 2 Centers Status of ATLAS SW Tier 2 Questions for Discussion Action Items?

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Development Areas Applications Fabric Grid Deployment Grid Technology ARDA- A Realization of Distributed Analysis for LHC

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Applications

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Grid Deployment Organization

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Grid Technology Activities Overall Requirements Technology Tracking Middleware Development Middleware Recommendations

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Overall Requirements Keep a clear view of the emerging requirements for the LHC computing including batch and interactive analysis. The HEPCAL document is the starting point for this. Track the grid activities within the experiments and help disseminate the experiences gained Disseminate the need for high quality infrastructure services and work towards their technical realization Work towards a systems architecture for grid technology to support the project

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Technology Tracking Monitor closely the technology evolution and “put into practice” the technologies as they mature in production. Work with the experiments to perform structured tests will be required. This may also involve working with industry and other sponsored developments to prototype and test solutions as they emerge Study the system architecture issues as experience is gained in order to steer the technology evolution

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Middleware Development Seek strategic advice from the individuals driving the multiple projects producing the core technologies Work towards one set of common and complementary projects encompassing the efforts underway. This involves participating in the plans for funding future projects Identify key developments that are required for the LHC computing grid that are not developed as part of existing projects and promote their development.

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Middleware Recommendations Recommend a coherent technology suite to be deployed to regional centers. This has to be done taking into account the matching with the LHC requirements Develop a plan for the evolution of this suite as new products become available and as new technologies mature Work towards developing a long term support structure for the middleware technology

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 ARDA The basic middleware development team. Joint European-US team, part of EGEE project, but including participation from VDT.EGEE projectVDT At least one team in each experiment, that takes part in adapting the analysis system of their experiment to use the basic middleware. Providers of common HEP tools, such as POOL, SEAL, ROOT, GANGA and PROOF. POOLSEALROOTGANGA Users within experiments that will provide immediate feedback to the developers.

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 ARDA (con’t) Service providers from regional centers who will be involved in deploying early versions of the middleware and analysis systems. The participation of teams from other sciences, such as those participating in EGEE, is welcomed.

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005

SW Tier 2 Status Tier 2 Center –ATLAS management selected OU, LU, UT-Arlington, as a Tier 2 Center (Southwest Tier 2 Center) –Collaboration started on grid software development (PanDA) –OCHEP linux cluster will be deployed this year Efforts will be made to increase NSF funding Physics Analysis: OCHEP collaboration will begin on physics topics, building on Tevatron experience –b tagging  tagging –top physics –Higgs/SUSY searches

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Production and Distributed Analysis (PanDA)

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Questions for Discussion

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Questions from Sergio How would we fit in the general structure of LCG? Will DOSAR VO become a distributed Tier 2 center? Which would be our associated Tier 1? Fermilab? What should we do to comply with Atlas and CMS requirements? How will we share our resources between D0 and LHC?

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Should DOSAR collaborate with other Tier 2 Centers? CMS Tier 2C? Brazil Tier 2 Federation?

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Should DOSAR participate in LCG software development or deployment? Common ATLAS-CMS projects?

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Should DOSAR software efforts be part of larger collaborations? OSG proposal? PanDA and DIRAC?

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 DIRAC- Distributed Infrastructure with Remote Agent Control Services: installed on high availability, centrally managed, servers Agents: installed at various computing centres of institutes associated with the LHCb experiment Clients: available to end users to submit, monitor, and retrieve jobs

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 DIRAC (con’t) It has been designed to be lightweight, robust, and scalable. This has been achieved by using a service oriented architecture and utilizing existing software for key components: 99% of DIRAC is written in Python, which provides a high performance, object oriented scripting language for rapid development, and maintenance. MySQL database is used for persistency. Services make connections to various DBs to manage job state, monitoring information, and meta-data concerning grid files. Condor ClassAds and Matchmaking are the basis of the scheduling strategy. This makes the best match between an available resource and a queued job. Jabber Instant Messaging has been used to provide asynchronous, real-time, fault-tolerant monitoring and control capabilities to DIRAC Agents, Services, and Jobs.

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 Action Items To be decided after discussion