Download presentation
Presentation is loading. Please wait.
Published byEric Pollock Modified over 11 years ago
1
Physics with SAM-Grid Stefan Stonjek University of Oxford 6 th GridPP Meeting 30 th January 2003 Coseners House
2
Outline Components of SAM Grid Job submission The demo Problems Outlook Summary
3
30 Jan 2003Stefan Stonjek1 Components of SAM-Grid (1) Condor for submission and brokering GRAM protocol to transfer job to execution site Authentication via GSI (Grid Security Infrastructure) Monitoring via JIM (Job management infrastructure and Information and Monitoring system)
4
30 Jan 2003Stefan Stonjek1 Components of SAM-Grid (2) Data handling with SAM (Sequential data Access via Meta-data) Local job submission via CDF: CAF (Central Analysis Facility) FBS: Farm batch system Kerberized tools to write data back to FNAL DØ: OpenPBS Output data handling via SAM
5
30 Jan 2003Stefan Stonjek1
6
30 Jan 2003Stefan Stonjek1 Submission to the Grid Requires Grid proxy User must provide job description file GUI exists (generates fdf file and submits) Submission to Condor Submission to the site with the most files already present New Condor feature: execution of external code when negotiating the matches
7
30 Jan 2003Stefan Stonjek1 Local Submission Job is transferred as tar file via the GRAM protocol and than submitted to the local batch system Different local batch systems are possible Need adaptor for submission and job status information Queues have to be the same at all sites
8
30 Jan 2003Stefan Stonjek1 Data Handling (SAM) If needed SAM transfer the files to the local station SAM translates dataset name to list of files Selection can be based on physics meta-data File transfer is transparent for the user
9
30 Jan 2003Stefan Stonjek1 Job Monitoring Monitoring via a Web page Information is collected at a central point A decentralized approach might be more suitable for the Grid
10
30 Jan 2003Stefan Stonjek1 Institutions for SC2002 (16 th – 22 nd Nov 2002) CDF Kyungpook National University, Korea Rutgers State University, New Jersey, US Rutherford Appelton Laboratory, UK Texas Tech, Texas, US University of Toronto, Canada DØ Imperial College, London, UK Michigan State University, Michigan, US University of Michigan, Michigan, US University of Texas at Arlington, Texas, US
11
30 Jan 2003Stefan Stonjek1 The Demo Submission via command line Broker to RAL or FNAL Transfer via GRAM protocol Local job submission by CAF Job monitoring via Web Transfer of results via kerberized rcp to FNAL web server
12
30 Jan 2003Stefan Stonjek1
13
30 Jan 2003Stefan Stonjek1 Problems (Security) Firewalls (different settings at different sites) Kerberos (FNAL allows just kerberized access) Authentication (ssh, kerberos, GSI,...) Different and local policies
14
30 Jan 2003Stefan Stonjek1 Problems (Private Networks) Already problems with SAM Worker node can contact outside world Outside world can not call back Problem if long time between call from worker and the response from the outside IPv6 might be a solution
15
30 Jan 2003Stefan Stonjek1 Outlook (CDF) RAL cluster (cdf01 – cdf16) is already Grid enabled cluster (as shown in the demo) Four new cluster computer in Glasgow, Liverpool, London and Oxford Maybe ScotGrid
16
30 Jan 2003Stefan Stonjek1 Summary Several new tools and protocols were used to from a Grid enabled environment to do physics SAM-Grid is able to use Grid technology on real physics data
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.