July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.

Slides:

Advertisements

Similar presentations

Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC

Advertisements

Xrootd and clouds Doug Benjamin Duke University. Introduction Cloud computing is here to stay – likely more than just Hype (Gartner Research Hype Cycle.

Container JVMClient JVM Server side Classes to test JUnit Test Runner Cactus Test Case Cactus Redirector Proxy Cactus Test Case.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.

Microsoft Server Technology An Overview By Christopher W. Baran.

Outline Network related issues and thinking for FAX Cost among sites, who has problems Analytics of FAX meta data, what are the problems  The main object.

1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.

CERN IT Department CH-1211 Genève 23 Switzerland t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.

Scalla Back Through The Future Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 8-April-10

Xrootd Demonstrator Infrastructure OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC

Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 19-May-09 ANL Tier3(g,w) Meeting.

Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL

Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.

11-July-2008Fabrizio Furano - Data access and Storage: new directions1.

FAX Redirection Topology Wei Yang 7/16/121. Redirector hardware at CERN Redundant redirectors for EU, UK, DE, FR – Redundant (the “+” sign below) VMs.

PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

Wahid, Sam, Alastair. Now installed on production storage Edinburgh: srm.glite.ecdf.ed.ac.uk  Local and global redir work (port open) e.g. root://srm.glite.ecdf.ed.ac.uk//atlas/dq2/mc12_8TeV/NTUP_SMWZ/e1242_a159_a165_r3549_p1067/mc1.

Enabling Grids for E-sciencE EGEE-III INFSO-RI I. AMGA Overview What is AMGA Metadata Catalogue of EGEE’s gLite 3.1 Middleware Main Feature of.

CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd setup An introduction/tutorial for ALICE sysadmins.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1.

Site operations Outline Central services VoBox services Monitoring Storage and networking 4/8/20142ALICE-USA Review - Site Operations.

Redirector xrootd proxy mgr Redirector xrootd proxy mgr Xrd proxy data server N2N Xrd proxy data server N2N Global Redirector Client Backend Xrootd storage.

Status & Plan of the Xrootd Federation Wei Yang 13/19/12 US ATLAS Computing Facility Meeting at 2012 OSG AHM, University of Nebraska, Lincoln.

CERN IT Department CH-1211 Genève 23 Switzerland Internet Services Xrootd explained

02-June-2008Fabrizio Furano - Data access and Storage: new directions1.

CERN IT Department CH-1211 Genève 23 Switzerland t Scalla/xrootd WAN globalization tools: where we are. Now my WAN is well tuned! So what?

CERN IT Department CH-1211 Genève 23 Switzerland t DSS Data Access in the HEP community Getting performance with extreme HEP data distribution.

CMS Issues. Background – RAL Infrastructure TM Nsd Xrd- mgr TM Nsd Xrd- mgr TM Rhd stagerd TGW Rhd stagerd TGW Cupv Vmgr Vdqm nsd Cupv Vmgr Vdqm nsd Cupv.

ATLAS XRootd Demonstrator Doug Benjamin Duke University On behalf of ATLAS.

Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 08-June-10 ANL Tier3 Meeting.

Scalla Advancements xrootd /cmsd (f.k.a. olbd) Fabrizio Furano CERN – IT/PSS Andrew Hanushevsky Stanford Linear Accelerator Center US Atlas Tier 2/3 Workshop.

Scalla Authorization xrootd /cmsd Andrew Hanushevsky SLAC National Accelerator Laboratory CERN Seminar 10-November-08

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS XROOTD news New release New features.

AliEn central services Costin Grigoras. Hardware overview  27 machines  Mix of SLC4, SLC5, Ubuntu 8.04, 8.10, 9.04  100 cores  20 KVA UPSs  2 * 1Gbps.

Scalla In’s & Out’s xrootdcmsd xrootd /cmsd Andrew Hanushevsky SLAC National Accelerator Laboratory OSG Administrator’s Work Shop Stanford University/SLAC.

SRM Space Tokens Scalla/xrootd Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University 27-May-08

Scalla As a Full-Fledged LHC Grid SE Wei Yang, SLAC Andrew Hanushevsky, SLAC Alex Sims, LBNL Fabrizio Furano, CERN SLAC National Accelerator Laboratory.

CERN IT Department CH-1211 Genève 23 Switzerland t ALICE XROOTD news New xrootd bundle release Fixes and caveats A few nice-to-know-better.

Federated Data Stores Volume, Velocity & Variety Future of Big Data Management Workshop Imperial College London June 27-28, 2013 Andrew Hanushevsky, SLAC.

11-June-2008Fabrizio Furano - Data access and Storage: new directions1.

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES L. Betev, A. Grigoras, C. Grigoras, P. Saiz, S. Schreiner AliEn.

Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features1.

DCache/XRootD Dmitry Litvintsev (DMS/DMD) FIFE workshop1Dmitry Litvintsev.

Good user practices + Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CUF,

An Analysis of Data Access Methods within WLCG Shaun de Witt, Andrew Lahiff (STFC)

ALICE computing Focus on STEP09 and analysis activities ALICE computing Focus on STEP09 and analysis activities Latchezar Betev Réunion LCG-France, LAPP.

New Features of Xrootd SE Wei Yang US ATLAS Tier 2/Tier 3 meeting, University of Texas, Arlington,

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Solutions for WAN data access: xrootd and NFSv4.1 Andrea Sciabà.

SCALABILITY AND SECURITY Presentation. 01 Scalability.

Pledged and delivered resources to ALICE Grid computing in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.

Grid Operations in Germany T1-T2 workshop 2015 Torino, Italy Kilian Schwarz WooJin Park Christopher Jung.

CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd LHC An up-to-date technical survey about xrootd- based storage solutions.

The ALICE Analysis -- News from the battlefield Federico Carminati for the ALICE Computing Project CHEP 2010 – Taiwan.

a brief summary for users

Data Access in HEP A tech overview

Dynamic Storage Federation based on open protocols

XNAT at Scale June 7, 2016.

CyberSKA: Global Federated e-Infrastructure

Xrootd explained Cooperation among ALICE SEs

Report PROOF session ALICE Offline FAIR Grid Workshop #1

Lab A: Installing and Configuring the Network Load Balancing Driver

Data access and Storage

Data Federation with Xrootd Wei Yang US ATLAS Computing Facility meeting Southern Methodist University, Oct 11-12, 2011.

Brookhaven National Laboratory Storage service Group Hironori Ito

Scalla/XRootd Advancements

Data Management cluster summary

Support for ”interactive batch”

Summary of the dCache workshop

Presentation transcript:

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can hold Up to 64 servers

July-2008Fabrizio Furano - The Scalla suite and the Xrootd2 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Simple cluster Up to 64 data servers 1-2 mgr redirectors Simple cluster Up to 64 data servers 1-2 mgr redirectors cmsd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Advanced cluster Up to 4096 (2 lvls) or 262K (3 lvls) data servers Advanced cluster Up to 4096 (2 lvls) or 262K (3 lvls) data servers Everything can have hot spares

July-2008Fabrizio Furano - The Scalla suite and the Xrootd3

July-2008Fabrizio Furano - The Scalla suite and the Xrootd4 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector (alirdr) all.role meta manager all.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/Includes CERN, GSI, and others xroot clusters Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing cmsd xrootd GSI all.manager meta alirdr.cern.ch:1312 all.role manager

July-2008Fabrizio Furano - The Scalla suite and the Xrootd5

July-2008Fabrizio Furano - The Scalla suite and the Xrootd6

cmsd xrootd GSI July-2008Fabrizio Furano - The Scalla suite and the Xrootd7 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector all.role meta manager all.manager meta alirdr.cern.ch:1312 all.role manager Note: the security hats could require you use xrootd native proxy support But missing a file? Ask to the global metamgr Get it from any other collaborating cluster all.manager meta alirdr.cern.ch:1312 Local clients work normally

July-2008Fabrizio Furano - The Scalla suite and the Xrootd8

cmsd xrootd New SE (starting empty) July-2008Fabrizio Furano - The Scalla suite and the Xrootd9 cmsd xrootd Old CERN::ALICE::SE (full) cmsd xrootd ALICE global redirector Grid Shuttle other

July-2008Fabrizio Furano - The Scalla suite and the Xrootd10

July-2008Fabrizio Furano - The Scalla suite and the Xrootd11