09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features1.

Slides:

Advertisements

Similar presentations

Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC

Advertisements

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.

GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.

Event Viewer Was of getting to event viewer Go to –Start –Control Panel, –Administrative Tools –Event Viewer Go to –Start.

1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.

Introduction to SMG-SS7 Konrad Hammel Sangoma Technologies.

PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.

Scalla Back Through The Future Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 8-April-10

DEMIGUISE STORAGE An Anonymous File Storage System VIJAY KUMAR RAVI PRAGATHI SEGIREDDY COMP 512.

The LCG File Catalog (LFC) Jean-Philippe Baud – Sophie Lemaitre IT-GD, CERN May 2005.

The Next Generation Root File Server Andrew Hanushevsky Stanford Linear Accelerator Center 27-September-2004

1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong

Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 19-May-09 ANL Tier3(g,w) Meeting.

Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL

April 2000Dr Milan Simic1 Network Operating Systems Windows NT.

Xrootd, XrootdFS and BeStMan Wei Yang US ATALS Tier 3 meeting, ANL 1.

Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.

Can we use the XROOTD infrastructure in the PROOF context ? The need and functionality of a PROOF Master coordinator has been discussed during the meeting.

11-July-2008Fabrizio Furano - Data access and Storage: new directions1.

D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.

FAX Redirection Topology Wei Yang 7/16/121. Redirector hardware at CERN Redundant redirectors for EU, UK, DE, FR – Redundant (the “+” sign below) VMs.

Introduction to HDFS Prasanth Kothuri, CERN 2 What’s HDFS HDFS is a distributed file system that is fault tolerant, scalable and extremely easy to expand.

CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd setup An introduction/tutorial for ALICE sysadmins.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1.

 CASTORFS web page - CASTOR web site - FUSE web site -

Xrootd Update Andrew Hanushevsky Stanford Linear Accelerator Center 15-Feb-05

Scalla Developer Summary xrootd /cmsd Andrew Hanushevsky SLAC National Accelerator Laboratory CERN Workshop 10-November-08

Redirector xrootd proxy mgr Redirector xrootd proxy mgr Xrd proxy data server N2N Xrd proxy data server N2N Global Redirector Client Backend Xrootd storage.

Status & Plan of the Xrootd Federation Wei Yang 13/19/12 US ATLAS Computing Facility Meeting at 2012 OSG AHM, University of Nebraska, Lincoln.

CERN IT Department CH-1211 Genève 23 Switzerland Internet Services Xrootd explained

02-June-2008Fabrizio Furano - Data access and Storage: new directions1.

Performance and Scalability of xrootd Andrew Hanushevsky (SLAC), Wilko Kroeger (SLAC), Bill Weeks (SLAC), Fabrizio Furano (INFN/Padova), Gerardo Ganis.

CERN IT Department CH-1211 Genève 23 Switzerland t Scalla/xrootd WAN globalization tools: where we are. Now my WAN is well tuned! So what?

ATLAS XRootd Demonstrator Doug Benjamin Duke University On behalf of ATLAS.

Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 08-June-10 ANL Tier3 Meeting.

Scalla Advancements xrootd /cmsd (f.k.a. olbd) Fabrizio Furano CERN – IT/PSS Andrew Hanushevsky Stanford Linear Accelerator Center US Atlas Tier 2/3 Workshop.

Scalla Authorization xrootd /cmsd Andrew Hanushevsky SLAC National Accelerator Laboratory CERN Seminar 10-November-08

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS XROOTD news New release New features.

JAliEn Java AliEn middleware A. Grigoras, C. Grigoras, M. Pedreira P Saiz, S. Schreiner ALICE Offline Week – June 2013.

AliEn central services Costin Grigoras. Hardware overview  27 machines  Mix of SLC4, SLC5, Ubuntu 8.04, 8.10, 9.04  100 cores  20 KVA UPSs  2 * 1Gbps.

Scalla In’s & Out’s xrootdcmsd xrootd /cmsd Andrew Hanushevsky SLAC National Accelerator Laboratory OSG Administrator’s Work Shop Stanford University/SLAC.

SRM Space Tokens Scalla/xrootd Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University 27-May-08

Scalla As a Full-Fledged LHC Grid SE Wei Yang, SLAC Andrew Hanushevsky, SLAC Alex Sims, LBNL Fabrizio Furano, CERN SLAC National Accelerator Laboratory.

Scalla + Castor2 Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University 27-March-07 Root Workshop Castor2/xrootd.

Federated Data Stores Volume, Velocity & Variety Future of Big Data Management Workshop Imperial College London June 27-28, 2013 Andrew Hanushevsky, SLAC.

11-June-2008Fabrizio Furano - Data access and Storage: new directions1.

Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,

Bestman & Xrootd Storage System at SLAC Wei Yang Andy Hanushevsky Alex Sim Junmin Gu.

Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.

New Development Efforts in GridFTP Raj Kettimuthu Math & Computer Science Division, Argonne National Laboratory, Argonne, IL 60439, U.S.A.

DCache/XRootD Dmitry Litvintsev (DMS/DMD) FIFE workshop1Dmitry Litvintsev.

Good user practices + Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CUF,

Scalla Update Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University 25-June-2007 HPDC DMG Workshop

A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.

New Features of Xrootd SE Wei Yang US ATLAS Tier 2/Tier 3 meeting, University of Texas, Arlington,

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Solutions for WAN data access: xrootd and NFSv4.1 Andrea Sciabà.

CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd LHC An up-to-date technical survey about xrootd- based storage solutions.

The ALICE Analysis -- News from the battlefield Federico Carminati for the ALICE Computing Project CHEP 2010 – Taiwan.

a brief summary for users

Blueprint of Persistent Infrastructure as a Service

Xrootd explained Cooperation among ALICE SEs

XRootD Release 4.5 And Beyond

Data access and Storage

Data Federation with Xrootd Wei Yang US ATLAS Computing Facility meeting Southern Methodist University, Oct 11-12, 2011.

Brookhaven National Laboratory Storage service Group Hironori Ito

Ákos Frohner EGEE'08 September 2008

Scalla/XRootd Advancements

File Transfer Protocol

Support for ”interactive batch”

Presentation transcript:

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features1

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features2

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features3 lfn2pfn prefix encoding Storage System (oss, drm/srm, etc) authentication (gsi, krb5, etc) Clustering (olbd) authorization (name based) File System (ofs, sfs, alice, etc) Protocol (1 of n) (xrootd) Protocol Driver (XRD)

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features4

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features5

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features6 Courtesy of Gerardo Ganis (CERN PH-SFT)

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features7 Courtesy of Gerardo Ganis (CERN PH-SFT)

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features8 Courtesy of Gerardo Ganis (CERN PH-SFT)

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features9

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features10

Application 09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features11 Client1 Server Client2 Client3 TCP (control)‏ Clients still see One Physical connection per server Clients still see One Physical connection per server TCP(data)‏ Async data gets automaticall y splitted Async data gets automaticall y splitted

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features12

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features13

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features14 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features15 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features16 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features17

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features18

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features19 Redirector xrootd:1094 Name Space xrootd:2094RedirectorHost ClientHost opendir create mkdir mv rm rmdir xrootd POSIX Client Kernel User Space Appl POSIX File System Interface FUSE FUSE/Xroot Interface Should run cnsd on servers to capture non-FUSE events

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features20

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features21

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features22

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features 23

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features24

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features25 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector (alirdr) all.role meta manager all.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/Includes CERN, GSI, and others xroot clusters Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing cmsd xrootd GSI all.manager meta alirdr.cern.ch:1312 all.role manager

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features26 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector all.role meta manager all.manager meta alirdr.cern.ch:1312 all.role manager Note: the security hats could require you use xrootd native proxy support cmsd xrootd GSI But missing a file? Ask to the global metamgr Get it from any other collaborating cluster all.manager meta alirdr.cern.ch:1312 Local clients work normally

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features27

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features28

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features29

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features30

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features31

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features32

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features33

09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features34