02-June-2008Fabrizio Furano - Data access and Storage: new directions1
02-June-2008Fabrizio Furano - Data access and Storage: new directions2
02-June-2008Fabrizio Furano - Data access and Storage: new directions3
02-June-2008Fabrizio Furano - Data access and Storage: new directions4
02-June-2008Fabrizio Furano - Data access and Storage: new directions5
02-June-2008Fabrizio Furano - Data access and Storage: new directions6 Courtesy of Gerardo Ganis (CERN PH-SFT)
02-June-2008Fabrizio Furano - Data access and Storage: new directions7 Courtesy of Gerardo Ganis (CERN PH-SFT)
02-June-2008Fabrizio Furano - Data access and Storage: new directions8
02-June-2008Fabrizio Furano - Data access and Storage: new directions9
02-June-2008Fabrizio Furano - Data access and Storage: new directions10
02-June-2008Fabrizio Furano - Data access and Storage: new directions11 Pre-xfer data “locally” Pre-xfer data “locally” Remote access Remote access Remote access+ Remote access+ Data Processing Data access Overhead Need for potentially useless replicas And a huge Bookkeeping! Overhead Need for potentially useless replicas And a huge Bookkeeping! Latency Wasted CPU cycles But easy to understand Latency Wasted CPU cycles But easy to understand Interesting! Efficient practical Interesting! Efficient practical
Application 02-June-2008Fabrizio Furano - Data access and Storage: new directions12 Client1 Server Client2 Client3 TCP (control) Clients still see One Physical connection per server Clients still see One Physical connection per server TCP(data) Async data gets automaticall y splitted Async data gets automaticall y splitted
02-June-2008Fabrizio Furano - Data access and Storage: new directions13
09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features14 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007
09-Apr-2008Fabrizio Furano - Scalla/xrootd status and features15 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007
02-June-2008Fabrizio Furano - Data access and Storage: new directions16
02-June-2008Fabrizio Furano - Data access and Storage: new directions17
02-June-2008Fabrizio Furano - Data access and Storage: new directions18
02-June-2008Fabrizio Furano - Data access and Storage: new directions19 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector (alirdr) all.role meta manager all.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/Includes CERN, GSI, and others xroot clusters Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing cmsd xrootd GSI all.manager meta alirdr.cern.ch:1312 all.role manager
cmsd xrootd GSI 02-June-2008Fabrizio Furano - Data access and Storage: new directions20 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector all.role meta manager all.manager meta alirdr.cern.ch:1312 all.role manager Note: the security hats could require you use xrootd native proxy support But missing a file? Ask to the global metamgr Get it from any other collaborating cluster all.manager meta alirdr.cern.ch:1312 Local clients work normally
02-June-2008Fabrizio Furano - Data access and Storage: new directions21
02-June-2008Fabrizio Furano - Data access and Storage: new directions22
02-June-2008Fabrizio Furano - Data access and Storage: new directions23
02-June-2008Fabrizio Furano - Data access and Storage: new directions24
02-June-2008Fabrizio Furano - Data access and Storage: new directions25
02-June-2008Fabrizio Furano - Data access and Storage: new directions26
02-June-2008Fabrizio Furano - Data access and Storage: new directions27 Redirector xrootd:1094 Name Space xrootd:2094RedirectorHost ClientHost opendir create mkdir mv rm rmdir xrootd POSIX Client Kernel User Space Appl POSIX File System Interface FUSE FUSE/Xroot Interface Should run cnsd on servers to capture non-FUSE events And keep the FS namespace!
02-June-2008Fabrizio Furano - Data access and Storage: new directions28
02-June-2008Fabrizio Furano - Data access and Storage: new directions29
02-June-2008Fabrizio Furano - Data access and Storage: new directions30