Presentation is loading. Please wait.

Presentation is loading. Please wait.

11-July-2008Fabrizio Furano - Data access and Storage: new directions1.

Published byDomenic Golden Modified over 9 years ago

Similar presentations

Presentation on theme: "11-July-2008Fabrizio Furano - Data access and Storage: new directions1."— Presentation transcript:

1

2 11-July-2008Fabrizio Furano - Data access and Storage: new directions1

3 11-July-2008Fabrizio Furano - Data access and Storage: new directions2

4 11-July-2008Fabrizio Furano - Data access and Storage: new directions3

5 11-July-2008Fabrizio Furano - Data access and Storage: new directions4

6 11-July-2008Fabrizio Furano - Data access and Storage: new directions5

7 11-July-2008Fabrizio Furano - Data access and Storage: new directions6

8 11-July-2008Fabrizio Furano - Data access and Storage: new directions7

9 11-July-2008Fabrizio Furano - Data access and Storage: new directions8

10 11-July-2008Fabrizio Furano - Data access and Storage: new directions9 Pre-xfer data “locally” Pre-xfer data “locally” Legacy remote access Legacy remote access Remote access+ Remote access+ Data Processing Data access Overhead Need for potentially useless replicas And a huge Bookkeeping! Overhead Need for potentially useless replicas And a huge Bookkeeping! Latency Wasted CPU cycles But easy to understand Latency Wasted CPU cycles But easy to understand Interesting! Efficient practical Interesting! Efficient practical

11 Application 11-July-2008Fabrizio Furano - Data access and Storage: new directions10 Client1 Server Client2 Client3 TCP (control)‏ Clients still see One Physical connection per server Clients still see One Physical connection per server TCP(data)‏ Async data gets automaticall y splitted Async data gets automaticall y splitted

12 11-July-2008Fabrizio Furano - Data access and Storage: new directions11

13 11-July-2008Fabrizio Furano - Data access and Storage: new directions12

14 11-July-2008Fabrizio Furano - Data access and Storage: new directions13

15 11-July-2008Fabrizio Furano - Data access and Storage: new directions14

16 11-July-2008Fabrizio Furano - Data access and Storage: new directions15

17 11-July-2008Fabrizio Furano - Data access and Storage: new directions16 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector (alirdr) all.role meta manager all.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/Includes CERN, GSI, and others xroot clusters Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing cmsd xrootd GSI all.manager meta alirdr.cern.ch:1312 all.role manager

18 cmsd xrootd GSI 11-July-2008Fabrizio Furano - Data access and Storage: new directions17 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector all.role meta manager all.manager meta alirdr.cern.ch:1312 all.role manager But missing a file? Ask to the global metamgr Get it from any other collaborating cluster all.manager meta alirdr.cern.ch:1312 Local clients work normally

19 11-July-2008Fabrizio Furano - Data access and Storage: new directions18

20 11-July-2008Fabrizio Furano - Data access and Storage: new directions19

21 11-July-2008Fabrizio Furano - Data access and Storage: new directions20

22 11-July-2008Fabrizio Furano - Data access and Storage: new directions21

23 11-July-2008Fabrizio Furano - Data access and Storage: new directions22

24 11-July-2008Fabrizio Furano - Data access and Storage: new directions23

25 11-July-2008Fabrizio Furano - Data access and Storage: new directions24

26 11-July-2008Fabrizio Furano - Data access and Storage: new directions25

27 11-July-2008Fabrizio Furano - Data access and Storage: new directions26

28 11-July-2008Fabrizio Furano - Data access and Storage: new directions27 Courtesy of Gerardo Ganis (CERN PH-SFT)

29 11-July-2008Fabrizio Furano - Data access and Storage: new directions28 Courtesy of Gerardo Ganis (CERN PH-SFT)

Download ppt "11-July-2008Fabrizio Furano - Data access and Storage: new directions1."

Similar presentations

The Replica Location Service In wide area computing systems, it is often desirable to create copies (replicas) of data objects. Replication can be used.

The Replica Location Service In wide area computing systems, it is often desirable to create copies (replicas) of data objects. Replication can be used.
Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC

Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC
The Google File System. Why? Google has lots of data –Cannot fit in traditional file system –Spans hundreds (thousands) of servers connected to (tens.

The Google File System. Why? Google has lots of data –Cannot fit in traditional file system –Spans hundreds (thousands) of servers connected to (tens.
2/18/2004 Challenges in Building Internet Services February 18, 2004.

2/18/2004 Challenges in Building Internet Services February 18, 2004.
NAMED DATA NETWORKING IN CLIMATE RESEARCH AND HEP APPLICATIONS CHEP2015, APRIL 16 2015, OKINAWA, JAPAN Susmit Shannigrahi*, Artur Barczyk^, Christos Papadopoulos*,

NAMED DATA NETWORKING IN CLIMATE RESEARCH AND HEP APPLICATIONS CHEP2015, APRIL , OKINAWA, JAPAN Susmit Shannigrahi*, Artur Barczyk^, Christos Papadopoulos*,
Outline Network related issues and thinking for FAX Cost among sites, who has problems Analytics of FAX meta data, what are the problems  The main object.

Outline Network related issues and thinking for FAX Cost among sites, who has problems Analytics of FAX meta data, what are the problems  The main object.
1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP 2009 - Prague.

1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗

Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗
Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.

Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.
ALICE DATA ACCESS MODEL Outline 13.12.2012 ALICE data access model - PtP Network Workshop 2  ALICE data model  Some figures.

ALICE DATA ACCESS MODEL Outline ALICE data access model - PtP Network Workshop 2  ALICE data model  Some figures.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.

PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.

CERN IT Department CH-1211 Genève 23 Switzerland t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.
The Next Generation Root File Server Andrew Hanushevsky Stanford Linear Accelerator Center 27-September-2004

The Next Generation Root File Server Andrew Hanushevsky Stanford Linear Accelerator Center 27-September-2004
ALICE data access WLCG data WG revival 4 October 2013.

ALICE data access WLCG data WG revival 4 October 2013.
Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 19-May-09 ANL Tier3(g,w) Meeting.

Scalla/xrootd Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 19-May-09 ANL Tier3(g,w) Meeting.
Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL

Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL
Scalable Web Server on Heterogeneous Cluster CHEN Ge.

Scalable Web Server on Heterogeneous Cluster CHEN Ge.
Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.

Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.
July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.

Similar presentations

Ads by Google