STATUS OF DCACHE N2N AND MONITORING REPORT I. CURRENT SITUATION xrootd4j is a part of dCache implemented in such a way that each change requires new dCache.

Slides:



Advertisements
Similar presentations
Enabling Secure Internet Access with ISA Server
Advertisements

© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 8: Monitoring the Network Connecting Networks.
Computer Networks21-1 Chapter 21. Network Layer: Address Mapping, Error Reporting, and Multicasting 21.1 Address Mapping 21.2 ICMP 21.3 IGMP 21.4 ICMPv6.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 22 World Wide Web and HTTP.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2000 Ferry Astika Saputra Workshop Administrasi Jaringan TELNET & SSH.
11 TROUBLESHOOTING Chapter 12. Chapter 12: TROUBLESHOOTING2 OVERVIEW  Determine whether a network communications problem is related to TCP/IP.  Understand.
History DHCP was first defined as a standards track protocol in RFC 1531 in October 1993, as an extension to the Bootstrap Protocol (BOOTP). The motivation.
System Configuration: DHCP and Autoconfiguration Chapter 6.
Hypertext Transfer Protocol Kyle Roth Mark Hoover.
TCP/IP Protocol Suite 1 Chapter 21 Upon completion you will be able to: Network Management: SNMP Understand the SNMP manager and the SNMP agent Understand.
Hands-On Microsoft Windows Server 2003 Networking Chapter 6 Domain Name System.
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 8: Managing and Troubleshooting DNS.
Hands-On Microsoft Windows Server 2003 Networking Chapter 7 Windows Internet Naming Service.
Chapter 13 Chapter 13: Managing Internet and Network Interoperability.
Domain Name System: DNS
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 5 Introduction to DNS in Windows Server 2008.
1 Enabling Secure Internet Access with ISA Server.
Windows Server 2008 Chapter 8 Last Update
File Transfer Protocol CS-328 Dick Steflik. FTP RFC 959 uses two TCP Ports –one for control –one for data transfers command-response protocol control.
Hands-On Microsoft Windows Server 2008 Chapter 8 Managing Windows Server 2008 Network Services.
Managing DHCP. 2 DHCP Overview Is a protocol that allows client computers to automatically receive an IP address and TCP/IP settings from a Server Reduces.
Microsoft Windows 2003 Server. Client/Server Environment Many client computers connect to a server.
Dynamic Host Configuration Protocol (DHCP)
1 Lab 3 Transport Layer T.A. Youngjoo Han. 2 Transport Layer  Providing logical communication b/w application processes running on different hosts 
9/15/2015© 2008 Raymond P. Jefferis IIILect Application Layer.
70-291: MCSE Guide to Managing a Microsoft Windows Server 2003 Network Chapter 7: Domain Name System.
PACKET ANALYSIS WITH WIRESHARK DHCP, DNS, HTTP Chanhyun park.
ATLAS Off-Grid sites (Tier-3) monitoring A. Petrosyan on behalf of the ATLAS collaboration GRID’2012, , JINR, Dubna.
TeraPaths TeraPaths: establishing end-to-end QoS paths - the user perspective Presented by Presented by Dimitrios Katramatos, BNL Dimitrios Katramatos,
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
Digital Multimedia, 2nd edition Nigel Chapman & Jenny Chapman Chapter 17 This presentation © 2004, MacAvon Media Productions Multimedia and Networks.
Lec 3: Infrastructure of Network Management Part2 Organized by: Nada Alhirabi NET 311.
1 CMPT 471 Networking II IGMP (IPv4) and MLD (IPv6) © Janice Regan,
Computer Emergency Notification System (CENS)
Chapter 22 Network Layer: Delivery, Forwarding, and Routing Part 5 Multicasting protocol.
Xrootd Monitoring for the CMS Experiment Abstract: During spring and summer 2011 CMS deployed Xrootd front- end servers on all US T1 and T2 sites. This.
Xrootd Monitoring Atlas Software Week CERN November 27 – December 3, 2010 Andrew Hanushevsky, SLAC.
Data Communications and Computer Networks Chapter 2 CS 3830 Lecture 8 Omar Meqdadi Department of Computer Science and Software Engineering University of.
Redirector xrootd proxy mgr Redirector xrootd proxy mgr Xrd proxy data server N2N Xrd proxy data server N2N Global Redirector Client Backend Xrootd storage.
Status & Plan of the Xrootd Federation Wei Yang 13/19/12 US ATLAS Computing Facility Meeting at 2012 OSG AHM, University of Nebraska, Lincoln.
TFTP: Trivial file transfer protocol
Efi.uchicago.edu ci.uchicago.edu FAX status developments performance future Rob Gardner Yang Wei Andrew Hanushevsky Ilija Vukotic.
Multimedia and Networks. Protocols (rules) Rules governing the exchange of data over networks Conceptually organized into stacked layers – Application-oriented.
TCP/IP Protocol Suite 1 Chapter 10 Upon completion you will be able to: Internet Group Management Protocol Know the purpose of IGMP Know the types of IGMP.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 19 Domain Name System (DNS)
Chapter 17 BOOTP and DHCP.
Securing GroupWise ® end-to-end with SSL Mike Bills ATT Engineer, Novell Inc.
Digital Multimedia, 2nd edition Nigel Chapman & Jenny Chapman Chapter 17 This presentation © 2004, MacAvon Media Productions Multimedia and Networks.
27.1 Chapter 27 WWW and HTTP Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
CSI 3125, Preliminaries, page 1 Networking. CSI 3125, Preliminaries, page 2 Networking A network represents interconnection of computers that is capable.
Lecture 4 Mechanisms & Kernel for NOSs. Mechanisms for Network Operating Systems  Network operating systems provide three basic mechanisms that support.
FAX UPDATE 12 TH AUGUST Discussion points: Developments FAX failover monitoring and issues SSB Mailing issues Panda re-brokering to FAX Monitoring.
JavaScript and Ajax (Internet Background) Week 1 Web site:
RIP Routing Protocol. 2 Routing Recall: There are two parts to routing IP packets: 1. How to pass a packet from an input interface to the output interface.
Dynamic Host Configuration Protocol (DHCP) DHCP provides a temporary IP address for a limited period of time DHCP has two databases. First one has static.
TCP/IP Protocol Suite 1 Chapter 17 Upon completion you will be able to: Domain Name System: DNS Understand how the DNS is organized Know the domains in.
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
Week 11: Application Layer 1 Web and HTTP r Web page consists of objects r Object can be HTML file, JPEG image, Java applet, audio file,… r Web page consists.
27.1 Chapter 27 WWW and HTTP Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
ATLAS Off-Grid sites (Tier-3) monitoring A. Petrosyan on behalf of the ATLAS collaboration GRID’2012, , JINR, Dubna.
EU privacy issue Ilija Vukotic 6 th October 2014.
This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
1 Kyung Hee University Chapter 16 Host Configuration : BOOTP and DHCP.
IST 201 Chapter 11 Lecture 2. Ports Used by TCP & UDP Keep track of different types of transmissions crossing the network simultaneously. Combination.
Jean-Philippe Baud, IT-GD, CERN November 2007
Monitoring Of XRootD Federation
Multimedia and Networks
Chapter 8: Monitoring the Network
Chapter 16 Host Configuration : BOOTP and DHCP
Cloud computing mechanisms
Presentation transcript:

STATUS OF DCACHE N2N AND MONITORING REPORT I

CURRENT SITUATION xrootd4j is a part of dCache implemented in such a way that each change requires new dCache version xrootd4j for dCache versions and 2.2+ have different interfaces for authentication and authorization plugins. N2N Two versions available. Tested and working. dCache version is needed if simultaneous N2N and authentication are required. When given PFN it is transparent. To use gFLNs two pre-requisites: Variable $LFC_HOST to be defined and pointed appropriately Have ATLAS certificate proxy. Documented here:

CURRENT SITUATION Monitoring There is a program that once a minute queries dCache billing DB, makes UDP packets in the xrootd format and sends them to collector. Due to very low overlap of information collected from dCache and xrootd only two variables are sent: in and out traffic. Installed and working at MWT2 and AGLT2

FUTURE PLANS I Xrootd4j itself will become a plugin for dCache, thus enabling easier updates and independence from underlying dCache version. This will require new versions of dCache ( , 2.2.xxx, 2.4)

FUTURE PLANS II N2N There will be just one version of N2N. Already written and unofficially tested Monitoring We get access to most of messages between xrootd client and xrootd4j dCache server. Consequences of this approach: No need for a billing DB and extra process mining it. Gives us a lot of freedom. And we’ll need it. Makes us responsible for it’s performance Need to completely understand xrootd protocol Need to understand what part of it dCache supports Leaves us open to protocol changes Will take me some serious time to write it – week or two

FUTURE PLANS III We should get – hopefully this week a CERN based no- authentication needed copy of LFC to be used by European sites. Expectation is that no changes in N2N will be needed. We should test WebDAV read-only access to LFC Will need new versions of both N2N versions (C++ and Java)

RESERVE

EVENTS BASED Package version: 1.0 Connect event conn id (generated by server) host ip [client version] [protocol] File open event conn id filename file id (generated by server) size mode (r/w) File close event conn id file id bytes read/written [read ops, Vector read ops, write ops ] Disconnect event conn id Connection duration [optional] Events sends it’s info immediately. Collector does: dns lookups (host,client) joins info using connID, fileID

TIMER BASED EVENTS ( ~ ONCE A MINUTE) Package version: 1.0 Server version: xxx Server ip Total bytes read and written Current number of connections Number of connection attempts in last period Number of successful connections in last period List of fileIDs of all currently active files and bytes transferred to/from them.

OVERLAP select protocol, isnew, transfersize, connectiontime from billinginfo; protocol | isnew | transfersize | connectiontime GFtp-1.0 | t | 2698 | 9 GFtp-1.0 | f | | 46 DCap-3.0 | f | | DCap-3.0 | f | | 646 DCap-3.0 | f | | DCap-3.0 | f | | DCap-3.0 | f | | GFtp-1.0 | t | | 6769

DETAILS DCACHE 1 \d billinginfo Column | Type | datestamp | timestamp without time zone | :52: useless cellname | character varying | useless action | character varying | transfer useless - always transfer transaction | character varying | useless pnfsid | character varying | 00005D39999EFE644ABBB4E1DBBE1D4AA61F useless fullsize | numeric | transfersize | numeric | storageclass | character varying | useless isnew | boolean | f - read/write client | character varying | useless connectiontime | numeric | errorcode | numeric | 0 errormessage | character varying | '' protocol | character varying | DCap-3.0 initiator | character varying | door:DCap-umfs03- useless

DETAILS DCACHE 2 \d doorinfo Table "public.doorinfo" Column | Type | Modifiers datestamp | timestamp without time zone | :05: cellname | character varying | DCap-msufs11- action | character varying | request owner | character varying | /DC=org/DC=doegrids/OU=People/CN=Edward Diehl or unknown mappeduid | numeric | or -1 mappedgid | numeric | or -1 client | character varying | unknown transaction | character varying | door:DCap-umfs01- pnfsid | character varying | FC61A F651FC7E90E connectiontime | numeric | 2256 queuedtime | numeric | 0 errorcode | numeric | 0 errormessage | character varying | '' path | character varying | /pnfs/aglt2.org/atlashotdisk/cond10_data/000021/lar/cond10_data lar.COND/cond10_data lar.COND._0008.pool.ro ot