DCache Basics Alessandro Usai, Sergio Maffioletti Grid Group CSCS.

Slides:

Advertisements

Similar presentations

Introduction to Java 2 Programming Lecture 10 Applets.

Advertisements

Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen

Owen SyngeDCache Slide 1 D-Cache Status Report Owen Synge.

Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 6 Managing and Administering DNS in Windows Server 2008.

EGEE is a project funded by the European Union under contract IST Using SRM: DPM and dCache G.Donvito,V.Spinoso INFN Bari

Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.

NODEMANAGER WEBLOGIC SERVER. 1.Creating logical machines 2.Using nodemanager for server startup and shutdown GETTING STARTED.

(e)Science-Driven, Production- Quality, Distributed Grid and Cloud Data Infrastructure for the Transformative, Disruptive, Revolutionary, Next-Generation.

Installing software on personal computer

OSG Logging Architecture Update Center for Enabling Distributed Petascale Science Brian L. Tierney: LBNL.

By: Shawn Li. OUTLINE XML Definition HTML vs. XML Advantage of XML Facts Utilization SAX Definition DOM Definition History Comparison between SAX and.

Zhiling Chen (IPP-ETHZ) Doktorandenseminar June, 4 th, 2009.

RAL PPD Site Update and other odds and ends Chris Brew.

Introduction to CVMFS A way to distribute HEP software on cloud Tian Yan (IHEP Computing Center, BESIIICGEM Cloud Computing Summer School.

DCache at Tier3 Joe Urbanski University of Chicago US ATLAS Tier3/Tier2 Meeting, Bloomington June 20, 2007.

Csi315csi315 Client/Server Models. Client/Server Environment LAN or WAN Server Data Berson, Fig 1.4, p.8 clients network.

A. Sim, CRD, L B N L 1 OSG Applications Workshop 6/1/2005 OSG SRM/DRM Readiness and Plan Alex Sim / Jorge Rodriguez Scientific Data Management Group Computational.

G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.

CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.

1 Administering Shared Folders Understanding Shared Folders Planning Shared Folders Sharing Folders Combining Shared Folder Permissions and NTFS Permissions.

Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.

Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.

Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.

SAM Installation Lauri Loebel Carpenter and the SAM Team February

UMD TIER-3 EXPERIENCES Malina Kirn October 23, 2008 UMD T3 experiences 1.

LCG Storage workshop at CERN. July Geneva, Switzerland. BNL’s Experience dCache1.8 and SRM V2.2 Carlos Fernando Gamboa Dantong Yu RHIC/ATLAS.

Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Site Monitoring with Nagios E. Imamagic,

SRM Monitoring 12 th April 2007 Mirco Ciriello INFN-Pisa.

Creating and running an application.

1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.

SAN DIEGO SUPERCOMPUTER CENTER Inca Control Infrastructure Shava Smallen Inca Workshop September 4, 2008.

ABT is defined by the benefits it bring to its clients Over a Decade of Innovation & Reliability Sample Client Application List.

GGUS Slides for the 2012/07/24 MB Drills cover the period of 2012/06/18 (Monday) until 2012/07/12 given my holiday starting the following weekend. Remove.

INFSO-RI Enabling Grids for E-sciencE The gLite File Transfer Service: Middleware Lessons Learned form Service Challenges Paolo.

VO Box Issues Summary of concerns expressed following publication of Jeff’s slides Ian Bird GDB, Bologna, 12 Oct 2005 (not necessarily the opinion of)

Andrew McNab - Security issues - 4 Mar 2002 Security issues for TB1+ (some personal observations from a WP6 and sysadmin perspective) Andrew McNab, University.

INFSO-RI Enabling Grids for E-sciencE SRMv2.2 in DPM Sophie Lemaitre Jean-Philippe.

GridView - A Monitoring & Visualization tool for LCG Rajesh Kalmady, Phool Chand, Kislay Bhatt, D. D. Sonvane, Kumar Vaibhav B.A.R.C. BARC-CERN/LCG Meeting.

CernVM-FS Infrastructure for EGI VOs Catalin Condurache - STFC RAL Tier1 EGI Webinar, 5 September 2013.

BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.

Placeholder ES 1 CERN IT EGI Technical Forum, Experiment Support group AAI usage, issues and wishes for WLCG Maarten Litmaath CERN.

Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.

II EGEE conference Den Haag November, ROC-CIC status in Italy

Martina Franca (TA), 07 November Installazione, configurazione, testing e troubleshooting di Storage Element.

GGUS summary (3 weeks) VOUserTeamAlarmTotal ALICE7029 ATLAS CMS LHCb Totals

Open Science Grid Consortium Storage on Open Science Grid Placing, Using and Retrieving Data on OSG Resources Abhishek Singh Rana OSG Users Meeting July.

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.

DCache.ORG Fuhrman n Wuppertal Atlas GridKa Cloud dCache.ORG dCache best practice additional funding, support or contributions by d-grid DGI.

Security recommendations for dCache

Jean-Philippe Baud, IT-GD, CERN November 2007

Scalable sync-and-share service with dCache

Apache Ignite Data Grid Research Corey Pentasuglia.

NGI and Site Nagios Monitoring

Security aspects of the CREAM-CE

Farida Naz Andrea Sciabà

James Casey, IT-GD, CERN CERN, 5th September 2005

dCache “Intro” a layperson perspective Frank Würthwein UCSD

dCache Status and Plans – Proposals for SC3

Artem Trunov and EKP team EPK – Uni Karlsruhe

Network Requirements Javier Orellana

Discussions on group meeting

A Web-Based Data Grid Chip Watson, Ian Bird, Jie Chen,

Distributed P2P File System

Outline Chapter 2 (cont) OS Design OS structure

MORE ON ARCHITECTURES The main reasons for using an architecture are maintainability and performance. We want to structure the software into reasonably.

INFNGRID Workshop – Bari, Italy, October 2004

Installation Smooth sailing....

Presentation transcript:

DCache Basics Alessandro Usai, Sergio Maffioletti Grid Group CSCS

Swiss WLCG Experts Workshop – CSCS DCache General Architecture

Swiss WLCG Experts Workshop – CSCS At the core of DCache are subservices (cells) and domains (JVM) sub-services can run in different locations DCache is flexible

Swiss WLCG Experts Workshop – CSCS General comments It is all Java based i.e. platform independent (in principle) It is highly configurable (good) but complex (bad)…the documentation could (needs to) be improved, the logs are obscure (if not absent, unless you explicitly increase the debug level) Not easy to maintain upgrades Yaim component not powerful enough (i.e. you do it by hand)

Swiss WLCG Experts Workshop –

Swiss WLCG Experts Workshop – CSCS In a nutshell Pnfs needs to be mounted by the pool and admin nodes (they need to be authorized) Postgres configured to grant the admin node Thumpers installed by coping /opt/d-cache from the admin node and changing the configuration where required. Data and Control dirs are placed under /data1 and pointed to via sym links CAs and grid-mapfile regular update from CE (via cronjob)

Swiss WLCG Experts Workshop – CSCS Our Pools Configuration Read only and write only pools (to balance the load) p2p enabled (files are replicated for load reasons, only cache copies which get deleted if needed) Two movers queues: wan (gridftp) and default (dcap) 10 concurrent transfers at a time se02-lcg with dteam+ops,cms,atlas and se03-lcg with dteam+ops,cms,atlas,lhcb,hone,dech

Swiss WLCG Experts Workshop – CSCS Some problems we saw Logging obscure (difficult to troubleshoot) Domains duplication (as a result we got on board default configuration and a performance hit) Timeouts (a known problem still under investigation within the community) Various authentication problems due to misconfigurations (e.g. wrong VO tags)

Swiss WLCG Experts Workshop – CSCS How are we doing just now? How are we doing just now?

Swiss WLCG Experts Workshop – CSCS Tips and Advices Recommended: increase the logging level Install srmwatch (beware of the security holes though ) Get acquainted with the ssh interactive shell on the admin node (ssh -l admin -c blowfish -p localhost) The dcache admin web page is very useful ( In case off problems

Swiss WLCG Experts Workshop – CSCSReferences