Policies in Distributed Data Storage

Slides:



Advertisements
Similar presentations
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
Advertisements

© 2006 DataCore Software Corp SANmotion New: Simple and Painless Data Migration for Windows Systems Note: Must be displayed using PowerPoint Slideshow.
Introduction to Storage Area Network (SAN) Jie Feng Winter 2001.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
Network-Attached Storage
1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.
An Adaptable Benchmark for MPFS Performance Testing A Master Thesis Presentation Yubing Wang Advisor: Prof. Mark Claypool.
Consistency in NFS and AFS. Network File System (NFS) Uses client caching to reduce network load Built on top of RPC Server cache: X Client A cache: XClient.
Comparison and Performance Evaluation of SAN File System Yubing Wang & Qun Cai.
OSD Metadata Management
Distributed File System: Design Comparisons II Pei Cao Cisco Systems, Inc.
PRASHANTHI NARAYAN NETTEM.
World Wide Web Caching: Trends and Technology Greg Barish and Katia Obraczka USC Information Science Institute IEEE Communications Magazine, May 2000 Presented.
Distributed File Systems Sarah Diesburg Operating Systems CS 3430.
Lecture 23 The Andrew File System. NFS Architecture client File Server Local FS RPC.
File Systems and N/W attached storage (NAS) | VTU NOTES | QUESTION PAPERS | NEWS | VTU RESULTS | FORUM | BOOKSPAR ANDROID APP.
Presented by: Alvaro Llanos E.  Motivation and Overview  Frangipani Architecture overview  Similar DFS  PETAL: Distributed virtual disks ◦ Overview.
Distributed File Systems Concepts & Overview. Goals and Criteria Goal: present to a user a coherent, efficient, and manageable system for long-term data.
SANPoint Foundation Suite HA Robert Soderbery Sr. Director, Product Management VERITAS Software Corporation.
Cluster Shared Volumes Reborn in Windows Server 2012 Gareth JamesHani AdhamiSenior Consultant WSV423.
Module 12: Designing High Availability in Windows Server ® 2008.
A brief overview about Distributed Systems Group A4 Chris Sun Bryan Maden Min Fang.
Distributed Systems. Interprocess Communication (IPC) Processes are either independent or cooperating – Threads provide a gray area – Cooperating processes.
All the components of network are connected to the central device called “hub” which may be a hub, a router or a switch. There is no direct traffic between.
Large Scale Test of a storage solution based on an Industry Standard Michael Ernst Brookhaven National Laboratory ADC Retreat Naples, Italy February 2,
1 U.S. Department of the Interior U.S. Geological Survey Contractor for the USGS at the EROS Data Center EDC CR1 Storage Architecture August 2003 Ken Gacke.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
Switched Storage Architecture Benefits Computer Measurements Group November 14 th, 2002 Yves Coderre.
Serverless Network File Systems Overview by Joseph Thompson.
Sun Network File System Presentation 3 Group A4 Sean Hudson, Syeda Taib, Manasi Kapadia.
Distributed File Systems 11.2Process SaiRaj Bharath Yalamanchili.
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Lecture 24: GFS.
Primitive Concepts of Distributed Systems Chapter 1.
An Introduction to GPFS
GPFS Parallel File System
Testing the Zambeel Aztera Chris Brew FermilabCD/CSS/SCS Caveat: This is very much a work in progress. The results presented are from jobs run in the last.
Ryan Leonard Storage and Solutions Architect
Network Attached Storage Overview
Distributed File Systems
File Share Dependencies
ETERNUS DX100 S3, DX200 S3, DX500 S3 and DX600 S2
Andrew File System (AFS)
Cloud Computing CS Distributed File Systems and Cloud Storage – Part I
Storage Networking.
Distributed Systems CS
Introduction to Networks
Introduction to Networks
Storage Virtualization
Module – 7 network-attached storage (NAS)
A Survey on Distributed File Systems
Replication Middleware for Cloud Based Storage Service
Storage Networking.
Storage Networks and Storage Devices
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Multiple Processor Systems
Distributed File Systems
DISTRIBUTED FILE SYSTEMS
Distributed File Systems
Outline Announcements Lab2 Distributed File Systems 1/17/2019 COP5611.
NeST: Network Storage Technologies
Distributed File Systems
Multiple Processor and Distributed Systems
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
Database System Architectures
Distributed File Systems
Distributed File Systems
CS 295: Modern Systems Organizing Storage Devices
Network File System (NFS)
Presentation transcript:

Policies in Distributed Data Storage Presented by: Ajay Potnis Professor: Craig E. Wills December 2000

Acknowledgements Professor Craig E. Wills Uresh Vahalia Xiaoye Jiang Gary Ma Jiannan Zheng Yael Melman Mrunal Potnis Aditya Potnis

Goal Study various distributed architectures NFS xFS SAN SSFS Conclusion

Direct Attached Storage Data Storage Unit Data on SCCI/Fibre

Direct Attached Storage Channel I/O Speed Can select the desired storage No sharing No flexibility

NFS Data Storage Unit Data and Metadata Data on SCCI/Fibre File Server

NFS Simple client server semantics using LAN/WAN Server is the owner of file system Uses RPC for communication NFS with Mount protocol makes FS locally available Support for advisory locking using NLM Caching in memory/on disk improves performance on clients (stale data) Data can be shared by multiple clients Administration is easy due to centralization of data Server can provide scalability, high availability, online maintenance, etc.

xFS Client Client and Manager Forward Request Data Storage Unit Data Data on SCCI/Fibre Data Storage Server

xFS Server-less architecture (clients, storage servers and managers) Distributes cache, storage and metadata management over machines Uses a stateful protocol Uses Active Messages instead of RPC for communication Multiple managers could lead to more network traffic Flexibility adding many clients, managers and storage servers Client write data to storage server before giving it to another client to avoid consistency problems in failures Increased circular dependencies and complexities

SAN (switched fabric) File Server Data Storage Unit Switch Data Data Data on Fibre

SAN Connects multiple clients to multiple storage drives Storage can be configured at will Needs good management tools and good Sys Admin skills No seamless sharing of same storage by multiple clients/servers

SSFS Client 1 Data on SCCI / Fibre 1.Metadata Request 2. Metadata Data Storage Unit uses SAN Data on SCCI / Fibre for NAS Server 2. Metadata 1.Metadata Request Data on SCCI / Fibre Client 2

SSFS Client-Server-Storage semantics using NAS and SAN NAS for sharing, SAN for channel I/O speed File sharing among heterogeneous clients Concurrent sharing among NAS and SAN clients Server is the owner of metadata and storage RPC communication for metadata exchange over network Caching in memory improves performance on clients (stale data not possible because of callbacks) Read/Write throughput increased since data goes at channel speed (can use multiple SCSI/fibre paths to write) Multiple clients can use the same storage device Scalability, high availability, transparent to applications Failure recovery built in the protocol

Conclusion Why not get two birds in one shot?