Storage Management: MirrorDisk/UX, Online JFS Introduction LVM Striping Mirror Disk / UX – Basics Online Backups (lvsplit) Mirror Disk / UX – Advanced.

Slides:



Advertisements
Similar presentations
Storage Management Lecture 7.
Advertisements

By Rashid Khan Lesson 6-A Place for Everything: Storage Management.
The Zebra Striped Network Filesystem. Approach Increase throughput, reliability by striping file data across multiple servers Data from each client is.
Storage Systems: Advanced Topics Learning Objectives: To understand limitations of “one file system per partition” model To understand Logical Volume Management.
Allocation Methods - Contiguous
L V M A Logical Volume Manager for Linux by Heinz Mauelshagen Sistina, Inc.
Chapter 11: File System Implementation
Chapter 7: Configuring Server Storage, Backup, and Performance Options
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 12: Managing and Implementing Backups and Disaster Recovery.
Chapter 7: Configuring Disks. 2/24 Objectives Learn about disk and file system configuration in Vista Learn how to manage storage Learn about the additional.
MIS 431 Chapter 61 Chapter 6 – Managing Disk and Data Storage MIS 431 Created Spring 2006.
File System Implementation
Hands-On Microsoft Windows Server 2003 Administration Chapter 6 Managing Printers, Publishing, Auditing, and Desk Resources.
70-270, MCSE/MCSA Guide to Installing and Managing Microsoft Windows XP Professional and Windows Server 2003 Chapter Five Managing Disks and Data.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.
Simplify your Job – Automatic Storage Management Angelo Session id:
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 12: Managing and Implementing Backups and Disaster Recovery.
Module 8: Designing Active Directory Disaster Recovery in Windows Server 2008.
Storage and NT File System INFO333 – Lecture Mariusz Nowostawski Noria Foukia.
Hands-On Microsoft Windows Server 2008
1 Chapter 12 File Management Systems. 2 Systems Architecture Chapter 12.
Guide to Linux Installation and Administration, 2e 1 Chapter 9 Preparing for Emergencies.
Chapter 2 Installation Overview. Planning the Installation Questions: –Size of partitions –Where to put partitions –Which software packages to install.
Operating Systems (CS 340 D) Dr. Abeer Mahmoud Princess Nora University Faculty of Computer & Information Systems Computer science Department.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 12: Managing and Implementing Backups and Disaster Recovery.
Chapter 18: Windows Server 2008 R2 and Active Directory Backup and Maintenance BAI617.
Module 9: Configuring Storage
11 SYSTEM PERFORMANCE IN WINDOWS XP Chapter 12. Chapter 12: System Performance in Windows XP2 SYSTEM PERFORMANCE IN WINDOWS XP  Optimize Microsoft Windows.
JFS Tuning and Performance
11g(R1/R2) Data guard Enhancements Suresh Gandhi
Page 1 of John Wong CTO Twin Peaks Software Inc. Mirror File System A Multiple Server File System.
Chapter 3 Managing Disk and File Systems. File Storage Basics Windows XP supports two types of storage Basic Dynamic Basic storage system Centers on partitioning.
4.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 4: Organizing a Disk for Data.
MCTS Guide to Microsoft Windows Vista Chapter 4 Managing Disks.
Hp education services education.hp.com 50 LVM Problems Version C.00 H4264S Module 6 Slides.
1 Interface Two most common types of interfaces –SCSI: Small Computer Systems Interface (servers and high-performance desktops) –IDE/ATA: Integrated Drive.
Managing Disks and Drives Chapter 13 powered by dj.
Module 2 Configuring Disks and Device Drivers. Module Overview Partitioning Disks in Windows® 7 Managing Disk Volumes Maintaining Disks in Windows 7 Installing.
Chapter 1 Managing Storage. Contents Understanding Partitioning Understanding LVM Understanding RAID Understanding Clustering and GFS Using Access Control.
UNIX File and Directory Caching How UNIX Optimizes File System Performance and Presents Data to User Processes Using a Virtual File System.
Windows Server 2003 硬碟管理與磁碟機陣列 林寶森
Configuring Disk Devices. Module 4 – Configuring Disk Devices ♦ Overview This module deals with making partitions using fdisk, implementing RAID and Logical.
Week #3 Objectives Partition Disks in Windows® 7 Manage Disk Volumes Maintain Disks in Windows 7 Install and Configure Device Drivers.
"1"1 Introduction to Managing Data " Describe problems associated with managing large numbers of disks " List requirements for easily managing large amounts.
LVM & Mirror 中国惠普有限公司支持服务事业部 QIAN Yun Elements of LVM (逻辑卷管理器) physical Volumes 物理卷 volume Group 卷组 logical Volumes 逻辑卷 VG01 lvol1 /dev/rdsk/c0t0d0.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 12: File System Implementation File System Structure File System Implementation.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 11: File System Implementation.
System Administration – Part 2. Devices in UNIX are files: A device can be accessed with different file names All device files are stored in /dev or its.
4P13 Week 12 Talking Points Device Drivers 1.Auto-configuration and initialization routines 2.Routines for servicing I/O requests (the top half)

11.1 Silberschatz, Galvin and Gagne ©2005 Operating System Principles 11.5 Free-Space Management Bit vector (n blocks) … 012n-1 bit[i] =  1  block[i]
Chapter 14: Mass-Storage Systems Disk Structure. Disk Scheduling. RAID.
JFS Module Objectives Understand How to Install JFS 3.3 on HP-UX 11i and Understand JFS 3.3 Supported Configurations Understand New Features.
FILE SYSTEM IMPLEMENTATION 1. 2 File-System Structure File structure Logical storage unit Collection of related information File system resides on secondary.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
File-System Management
Storage HDD, SSD and RAID.
Answer to Summary Questions
L V M A Logical Volume Manager for Linux by Heinz Mauelshagen
Chapter 11: File System Implementation
Chapter 12: File System Implementation
VCS-257 Dumps Questions
Storage Virtualization
RAID RAID Mukesh N Tekwani
Overview Continuation from Monday (File system implementation)
Directory Structure A collection of nodes containing information about all files Directory Files F 1 F 2 F 3 F 4 F n Both the directory structure and the.
Btrfs Filesystem Chris Mason.
RAID RAID Mukesh N Tekwani April 23, 2019
Storage Management Lecture 7.
Presentation transcript:

Storage Management: MirrorDisk/UX, Online JFS Introduction LVM Striping Mirror Disk / UX – Basics Online Backups (lvsplit) Mirror Disk / UX – Advanced Mirrored Boot Devices Snapshots

Introducing the Journal File System Base Version Bundled Veritas Extended File System (VXFS) Fast fsck Extent-based allocation Enhanced mount options On-line JFS Additional Features On-Line Defragmentation On-Line Backup – Snapshot On-Line Growth/Reduction

Software Disk Striping When you use disk striping you create a Logical Volume that spans multiple disks, allowing successive blocks of logical extents to map to different disks. Valid stripe sizes are 4k, 8k. 16k, 32k, and 64k. The default size is 16k. You should match the stripe size with the block size of the file system (or a number evenly divisible by the stripe size). EG: If the planned block size for a filesystem is 16k, the stripe size should be 4, 8, or 16k. Note: You cannot use striping and mirroring on the same logical volume.

Striping – Benefits and Costs Benefits Data access performed over multiple disks simultaneously I/O can be balanced across interfaces Costs Hardware failure on a single disk may result in loss of portions of many files Entire files must be restored, even though only a portion was lost Added complexity Maximizing the Benefits of Striping

To maximize the benefits of striping it is best to spread the volumes across separate interfaces. Best performance results from a striped logical volume that spans similar disks Select the appropriate stripe size For HFS file systems match the block size. For JFS file systems, always use 64K stripes. For RAW data choose a size that matches the primary I/O size for the application. Creating Striped Logical Volumes

lvcreate –i stripes –I stripe_size [-l | -L space] [-n name] VG -inumber of disks to stripe across -Istripe size in kilobytes (4, 8, 16, 32, or 64) -ltotal space expressed in extents -Ltotal space expressed in megabytes -nname of the logical volume EG:lvcreate –i 3 –I 8 –L 24 –n lvstripe /dev/vg01

Implementing Mirroring

Mirrored I/O Scheduling

Protecting from Disk Failure PV0 Scheduled - returned PV1 Scheduled - returned PV2 Scheduled, returned – retry – unavailable High priority write of PV status to VGRA on all available pvs.

Mirrored Write Cache Tracking of pending I/O is done in a cache called Mirrored Write Cache (MWC). The MWC holds the status of write I/Os to a relatively large areas of a logical volume called Logical Track Groups (LTG). When a write I/O is scheduled it is resolved onto the LTG it affects. This entry in the cache is marked dirty. The I/O is scheduled, and when it completes the I/O is marked clean. The MWC can be turned off Provides a runtime performance gain Mirror resync takes longer At volume group activation if MWC is off then /usr/sbin/nomwcsyncd is started to do a background mirror resync You can never run this manually, if necessary deactivate and reactivate the volume group.

LVM Commands for Mirroring lvcreate [–m copies] [-L size in MB] VG lvextend [-m copies] LV PV lvreduce [-m copies] LV PV lvdisplay –v LV You may have 0, 1, or 2 copies of any given logical volume

LVM Commands for Synchronization lvsync LV vgsync VG Resynchronizes from one copy to make all mirror copies consistent Automatically done when a volume group that is not currently active, is activated. Rarely done manually.

Online Backups In this example you see lvol2 is mirrored with one copy on PV0 and one on PV1. A lvsplit operation will freeze the mirror copy and create a ‘backup’ logical volume which points to it. This can now be mounted and used while activity continues on the other PV. If you have three mirrors when you do this, you can take the backup while continuing to have data protection for the active volume. Once a backup has completed you can use the lvmerge command to resynchronize the mirrors.

Base JFS / Online JFS Base JFSOnline JFS Online Backupnot possibleonline, snapshot Extending fsoffline, extendfsonline, fsadm Reducing fsnot possibleonline, fsadm Defragmenting fsnot possibleonline, fsadm Fast recovery fsckyesyes

fsadm fsadm –F vxfs [-d] [-D] [-e] [-E] /mountpoint_dir fsadm-options: -F vxfsspecifies the journaled filesystem -dPerforms a directory defragmentation -DReport on directory fragmentation -ePerforms a file extent defragmentation -EReport on file extent fragmentation Regains lost performance Should be periodically used (between once a day and once a month) Can be done manually or scheduled with a cron-job The optimization runs online on a mounted JFS file system

Resizing

Increasing an Online JFS filesystem Extend the logical volume to the needed size: # lvextend –L new_size lvol_name The value of new_size is given in megabytes! Extend the JFS filesystem online: # fsadm –F vxfs –b new_size /mountpoint The value of new_size is given in kilobytes! Check the size of the increased file system: # bdf

Reducing an Online JFS filesystem Reorganize directories/file extents: # fsadm –F vxfs –d –D –e –E /mountpoint Reduce the JFS file system online: # fsadm –F vxfs –b new_size /mountpoint The value of new_size is given in kilobytes! Reduce the logical volume to the needed size: # lvreduce –L new_size lvolname The value of new_size is given in megabytes! Verify the size of the reduced file system: # bdf

Online Backup via Snapshot

Creating a snapshot Create a snapshot # mount –F vxfs –o snapof=/orig_vol /aux_vol /aux_dir /orig_volfile system, which you want to take a snapshot of /aux_vollogical volume to hold the snapshot (no file system) /aux_dirdirectory to mount the snapshot Backup from the snapshot file system # cd /aux_dir # tar cvf /dev/rmt/0mor # find. | cpio –ovcx > /dev/rmt/0mor # vxdump –f /dev/rmt/0m /aux_dir Unmount the snapshot, then lvremove the volume