Novell BrainShare 2002 Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance Ken Smallwood BscEE FC-SAN 1 and 2 Senior Storage Architect XIOtech kenneth_smallwood@xiotech.com IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

Agenda Current storage trends Virtualization—Abstraction (man behind the curtain) IP SAN’s iFCP, iSCSI FCIP Fibre Channel SAN over WAN using DWDM, CWDM SNIA examples of SoIP, ATM, etc... technologies NetWare® REDI SAN-Links D/R example

Current Storage Trends

Current Storage Trends Fibre Channel is mature and is the incumbent SAN media Installed base growing faster than expected; ~70% of enterprises have implemented FC to date with IP SANs on the horizon InfiniBand will also be used as interconnect to FC SANs from high-end servers; IP from low, mid-range Netware 6 and future releases will continue to deliver a much better SAN-aware system than their competition

Enterprise Storage Trends Virtualization—abstraction of detail 2Gig-10Gig Fibre Channel HBAs/devices Path failover in fabric mesh topologies 100% fabric connectivity for both hosts and devices—no more AL except inside the storage cabinet Third-party copy for server-less backup/restore

Subsystem Virtualization (“The Little Man Behind The Curtain”)

The SNIA Storage Virtualization Taxonomy Novell BrainShare 2002 The SNIA Storage Virtualization Taxonomy Storage Virtualization Any type of virtualization that aggregates storage devices in the SNIA SSM block layer Block Virtualization Disk Virtualization Tape Tape Drive Tape Library Virtualization File and Record Virtualization Storage device and Storage subsystem Virtualization Host-based or Server-based Virtualization Network-based Virtualization File System Virtualization File Virtualization In-band Virtualization Out-of-band Virtualization (Symmetrical Virtualization) (Asymmetrical Virtualization) IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

Virtualization “What Does It Really Mean”? SNIA Definitions: Block Virtualization: The act of applying virtualization to one or more block-based storage services for the purpose of providing a new block service to clients Some examples of block virtualization are disk aggregation. (Most vendors fall under this definition) Storage Sub-System Virtualization: The implementation of virtualization in a storage subsystem such as a disk array Storage Virtualization: The act of abstracting, hiding or isolating the internal function of a storage (sub) system or service from applications, host computers or general network resources for the purpose or enabling application, server, and network independent management of storage or data

Storage Sub-System Virtualization Storage element abstraction—make storage easy to add, remove, discover, manage, and secure—reduces operating costs by reducing administration and downtime Storage should follow the computation model—we have virtual primary memory, why not virtual storage? Hide physical device detail from the OS Mixing and matching any drive size or drive speed, within the same enclosure on same SCSI bus or FC_AL, without reducing capability to the lowest common denominator

Advantages of Storage Virtualization Decrease time spent to manage real storage by orders of Magnitude (e.g., copy, swap, mirror, d/b re-org, defrag, change protection level, change stripe size) Eliminate server down time needed to perform traditional storage management (add/change/delete/reconfigure LUNs) Add servers online to storage; add storage online to servers; no down time

IP SANs

IP Storage Protocols FCIP iFCP iSCSI SoIP (not a protocol)

SAN Over WAN Using IP Why? Mainstream IP/GE networking Familiar/well-understood technology Trained staff/certifications Network management tools QoS and security features Highly scalable (population/distance/speed) 10 Gigabit Ethernet entering market now Mature IP standards and tools for QoS and security (802.3ad Link Aggregation, IPsec, etc)

FCIP Fibre Channel over IP

Creates single-fibre channel fabric SAN Topologies—Fibre Channel over IP (FCIP) Creates single-fibre channel fabric Tunnel Session FCIP IP Network FCIP Fibre Channel Switch Fibre Channel Switch Fibre Channel End Devices Fibre Channel End Devices FCIP Tunneling New York New Jersey

FC Over Internet Protocol Fibre channel extension strategy IP used only for tunneling through WAN Creates one logical fabric between remote SANs Potentially disruptive if route loss occurs in WAN No migration path to IP storage

iFCP Internet Fibre Channel Protocol

iFCP and Fibre Channel Protocol Stacks Mature, Tested Mapping FCP SCSI Stable Works Okay FCP SCSI iFCP mFCP Value-Add Stable, Reliable, Interoperable TCP UDP FC-2 FC-1 FC-0 IP Ethernet Interoperability Issues Physical iFCP Stack Fibre Channel Stack

= SAN Topologies—Internet FCP (iFCP) Maintains separate SANs FC Host FC Host FC Tape iFCP Gateway iFCP Gateway IP Metro or Wide Area Network Device-to-Device Session iFCP Gateway iFCP Gateway FC Switch Maintains separate SANs while providing connectivity FC Host FC Host

iFCP Protocol Support for Fibre Channel end devices Any-to-any IP routing for storage traffic Complements Fibre Channel fabrics with IP fabric Not vulnerable to disruption at a local SAN Designed as a migration path to IP storage

iSCSI Internet Small Computer Systems Interface

Native iSCSI Hosts and Storage SAN Topologies—Internet SCSI (iSCSI) iSCSI Host iSCSI Host iSCSI Tape IP Metro or Wide Area Network Native iSCSI Hosts and Storage iSCSI Host iSCSI Host

Internet SCSI Reconstruction of serial SCSI-3 layer Assumes iSCSI initiators and iSCSI targets Light switch solution for SANs iSCSI-to-Fibre Channel not defined by standards Designed as a replacement for Fibre Channel? TOE (TCP Offload Engine) ASIC?

Fibre Channel SAN and DWDM/CRDM

SAN Over WAN Using DWDM/CRDM Why? Extends native FC to 80 km Nortel claims 20 million miles of wavelength connectivity globally Enables cost-effective use of leased or private fiber Integrates Fibre Channel traffic with legacy services ESCON, FDDI Integrates storage traffic with LAN services 100 Mb Ethernet, 1 Gb Ethernet, upcoming 10 Gb Ethernet

Dense Wavelength Division Multiplexing Novell BrainShare 2002 Dense Wavelength Division Multiplexing DWDM DWDM March 2001, French and Japanese engineers had squeezed more than 10 trillion bits per second through single optical fibers in trial situations IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

FC DWDM Relative Pipe Size GE or FC-1 Gb/s OC-12-622.08 Mb/s OC-B-155.52 Mb/s Fast E-100 Mbs/s T3 or DS3-44.736 Mb/s Ethernet 10 Mb/s T1-1.544 Mb/s

Disaster Recovery Examples

Remote Tape with Legato Networker SNIA Example: SAN over WAN Novell Remote Disk with Veritas Volume Manager over IP IP Brocade Brocade McData 2 McData 1 ATM CNT OSD CNT OSD ATTO FibreBridge Novell XIOtech SpectraLogic Tape Library CommVault Galaxy Tape Backup Optera Optera Qlogic SANbox Qlogic SANbox Dark Fiber SpectraLogic Tape Library Novell Crossroads 7100 Crossroads 7100 Remote Tape with Legato Networker ATM

REDI SAN Links Backup Server WAN/MAN W2K NetWare Solaris Servers require a backup application to be installed. Backup Server Data is copied from one MAGNITUDE to the other via the backup server Backup Server Tape Library Brocade Switch/Fabric Brocade Switch/Fabric 3000 3000 WAN/MAN Data PROCESS VLink Create VLinks to remote VDisks Backup server configured for backup to disk Data servers are backed up to VLinks Secondary process backups up the remote VDisk to tape VLink Disaster Recovery Site MAGNITUDE MAGNITUDE

LAN 1 LAN 2 SERVER 1 SERVER 2 HBA 2 HBA 1 HBA 2 HBA 1 SWITCH 1 HAB 1 HAB 2 If LAN 1 fails, LAN 2 takes IP If Server 1 fails, server 2 takes over services via clustering If HBA 1 fails, HBA 2 takes active path via QMS failover If Switch 1 fails, HBAs take active paths via QMS/switch 2 If HAB 1 fails, HBAs take active path via QMS/HAB 2 If MAG 1 fails, HBAs take active paths via VM/QMS failover HAB 2 HAB 1 MAG 2 MAG 1

Distance and High Availability (HA) How to Solve The Problem? Cluster on the same segment-subnet mask? Heartbeat LAN connection? X2 Fibre Channel limits 10K channel extenders 120K Fibre Infrastructure multiply fibre connections

FC High Availability over DWDM Resolves multiple cluster option Heartbeat connectivity Multiply Fibre Channel FCP-SCSI-3 transport layers Multiplex 64 circuits or 32 protected circuits

Novell BrainShare 2002 IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance