1. Novell BrainShare 2002
Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance
Ken Smallwood BscEE FC-SAN 1 and 2
Senior Storage Architect
XIOtech
IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

2. Agenda Current storage trends
Virtualization—Abstraction (man behind the curtain)
IP SAN’s iFCP, iSCSI FCIP
Fibre Channel SAN over WAN using DWDM, CWDM
SNIA examples of SoIP, ATM, etc... technologies
NetWare® REDI SAN-Links D/R example

3. Current Storage Trends

4. Current Storage Trends
Fibre Channel is mature and is the incumbent SAN media
Installed base growing faster than expected; ~70% of enterprises have implemented FC to date with IP SANs on the horizon
InfiniBand will also be used as interconnect to FC SANs from high-end servers; IP from low, mid-range
Netware 6 and future releases will continue to deliver a much better SAN-aware system than their competition

5. Enterprise Storage Trends
Virtualization—abstraction of detail
2Gig-10Gig Fibre Channel HBAs/devices
Path failover in fabric mesh topologies
100% fabric connectivity for both hosts and devices—no more AL except inside the storage cabinet
Third-party copy for server-less backup/restore

6. Subsystem Virtualization (“The Little Man Behind The Curtain”)

7. The SNIA Storage Virtualization Taxonomy
Novell BrainShare 2002
The SNIA Storage Virtualization Taxonomy
Storage Virtualization
Any type of virtualization that aggregates storage devices in the SNIA SSM block layer
Block
Virtualization
Disk
Virtualization
Tape
Tape Drive
Tape Library
Virtualization
File and Record
Virtualization
Storage device and
Storage subsystem
Virtualization
Host-based or
Server-based
Virtualization
Network-based
Virtualization
File System
Virtualization
File
Virtualization
In-band Virtualization
Out-of-band Virtualization
(Symmetrical Virtualization)
(Asymmetrical Virtualization)
IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

8. Virtualization “What Does It Really Mean”?
SNIA Definitions:
Block Virtualization: The act of applying virtualization to one or more block-based storage services for the purpose of providing a new block service to clients Some examples of block virtualization are disk aggregation. (Most vendors fall under this definition)
Storage Sub-System Virtualization: The implementation of virtualization in a storage subsystem such as a disk array
Storage Virtualization: The act of abstracting, hiding or isolating the internal function of a storage (sub) system or service from applications, host computers or general network resources for the purpose or enabling application, server, and network independent management of storage or data

9. Storage Sub-System Virtualization
Storage element abstraction—make storage easy to add, remove, discover, manage, and secure—reduces operating costs by reducing administration and downtime
Storage should follow the computation model—we have virtual primary memory, why not virtual storage?
Hide physical device detail from the OS
Mixing and matching any drive size or drive speed, within the same enclosure on same SCSI bus or FC_AL, without reducing capability to the lowest common denominator

10. Advantages of Storage Virtualization
Decrease time spent to manage real storage by orders of Magnitude (e.g., copy, swap, mirror, d/b re-org, defrag, change protection level, change stripe size)
Eliminate server down time needed to perform traditional storage management (add/change/delete/reconfigure LUNs)
Add servers online to storage; add storage online to servers; no down time

11. IP SANs

12. IP Storage Protocols
FCIP
iFCP
iSCSI
SoIP (not a protocol)

13. SAN Over WAN Using IP Why? Mainstream IP/GE networking
Familiar/well-understood technology
Trained staff/certifications
Network management tools
QoS and security features
Highly scalable (population/distance/speed)
10 Gigabit Ethernet entering market now
Mature IP standards and tools for QoS and security (802.3ad Link Aggregation, IPsec, etc)

14. FCIP Fibre Channel over IP

15. Creates single-fibre channel fabric
SAN Topologies—Fibre Channel over IP (FCIP)
Creates single-fibre channel fabric
Tunnel Session
FCIP
IP Network
FCIP
Fibre Channel
Switch
Fibre Channel
Switch
Fibre Channel
End Devices
Fibre Channel
End Devices
FCIP Tunneling
New York
New Jersey

16. FC Over Internet Protocol
Fibre channel extension strategy
IP used only for tunneling through WAN
Creates one logical fabric between remote SANs
Potentially disruptive if route loss occurs in WAN
No migration path to IP storage

17. iFCP Internet Fibre Channel Protocol

18. iFCP and Fibre Channel Protocol Stacks
Mature,
Tested
Mapping
FCP
SCSI
Stable
Works Okay
FCP
SCSI
iFCP
mFCP
Value-Add
Stable,
Reliable,
Interoperable
TCP
UDP
FC-2
FC-1
FC-0 IP
Ethernet
Interoperability
Issues
Physical
iFCP Stack
Fibre Channel Stack

19. = SAN Topologies—Internet FCP (iFCP) Maintains separate SANs
FC Host
FC Host
FC Tape
iFCP
Gateway
iFCP
Gateway
IP Metro or Wide Area Network
Device-to-Device Session
iFCP
Gateway
iFCP
Gateway
FC Switch
Maintains separate SANs
while providing connectivity
FC Host
FC Host

20. iFCP Protocol Support for Fibre Channel end devices
Any-to-any IP routing for storage traffic
Complements Fibre Channel fabrics with IP fabric
Not vulnerable to disruption at a local SAN
Designed as a migration path to IP storage

21. iSCSI Internet Small Computer Systems Interface

22. Native iSCSI Hosts and Storage
SAN Topologies—Internet SCSI (iSCSI)
iSCSI Host
iSCSI Host
iSCSI Tape
IP Metro or Wide Area Network
Native iSCSI Hosts and Storage
iSCSI Host
iSCSI Host

23. Internet SCSI Reconstruction of serial SCSI-3 layer
Assumes iSCSI initiators and iSCSI targets
Light switch solution for SANs
iSCSI-to-Fibre Channel not defined by standards
Designed as a replacement for Fibre Channel?
TOE (TCP Offload Engine) ASIC?

24. Fibre Channel SAN and DWDM/CRDM

25. SAN Over WAN Using DWDM/CRDM
Why?
Extends native FC to 80 km
Nortel claims 20 million miles of wavelength connectivity globally
Enables cost-effective use of leased or private fiber
Integrates Fibre Channel traffic with legacy services
ESCON, FDDI
Integrates storage traffic with LAN services
100 Mb Ethernet, 1 Gb Ethernet, upcoming 10 Gb Ethernet

26. Dense Wavelength Division Multiplexing
Novell BrainShare 2002
Dense Wavelength Division Multiplexing
DWDM
DWDM
March 2001, French and Japanese engineers had squeezed more than 10 trillion bits per second through single optical fibers in trial situations
IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance

27. FC DWDM Relative Pipe Size
GE or FC-1 Gb/s
OC Mb/s
OC-B Mb/s
Fast E-100 Mbs/s
T3 or DS Mb/s
Ethernet 10 Mb/s
T Mb/s

28. Disaster Recovery Examples

29. Remote Tape with Legato Networker
SNIA Example: SAN over WAN
Novell
Remote Disk with
Veritas Volume Manager over IP IP
Brocade
Brocade
McData 2
McData 1
ATM
CNT OSD
CNT OSD
ATTO
FibreBridge
Novell
XIOtech
SpectraLogic
Tape Library
CommVault Galaxy Tape Backup
Optera
Optera
Qlogic SANbox
Qlogic SANbox
Dark
Fiber
SpectraLogic
Tape Library
Novell
Crossroads 7100
Crossroads 7100
Remote Tape with Legato Networker
ATM

30. REDI SAN Links Backup Server WAN/MAN W2K NetWare Solaris
Servers require a backup application to be installed.
Backup
Server
Data is copied from one MAGNITUDE to the other via the backup server
Backup
Server
Tape Library
Brocade Switch/Fabric
Brocade Switch/Fabric
3000
3000
WAN/MAN
Data
PROCESS
VLink
Create VLinks to remote VDisks
Backup server configured for backup to disk
Data servers are backed up to VLinks
Secondary process backups up the remote VDisk to tape
VLink
Disaster
Recovery
Site
MAGNITUDE
MAGNITUDE

31. LAN 1 LAN 2 SERVER 1 SERVER 2 HBA 2 HBA 1 HBA 2 HBA 1 SWITCH 1
HAB 1
HAB 2
If LAN 1 fails, LAN 2 takes IP
If Server 1 fails, server 2 takes over services via clustering
If HBA 1 fails, HBA 2 takes active path via QMS failover
If Switch 1 fails, HBAs take active paths via QMS/switch 2
If HAB 1 fails, HBAs take active path via QMS/HAB 2
If MAG 1 fails, HBAs take active paths via VM/QMS failover
HAB 2
HAB 1
MAG 2
MAG 1

33. Distance and High Availability (HA) How to Solve The Problem?
Cluster on the same segment-subnet mask?
Heartbeat LAN connection? X2
Fibre Channel limits 10K channel extenders 120K
Fibre Infrastructure multiply fibre connections

34. FC High Availability over DWDM
Resolves multiple cluster option
Heartbeat connectivity
Multiply Fibre Channel FCP-SCSI-3 transport layers
Multiplex 64 circuits or 32 protected circuits

35. Novell BrainShare 2002
IO303—Introduction to IPSAN, Fibre Channel SAN, and Design of Disaster Recovery over Distance