1. Storage System Lab SKKU 0 SAN Management and Application 성균관대학교 저장시스템 연구실 윤 희용 2001. 9. 11 21 세기 유망핵심부품 기술 세미나

2. Storage System Lab SKKU 1 Outline SAN Architecture and Model SAN Technology Trends SAN Management Architecture SAN Applications SAN File System SAN Standardization SAN Hot Issues Conclusion

3. Storage System Lab SKKU 2 SAN Architecture SAN Management SAN Interface SAN Hardware Base Storage Extract the value of data Backup / Recovery Outboard data movement Clustering, data sharing Zero latency, one-touch management Centralized local point Reduced cost Flexibility and automation Migration paths Investment protection Fibre channel Distance, speed, reliability Hubs, switches Any storage to any system SAN-enabled Native attachments SAN-aware SAN from initiative to implementation Reduced time & cost to implement Skilled resources SAN integration, testing, & verification Services and Support Solutions SAN Application

4. Storage System Lab SKKU 3 Storage Model Storage domain File/record layer Block layer Storage devices (disks, …) Services Discovery, monitoring Resource mgmt, configuration Security, billing Redundancy mgmt (backup, …) High availability (fail-over, …) Capacity planning Database (dbms) File system (fs) Network Host Device Block aggregation Application

5. Storage System Lab SKKU 4 Storage Model – Full function View Host. with LVM and software RAID 1. Direct-attach File/record layer Block layer Device block-aggregation SN block-aggregation Host block-aggregation NAS head 4. NAS head 2. SN-attach Host. with LVM Disk array SN 5. SN aggregation Aggregation appliance Block metadata server File metadata server 6. Metadata aggr’n Application 3. NAS server LAN Host NAS server

6. Storage System Lab SKKU 5 Storage Model – Multi-site Block Storage Disk array SN Aggregation appliance Host. with LVM Application Disk array Aggregation appliance Host. with LVM Application SN appliances WAN Host-to-host Functions: point-in-time copy, caching, local & remote mirroring, … WAN Device-to-device Device block-aggregation SN block-aggregation Host block-aggregation

7. Storage System Lab SKKU 6 Why Networked Storage? Doubling every 8-9 months optical networks speed Doubling every 12 months storage capacity Doubling every 18 months computing power Moore’s Law

8. Storage System Lab SKKU 7 Storage and Network Convergence IP Networking External Storage Optical Networking StorageNetworking

9. Storage System Lab SKKU 8 Technology Trend – Fibre Channel Fibre Channel provides new levels of Bandwidth, Connectivity, and Flexibility –Switches provide non-blocking 100 MB/sec (1 Gbit/sec) per port with any-to-any connectivity –Long-wave ports provide up to 10 km distance Future Developments: –Large port-count switches (~ 256) –Fibre Channel has grown to 2 Gbit/sec 10 Gbit/sec in 2-3 years

10. Storage System Lab SKKU 9 SAN Connectivity Evolution DATA CENTER ESCON / BUS & TAG 1990 199 8 FCA L FC-AL HU B SWITC H FC- SW 199 9 1-11 KM CAMP US REMOT E 1994 SCS I25 M 1997 FC-AL (Point-to- Point) 500M 200 1 FC- SW SWITC HMAN 100Km DWDM SWITCH FC - SW Global IP-SAN 1,000+ Km FC- SW FC / ISCSI 2002+ SWITCH FC - SW

11. Storage System Lab SKKU 10 Conventional IT Organization Network used for exchange of data between clients and servers and between servers themselves. Difficult to manage, wasted resources, often unprotected: Impossible to scale Heterogeneous Servers Client Network Clients LAN UNIX NT MVS

12. Storage System Lab SKKU 11 IT Organization with Enterprise Storage Network used for exchange of data between clients and servers and between servers themselves. Heterogeneous Servers Client Network Clients LAN UNIX NT MVS Enterprise Storage Enterprise Storage provides storage and exchange of data by servers Simpler to manage, resources easily re-deployed, superior protection Simpler to manage, resources easily re-deployed, superior protection. The next stage of manageability and scalability

13. Storage System Lab SKKU 12 IT Organization SAN Data Logistics Information Move Backup/Restore Information Mgmt Cluster Support Data Presentation Information visualization using HTML, Java, etc. Storage Area Network Heterogeneous Servers Client Network Clients LAN UNIXNT MVS NAS Appliance

14. Storage System Lab SKKU 13 Why Networked Storage? Consolidation - Application Server and Storage –Storage Consolidation Management - Total Cost of Ownership (TCO) Disaster recovery - Backup / Restore Availability Forever –7 x 24 x Forever Flexibility –Rapid adaptation of changes in business requirements Capacity Expansion Performance Configuration

15. Storage System Lab SKKU 14 Shift in Customer Perceptions IT contributes to revenuegrowth 1) IT saves dollars IT contributes to revenue growth Put information needs first 2) Choose technology first Put information needs first Managing information 3) Managing technology Managing information Total cost of ownership 4) Acquisition costs Total cost of ownership Change-tolerant infrastructure Flexibility, compatibility 5) Rigid infrastructure Change-tolerant infrastructure Technology / Vendor lock-in Flexibility, compatibility

16. Storage System Lab SKKU 15 SNIA Management Standards - 1999 – Common Information Model (CIM) – Simple Network Management Protocol- Management Information Bases (SNMP-MIB) Reviewed and assisted in the standardization of two SNMP MIBS – Fibre Alliance MIB in process within IETF – Creation of new MIB for Storage Libraries (First MIB to use CIM schema ) SNIA CIM schema definitions submitted for CIM V2.2 – Storage Media Library (SML WG) – Disk Resource Management (DRM WG) – Fibre Channel (FC WG) October 1999 Storage Networking World First demonstration of V2.2 CIM web based technology

17. Storage System Lab SKKU 16 SNIA Management Standards – 1 st half 2000 Education –Release of the first Storage Networking Dictionary to the industry –Successful completion of three major industry events: The SNIA workgroup conference - Feb 2000 Spring Storage Networking World - April 2000 CIFS 2000 Conference and Interoperability Lab - May 2000 Management –Delivery of Industry first Open Source - CIM-OM (CIM-Object Manager) Disaster Recovery - Backup –SCSI-3 extended copy command Submitted to ANSI T10 –Driving the NDMP version 4 development

18. Storage System Lab SKKU 17 SNIA Management Standards – 2nd half 2000 Education –The SNIA workgroup Symposium - Sept. 2000 –Vendor and IT Consumer Surveys –Fall Storage Networking World 2000 –Architectural white papers Interoperability –Continued Standardization of CIFS (Common Internet File System) –Test plans and reference implementations for new and existing standards Management –Adoption of the SNIA developed HBA-API by T11 –Management models for extended copy sessions –MIBs and extensions to the CIM Schema for storage management Disaster Recovery –APIs for snapshot and checkpoint

19. Storage System Lab SKKU 18 SNIA Management Standards – 2001 Grand Opening of the SNIA Technology Center Jan ‘01 SNIA-Japan - SNW Japan Jan. ‘01 SNIA Shared Storage Model March ‘01 Spring Storage Networking World April ‘01 Spring SNIA Work Group Symposium April ‘01 Summer SNIA Work Group Symposium June ‘01 SNIA CIFS Conference Aug ‘01 European Storage Networking World Sept. ‘01 Fall Storage Networking World USA Oct. ‘01

20. Storage System Lab SKKU 19 SAN Management Architecture

21. Storage System Lab SKKU 20 SAN Management Architecture – EMS & CMS EMS ☞ SNMP based service ☞ DMI based service ☞ FC service ☞ SES service ☞ Native CIM service CMS ☞ Entity mapping ☞ Common data model ☞ Access services

22. Storage System Lab SKKU 21 SAN Management Open Standard Platform SCSI Instruction Set SCSI Enclosure Services(SES) SCSI Self-monitoring Analysis and Reporting Technology (SMART) SCSI Accessed Fault-Tolerant Enclosure(SAF-TE) SNMP Web-based Enterprise Management(WBEM)

23. Storage System Lab SKKU 22 SAN Management Storage Management Problem SAN Solution Time for data backup Improvement of backup speed through bandwidth and protocol efficiency Impossibility of remote backup, mirror, or recovery Support remote operation through a cable of about 10km Insufficient solution for local backup and mirroring Ideal platform for hierarchical storage management(HSM) Exhaustion of network bandwidth by LAN connection for server backup Decrease LAN traffic by separating server-storage from LAN connection

24. Storage System Lab SKKU 23 SAN Application Clustering Data Protection DataVaulting DataExchange ReplicateRecovery NetworkArchitecture SAN

25. Storage System Lab SKKU 24 SAN Application - Remote Backup

26. Storage System Lab SKKU 25 SAN Application - Server-Storage Clustering

27. Storage System Lab SKKU 26 SAN Serverless Backup Client Disk storage Tape LAN Net server Backup server SAN Net server

28. Storage System Lab SKKU 27 SAN Storage Integration Client Disk storage Tape LAN Net server SAN Net server Disk storage Disk storage

29. Storage System Lab SKKU 28 SAN Storage Expansion FC-AL

30. Storage System Lab SKKU 29 SAN Storage Expansion Fabric server FC host 어댑터

31. Storage System Lab SKKU 30 SAN Storage Expansion Multiple Loops Loop #1 Loop #2 Loop #3 Loop #4 Loop #5 Individual loop Serially connected

32. Storage System Lab SKKU 31 SAN FC Workgroup workstation FC-AL w/IP FC-AL w/SCSI NT file server Shared storage

33. Storage System Lab SKKU 32 SAN Recovery – Server Clustering server FC switch/hub JBOD or RAID

34. Storage System Lab SKKU 33 SAN Recovery – HA clustering

35. Storage System Lab SKKU 34 SAN Recovery – Data Mirroring

36. Storage System Lab SKKU 35 SAN File System SAN Support Customizability ☞ According to specific I/O requirement such as web, multimedia User-Controllability ☞ Users decide logical storage space, data format, fault tolerance, and recovery High Performance and Scalability ☞ Dynamic load balancing across all disks ☞ Hot system mode change ☞ Storage environment optimization according to I/O requirement High Availability ☞ Software RAID, Chained-Declustering, Fast Recovery Compatibility withexisting file system in API and access method

37. Storage System Lab SKKU 36 SAN File System Requirement Mass Storageability ☞ Unlimited High Scalability ☞ Capacity, performance, connectivity, bandwidth, cost High Availability ☞ Duplex ☞ Online data backup Easy Manageability ☞ Effective central management and remote control through Internet High Utilizability ☞ Logical disk pool Load Balanceability ☞ Data migration through SAN

38. Storage System Lab SKKU 37 Application Software (Oracle, Word, Web Browser, etc.) Hardware (Disk, Memory, CPU, Network Cards, etc.) Kernel System Call Interface Networking Process Management Memory Management Device Driver IPCTimer Function Ext2 I/FNew I/F Buffer Cache Virtual File System MPI-IO NTFS Ext FS HFS SAN FS New Driver SAN File System Structure

39. Storage System Lab SKKU 38 SAN File System Products Yes High Availability Yes No MPI-IO Yes No Linux version FS Share SAN Support I/O Perf SAN Support FS Share SAN Support Key Functionality Yes Disk share Yes SAN Support Possible NoPossibleParallel I/O High Low NoLowTuning New Native NTFS/UFSNativeFile System Multiplatform Unix/NT/VMS Unix/NTUnixO S Target SoftWorks IBM TivoliVeritasItem

40. Storage System Lab SKKU 39 Standard Collaboration DMTFDMTF – WBEM (Web-Based Enterprise Mgmt), CIM ANSIANSI – T10 (SCSI) and T11 (Fibre Channel) IEEEIEEE – Media management and tape IETFIETF – SNMP, IP SANs, IP storage,directories/LDAP and policy And others –FCIA –FCIA – Fibre Channel Industry Association –Fibre Alliance –Fibre Alliance - SNMP MIB

41. Storage System Lab SKKU 40 SAN Standardization - FC 1994 ANSI X3T11 IPI-3 Inst mapping (IPI-3 STD) SCSI-3 Inst mapping FC link Encapsulation FC-LE FC-ATM SCSI-3 IP ATM Common service FC Physical/signaling Interface (FC-PH,FC-PH2, FC- PH3) FC-ALFC-AL-2 ULP(Upper Level Protocol) FC-4 FC-3 FC-2 FC-1 FC-0 Frame protocol En/decoding Physical 8B/10B Coding Copper/Fibre

42. Storage System Lab SKKU 41 SAN – Hot Issues Storage over Wide Area Networks SANs for Everyone Storage Services Providers Storage Management Applications Extended Copy for server-free data movement Host Adapter API for fibre channel management IP Storage technologies Fibre channel switch interoperability Infiniband

43. Storage System Lab SKKU 42 SAN over WAN

44. Storage System Lab SKKU 43 SAN for Everyone

45. Storage System Lab SKKU 44 Storage Services Providers

46. Storage System Lab SKKU 45 Storage Management

47. Storage System Lab SKKU 46 IP Storage

48. Storage System Lab SKKU 47 Switch Interoperability

49. Storage System Lab SKKU 48 InfiniBand

50. Storage System Lab SKKU 49 PCI vs IB CharacteristicsPCI 2.2PCI-X 1.0IB Speed66MHz133MHz/slot2.5Gbps Data width32/64 bit 1x, 4x, 12x Max bandwidth533Mbyte/sec1,064Mbyte/sec2.5Gbps/port ConnectionShared bus Point-to-point Max nodesLess than 101/133MHz2 16 /subnet CommunicationShared memory Channel-based Message passing

51. Storage System Lab SKKU 50 Conclusion - Trends The Next Big Thing 2003 2001 2004 2002 Focus on the problem new technologies may solve/displace –I/O bus vs. IP network vs. SCSI-based channel network Most of these new technology specifications have not been defined, much less adopted as “standards” 10Gb FC DAFS 2Gb FC 10Gb Ethernet InfiniBand SCSI over IP EtherStorage iSCSI Storage over IP

52. Storage System Lab SKKU 51 SNIA Vision Security OBSD PolicyNAS Discovery StorageMediaLibrary FileSystems DRM Backup Fibre Channel Channel WebDevelop-ment Marketing Education Finance Interoperability MembershipDevelopment ConferenceDevelopmentStrategicPlanning TechnologyCouncil 11 members

53. Storage System Lab SKKU 52 SAN Milestone Block I/O NAS Object As technology marches forward… …SNIA will address practical storage networking concerns 20012002200320042005 Access Models… Changing! Required Storage Capacity… Doubling! IT Concerns Usage Models Goals SNIA Technical Activities FC Tunneling Over LAN/WAN Fibre Channel iSCSI InfiniBand Infrastructure Complexity… Increasing! SCSI STANDARDS MANAGEMENT SECURITY AVAILABILITY PERFORMANCE DATA PROTECTION INTEROPERABILITY