1. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies Module 6.2

2. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 2 Virtualization Technologies Upon completion of this module, you will be able to:  Identify different virtualization technologies  Describe block-level virtualization technologies and processes  Describe file-level virtualization technologies and processes

3. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 3 Lesson 1 – Virtualization – An Overview Upon completion of this lesson, you will be able to:  Identify and discuss the various options for virtualization technologies

4. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 4 Defining Virtualization Virtualization provides logical views of physical resources while preserving the usage interfaces for those resources Virtualization removes physical resource limits and improves resource utilization

5. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 5 What Makes Virtualization Interesting Potential Benefits:  Higher rates of usage  Simplified management  Platform independence  More flexibility  Lower total cost of ownership  Better availability Server Storage network Storage

6. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 6 Virtualization Comes in Many Forms 6 Each application sees its own logical memory, independent of physical memory Virtual Memory Each application sees its own logical network, independent of physical network Virtual Networks Each application sees its own logical server, independent of physical servers Virtual Servers Each application sees its own logical storage, independent of physical storage Virtual Storage

7. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 7 7 Each application sees its own logical memory, independent of physical memory Virtual Memory Virtualization Comes in Many Forms Benefits of Virtual Memory Remove physical-memory limits Run multiple applications at once Physical memory Swap space App

8. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 8 8 Each application sees its own logical network, independent of physical network Virtual Networks Virtualization Comes in Many Forms Benefits of Virtual Networks Common network links with access- control properties of separate links Manage logical networks instead of physical networks Virtual SANs provide similar benefits for storage-area networks VLAN AVLAN BVLAN C VLAN trunk Switch

9. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 9 Server-Virtualization Basics Before Server Virtualization: Operating system Application  Single operating system image per machine  Software and hardware tightly coupled  Running multiple applications on same machine often creates conflict  Underutilized resources After Server Virtualization:  Virtual Machines (VMs) break dependencies between operating system and hardware  Manage operating system and application as single unit by encapsulating them into VMs  Strong fault and security isolation  Hardware-independent: They can be provisioned anywhere Virtualization layer Operating system App Operating system App

10. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 10 Check Your Knowledge  Define Virtualization  What type of virtualization has existed for many years at the storage layer?  What is a VSAN?  Explain the concept of a swap file  Explain the concept of server virtualization

11. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 11 Lesson 2 – Storage Virtualization Upon completion of this lesson, you will be able to:  Identify and discuss the various options for virtualization technologies

12. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 12 Server Storage network Storage  Volume management –LUNs  Access control  Replication  RAID  Cache protection  Path management  Volume management  Replication  Connectivity Storage Functionality Today Intelligence Lives Primarily on Servers and Storage Arrays

13. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 13 Storage Virtualization Requires a Multi-Level Approach Distributed intelligence / centralized management Application functions Server Storage network Storage Data-access functions Data-preservation functions Intelligence Should Be Placed Closest to What it Controls

14. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 14 SNIA Storage Virtualization Taxonomy File System, File/record Virtualization Other Device Virtualization Host based server Based Virtualization Network based Virtualization Storage Device Storage subsystem Virtualization In-band VirtualizationOut-of-band Virtualization What is created How it is implemented Where it is done:

15. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 15 Problem: Current Storage Virtualization Examples NAS Gateway Consolidated file-based storage Mgmt Station NAS Heads LAN File Block Storage network Solution: MultiPathing Software I/O path performance and availability Storage-Virtualization Examples

16. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 16 Four Challenges of Storage Virtualization  Scale: Virtualization technology aggregates multiple devices— must scale in performance to support the combined environment  Functionality: Virtualization technology masks existing storage functionality— must provide required functions, or enable existing functions  Management: Virtualization technology introduces a new layer of management —must be integrated with existing storage-management tools  Support: Virtualization technology adds new complexity into the storage network—requires vendors to perform additional interoperability tests

17. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 17  The Scaling Challenge Before:  Performance requirements are distributed across multiple storage arrays –Application performance –Replication performance Standard environment Each array delivers units of performance (e.g., IOPS, SPEC-SFS, MB/s) 20,000

18. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 18  The Scaling Challenge Before:  Performance requirements are distributed across multiple storage arrays –Application performance –Replication performance After:  Storage network capabilities must support the aggregated environment –Aggregate application performance –Aggregate replication performance Virtualized environment Aggregated performance (e.g., IOPS, SPEC-SFS, MB/s) 100,000+ ++++ 20,000

19. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 19  The Functionality Challenge Before:  Applications have access to rich array functionality –Advanced local replication –Advanced remote replication –Array-level optimization Standard environment Advanced array functionality: Mirrors, clones, and snapshots Protected and instant restores Synchronous and asynchronous replication Consistency Groups

20. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 20  The Functionality Challenge Before:  Applications have access to rich array functionality –Advanced local replication –Advanced remote replication –Array-level optimization After:  Virtualization device must provide either required functionality or  Specialized access to array functionality Virtualized environment Network functionality (depending on implementation) Advanced array functionality: Mirrors, clones, and snapshots Protected and instant restores Synchronous and asynchronous replication Consistency Groups ?

21. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 21  The Management Challenge Before:  Management tools provide integrated view of application to physical-storage mapping –Monitoring and reporting –Planning and provisioning Standard environment End-to-end management

22. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 22  The Management Challenge Before:  Management tools provide integrated view of application to physical-storage mapping –Monitoring and reporting –Planning and provisioning After:  Storage network requires modification of management tools to support a virtualized environment –Servers –Networks –Storage –… and virtualization device Virtualized environment Virtualization device Server to virtualization device Virtualization device to physical storage

23. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 23  The Support Challenge Before:  Storage vendor must support complexity of multi-vendor network environments –Servers and software –Networks and software –Arrays and software Standard environment Interoperability: server types OS versions network elements storage-software products

24. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 24  The Support Challenge Before:  Storage vendor must support complexity of multi-vendor network environments –Servers and software –Networks and software –Arrays and software After:  Storage-virtualization vendor must provide additional support to address increased complexity –New platforms –New intelligence –Interaction with existing infrastructure Virtualized environment More complexity requires additional interoperability investments Considerations: New hardware- qualification requirements Service and support ownership Problem escalation and resolution

25. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 25 25 Each application sees its own logical storage, independent of physical storage Virtual Storage Benefits of Virtual Storage Nondisruptive data migrations Access files while migrating Increase storage utilization Storage Virtualization: Block and File Level Storage network IP network

26. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 26  No state / no cache  I/O at wire speed  Full-fabric bandwidth  High availability  High scalability  Value-add functionality Out-of-BandIn-Band  State / cache  I/O latency  Limited fabric ports  More suited for static environments or environments with less growth  Value-replace functionality Comparison of Virtualization Architectures

27. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 27 Check Your Knowledge  What are the four challenges of storage virtualization?  At which level(s) is storage virtualization implemented?  Control data in the data path is a feature of what type of virtualization architecture?

28. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 28 Lesson 3 – Block-Level Virtualization Upon completion of this lesson, you will be able to:  Describe Block-Level Virtualization technologies and functionality

29. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 29 Block-Level Storage Virtualization Basics  Ties together multiple independent storage arrays – Presented to host as a single storage device – Mapping used to redirect I/O on this device to underlying physical arrays  Deployed in a SAN environment  Nondisruptive data mobility and data migration Multi-vendor storage arrays Storage-area network (SAN)

30. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 30 Usage Scenarios for Block-level Storage Virtualization Heterogeneous Storage Application Growth 30 © Copyright 2006 EMC Corporation. All rights reserved. Next-Generation Data Center Operations Extending Volumes Online Scalability Consolidation Business Continuity Storage Utilization Nondisruptive Data Mobility

31. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 31 After Multi-vendor storage arrays Virtualization SAN Simplify volume access Nondisruptive mobility Optimize resources Block-Level Storage Virtualization Optimizes Resources and Improves Flexibility Before Multi-vendor storage arrays SAN All applications have direct knowledge of storage location

32. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 32 Data Mobility  How much data can you migrate on the weekend? – Average migration rate using server-based copies is 4 GB per hour and with downtime – At 48 hours of time per weekend, you can migrate 192 GB of data a week  With network-based virtualization, data can be migrated at any time at much faster rates Data mobility becomes a routine operation, making it a daily part of infrastructure optimization

33. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 33 Block-Level Virtualization Example: EMC Invista Intelligent Switches:  Fibre Channel switches with custom hardware for enhanced processing  Capable of performing operations on data streams at line speed  Controlled by instructions from external management software (via APIs) Inside the Intelligent Switch Mapping operation Mapped I/O streams Host Storage Intelligent switch becomes storage target Input I/O stream

34. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 34 Inside the Intelligent Switch Block-Level Virtualization Example: EMC Invista Mapped I/O streams Host Storage Control Path Cluster—control path  The CPC gets involved to make changes (e.g., allocate more storage), handle uncommon cases (e.g., SCSI inquires, SCSI reservations), perform control operations (e.g., cloning), etc. Intelligent switch—data path Control processing Invista Control Path Cluster (CPC) Mapping operation Input I/O stream

35. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 35 Inside the Intelligent Switch Control processing Invista Control Path Cluster (CPC) Block-Level Virtualization Example: EMC Invista Input I/O stream Requests received and dispatched to assigned storage location Host Mapping Operation Mapped I/O streams Storage Mapping operation  A new device is placed within the data center, and the CPC discovers the new device  The CPC creates the map and shows the host where the virtual volume exists; I/O begins  Contents of an existing volume are moved online, and the volume is freed

36. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 36 Check Your Knowledge  Consider that you have a leased storage array that is being replaced by a newer model. Place the relevant steps below in the correct order for data migration (hint: not all steps apply) – Reconfigure LUN definitions on hosts – Implement new array into existing environment – Decommission legacy array – Obtain new array – Take host volumes offline for migration – Migrate existing data from legacy array to new array – Present storage on new array to virtualization engine

37. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 37 Lesson 4 – File Level Virtualization Upon completion of this lesson, you will be able to:  Describe File Level Virtualization technologies and functionality

38. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 38 Before File-level Virtualization: File-Level Virtualization Basics  Every NAS device is an independent entity, physically and logically  Underutilized storage resources  Downtime caused by data migrations NAS devices/platforms IP network After File-level Server Virtualization:  Break dependencies between end-user access and data location  Storage utilization is optimized  Nondisruptive migrations NAS devices/platforms IP network

39. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 39 After Move data while writing and accessing existing data Update Global Namespace Multi-vendor NAS systems File Virtualization IP File-Level Storage Virtualization File Abstraction that Optimizes Resources and Improves Flexibility Multi-vendor NAS systems Before All users have direct knowledge of file locations File systems

40. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 40 Automount NISLDAP DFS AD Moving Files Online: A File Virtualization Example NFS4 Root NISLDAP Global Namespace Manager Event Log  File Virtualization inserted into I/O  Client redirection Global Namespace updated File Virtualization Appliance DFS AD Automount NISLDAP Global Namespace Manager NFS4 root NISLDAP Admin File-data migration

41. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 41 Moving Files Online: A File Virtualization Example (continued) DFS AD NFS4 Root NISLDAP Global Namespace Manager Event Log  File virtualization inserted into I/O  Client redirection Global Namespace updated  Migration complete without downtime File Virtualization Appliance Admin File-data migration Automount NISLDAP

42. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 42 Usage Scenarios for File-Level Storage Virtualization 42 © Copyright 2006 EMC Corporation. All rights reserved. Next-Generation Data Center Operations Performance Management Tiered Storage Management Consolidation Business Continuity Capacity Management Global Namespace Management Consolidation

43. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 43 Accelerated Consolidation Move Files Nondisruptively—with Continuous Access to Data After:  Eliminate servers via migration to underutilized servers  Maintain full read/write access during migration  Transparent to clients and applications Before:  Too many file servers –Buying more file servers for additional storage  Complex migrations IP network File Virtualization Server 1Server 2Server 3 Server 4 Average utilization Eliminate file servers Increased utilization

44. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 44 Usage Scenarios for File-Level Storage Virtualization 44 © Copyright 2006 EMC Corporation. All rights reserved. Next-Generation Data Center Operations Performance Management Tiered Storage Management Consolidation Business Continuity Capacity Management Global Namespace Management

45. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 45 Global Namespace Management Situation  Billions of files with thousands to hundreds of thousands of clients  Update namespace and retain access to files while migrating Scenario  Update 1,000 client namespaces over the weekend  95% successful—50 typos or glitches  50 calls with 50 very angry employees  There goes Monday...and Tuesday  Wednesday: Start planning next set of changes Zero mistypes, 100% access during migration 45

46. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 46 Simplified Namespace Management Access to Files and Folders Before:  Complex file-server environments  Namespace changes are time- consuming  Multiple shares or mounts per client After:  Multiple file systems appear as a single virtual file system via standard namespace  Simplify management and ensure continuous access to files and folders  Updates standard-namespace entries (UNIX, Linux, Windows) Server 1Server 2Server 3 Server 4 SHARE1 Windows T:\svr1\ SHARE2 NetApp S:\svr2\ SHARE3 Celerra H:\svr3\ SHARE4 UNIX G:\svr4\

47. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 47 Check Your Knowledge  Name two benefits of file-level virtualization  What is a Global Namespace?

48. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 48 Module Summary Key points covered in this module:  Virtualization technologies  Block-level virtualization technologies and processes  File-level virtualization technologies and processes

49. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 49 Course Summary Key points covered in this course:  Challenges found in today’s complex information management environment  Storage technology solutions – DAS – NAS – SAN  Key business drivers for storage - Information Availability and Business Continuity  Business continuity, managing and monitoring the data center, storage security, and virtualization  Common storage management roles and responsibilities  Key themes – Technology Requirements – Physical and Logical Elements – Host – Interconnect – Storage – Data Flow – Storage Security

50. © 2007 EMC Corporation. All rights reserved. Virtualization Technologies - 50 Closing Slide