Virtualization, Cloud Computing and Big Data

Virtualization Virtualization - Various techniques and methods of creating a virtual (rather than actual) version of something, such as: Computer hardware platform Operating System (OS) – Virtual Machine or VM Storage device Network resources Rick Graziani graziani@cabrillo.edu

Virtual Computers DHCP Server File/Storage Server Email Server DNS Server Application Server Web Server Virtual Machines Rick Graziani graziani@cabrillo.edu

Virtual Machine Software that supports multiple operating systems on a single computer. Each operating system is it’s own “virtual machine” with it’s own: Operating system RAM Storage Shared CPU Rick Graziani graziani@cabrillo.edu

VM A computer can run: Multiple operating systems simultaneously including the software applications Rick Graziani graziani@cabrillo.edu

Virtual Machines Instead of being stored on the local computer, the VMs may be stored on a remote server. Virtual Machine Server Rick Graziani graziani@cabrillo.edu

Each virtual machine is called a guest machine. http://securitywing.com/types-virtualization-technology/ The two classes of hypervisor are: type 1 and type 2. Type 1 hypervisor is also known as bare-metal implementation because they sit directly on the top of hardware, without needing any operating system. Since they can directly communicate with hardware resources, they are much faster than type 2 hypervisor. hypervisor type 1 Advantage of type 1: if a single virtual machine crash, it does not affect the rest of the guest operation system. Therefore, they are considered more secure than type 2. Since they generate less overhead, type 1 hypervisor is much faster than its counterpart. Type 1 Products: include VMware ESX, Microsoft Hyper-V, and the many Xen variants. Type 2 hypervisor resides on top of the operating system. Since they cannot directly communicate with the hardware, they are less efficient than the type 1. hypervisor type 2 Advantage of type 2: in type 2 hypervisor, the OS takes care of all the hardware. That is why a type 2 hypervisor can support a wide range of hardware. Besides, installing a type 2 is much easier than that of type 1. Disadvantage of type 2: they have more points of failure since anything that affect the stability of the base operating system can also affect the guest OS and the virtual machine. When the base OS needs a reboot, all the VM will also be rebooted. Example of type 2 hypervisor VMware Player, VMware Workstation, and Microsoft Virtual Server . - See more at: http://securitywing.com/types-virtualization-technology/#sthash.ETssJFzo.dpuf A hypervisor is a piece of computer software, firmware or hardware that creates and runs virtual machines. (aka virtual machine manager or virtual machine monitor Host machine: The computer that runs the and has one or more virtual machines. Each virtual machine is called a guest machine. Rick Graziani graziani@cabrillo.edu

Rick Graziani graziani@cabrillo.edu

Zero Clients The Cloud Zero Client (thin clients) just: Connect to the network Begins a networking protocol to communicate with the VM server Displays the server's output: Operating system, applications and data Basically the full OS and applications are run in “the cloud” Rick Graziani graziani@cabrillo.edu

Zero Clients – No computer needed Rick Graziani graziani@cabrillo.edu

Zero Clients – No computer needed Rick Graziani graziani@cabrillo.edu

Zero Clients – No computer needed USB Network (Ethernet) Microphone Speakers Etc. Monitor Rick Graziani graziani@cabrillo.edu

Centralization of hardware and software Fewer client “computers” means: Less cost – fewer “computers” Do not have to constantly upgrade computers or buy new computers Easier installation of software and upgrading current software Better utilization of resources Easier management of client computers Access “the cloud” from any device on the network. Rick Graziani graziani@cabrillo.edu

Centralization – Looks familiar…. The mainframe computer has now become the “cloud”. Rick Graziani graziani@cabrillo.edu

Cloud Computing Cloud computing – Ability to run a program on many connected computers at the same time. The popularity of the term is from the ability host application services so that the client can access from a remote location. Also known as distributed computing over a network Rick Graziani graziani@cabrillo.edu

Where is the cloud…. In the Data Center A data center is a specialized facility used to house computer systems and associated components, such as telecommunications and storage systems. Rick Graziani graziani@cabrillo.edu

A Walk Through of Google’s Data Center Rick Graziani graziani@cabrillo.edu

Cloud Computing https://www.youtube.com/watch?v=J9LK6EtxzgM Cloud computing is offline computing in which large groups of remote servers are networked to allow the centralized data storage, and online access to computer services or resources. https://www.youtube.com/watch?v=J9LK6EtxzgM Rick Graziani graziani@cabrillo.edu

Cloud Computing – Outsourced Flexibility Outsourcing “some” IT (Information Technology) services to a third party allows for flexibility and growth. Example: WebAdvisor in the cloud? Rick Graziani graziani@cabrillo.edu

Big Data Big data - The collection of data sets so large and complex that it becomes difficult to process using traditional database management tools or traditional data processing applications. Challenges: How to capture, organize, store, search, share, transfer, analyze, and visualize. How to use larger data sets of information, analyze the information and use it to "spot business trends, determine quality of research, prevent diseases, link legal citations, combat and prevent crime, and make informed decisions. Rick Graziani graziani@cabrillo.edu

Big Data (2012) Rick Graziani graziani@cabrillo.edu

Big Data https://www.youtube.com/watch?v=JIo-V0beaBw https://www.youtube.com/watch?v=TzxmjbL-i4Y https://www.youtube.com/watch?v=66_nkd4KbBk https://www.youtube.com/watch?v=8pHzROP1D-w https://www.youtube.com/watch?v=qAT_ina93NY Rick Graziani graziani@cabrillo.edu

Example Rick Graziani graziani@cabrillo.edu

Analyzing Data – RapidMiner Rick Graziani graziani@cabrillo.edu

Rick Graziani graziani@cabrillo.edu

Meta Data Metadata is data that describes other data. A metadata record is a file of information which captures the basic characteristics of a data or information resource. Metadata is traditionally in the card catalogs of libraries. Metadata describes how and when and by whom a particular set of data was collected, and how the data is formatted. Rick Graziani graziani@cabrillo.edu

Big Data Books… Rick Graziani graziani@cabrillo.edu