CIS 4403 Cloud Computing Resource Virtualization and Pooling PDF
Document Details
Higher Colleges of Technology
Dr. Basel Magableh, Dr. Samia Kouki
Tags
Summary
These lecture notes cover Resource Virtualization and Pooling for a Cloud Computing course (CIS 4403). The document details the concepts of virtualization, its types, and its implementation within cloud environments. It also discusses the benefits of data center virtualization, emphasizing resource efficiency.
Full Transcript
CIS 4403 – Cloud Computing Week 3-4: – Resource Virtualization and Pooling CLO2: Design a cloud data center based on specific technical requirements 1 ...
CIS 4403 – Cloud Computing Week 3-4: – Resource Virtualization and Pooling CLO2: Design a cloud data center based on specific technical requirements 1 2 Credits and Revision Control Change description: existing material is revised and updated Change level: minor Versi Author Effective Date Change Description DRC No on 1.0 Unknown NA Define the first version 001 Fall 2023(August Revise the first version 1.1 Dr. Basel Magableh 002 2023) Revamped the chapter content (Major 1.2 Dr. Samia Kouki changes) 003 Fall 202410 CIS-4403-Week3&4-Resource virtualization and pooling 2 3 Delivery Outline W1: CLO1 - Introduction to Cloud Computing W2: CLO1 - Cloud Computing Models and Services W3-4: CLO2 - Resource Virtualization and Pooling W5: CLO2 - Scaling and Capacity Planning W6: CLO2 - Load Balancing W7: CLO2 - File System and Storage W8: CLO3 - Database Technology W9-10: CLO3 - Cloud Computing Security W11: CLO3 - Privacy and Compliance W12: CLO4 - Content Delivery Network W13: CLO4 - Portability and Interoperability W14: CLO4 - Cloud Management W15: CLO all - Hot Research Topics CIS-4403-Week3&4-Resource virtualization and pooling 3 4 Chapter Objectives At the end of this lecture, students should be able to: Define the virtualization and its different types. Demonstrate an understanding of the use of virtualization to enable resource pooling, sharing and provisioning in cloud environments. Implement Physical Computing Resources Virtualization. Implement machine, server level and operating system virtualization. CIS-4403-Week3&4-Resource virtualization and pooling 4 1. What is virtualization? 2. Virtualization in the cloud LECTUR 3. Benefits of data center virtualization E 4.Tyes of virtualization OUTLINE 5. Resource pooling in cloud 6. Containerization in cloud : Dockers CIS-4403-Week3&4-Resource virtualization and pooling 5 What is Virtualization? (1/5) CIS-4403-Week3&4-Resource virtualization and pooling 6 7 What is virtualization? (2/5) Watch the video, take notes, and then present the key information gathered from it. CIS-4403-Week3&4-Resource virtualization and pooling 7 8 What is Virtualization? (3/5) Virtualization - Green Focus The Reality: Most servers only use 5-15% of their capabilities on average, while consuming 60-90% of their peak power. The Solution - Virtualization: Use one server to host multiple applications. Reduce energy consumption Reduce CO2 emissions CIS-4403-Week3&4-Resource virtualization and pooling 8 9 What is Virtualization? (4/5) Virtualization is the process of converting physical computing resources into simulated versions through software. This software layer, referred to as the virtualization layer, is installed on physical machines and converts their resources into virtual ones. Users can then utilize these virtual resources to fulfill their computing requirements. Fig1. Traditional computing Vs. virtualized computing CIS-4403-Week3&4-Resource virtualization and pooling 9 10 What is Virtualization? (5/5) With virtualization, multiple operating systems and applications can run on a single machine. The physical machine on which the virtual machine is created is called the host machine, while the virtual machine itself is referred to as the guest machine. The Hypervisor called also virtual machine manager (VMM), is a software that creates and runs virtual machines (VMs). It allows multiple operating systems to share a single hardware host by abstracting the underlying physical resources and managing the allocation of these resources among the VMs. Fig2. Host, guest machine and Hypervisor CIS-4403-Week3&4-Resource virtualization and pooling 10 11 Types of hypervisors :Type 1: Bare Metal Approach In this approach of machine virtualization, the hypervisor is directly installed over the physical machine. Since, the hypervisor is the first layer over hardware resources, hence, the technique is referred as bare metal Citrix Hypervisor (XenServer). approach. VMware vSphere/ESXi. Microsoft Hyper-V. Here, the VMM or the hypervisor Red Hat Enterprise Virtualization (RHEV). Kernel-Based Virtual Machine communicates directly with system Fig-3. Hypervisor type 1 CIS-4403-Week3&4-Resource virtualization and pooling (KVM). 11 Types of hypervisors :Type 2: Hosted Approach 12 In this approach, an operating system is first installed on the physical machine to activate it. This OS installed over the host machine is referred as host operating Microsoft Virtual PC. Oracle Virtual Box. system. VMware Workstation. Oracle Solaris Zones. The hypervisor is then installed over VMware Fusion. Oracle VM Server for x86. CentOS Virtualization. this host OS. 12 Fig-4. Hypervisor type 2 CIS-4403-Week3&4-Resource virtualization and pooling 13 Evaluating your understanding https://create.kahoot.it/creator/aa802c8a-fec6-4752-a366-56465af 3705b CIS-4403-Week3&4-Resource virtualization and pooling 13 14 Virtualization in Cloud computing (1/5) Watch the video, take notes, and then present the key information gathered from it. CIS-4403-Week3&4-Resource virtualization and pooling 14 Virtualization in Cloud computing (2/5) 15 Virtualization is a part of cloud computing, Fig-5. Virtualization management (Admin) Fig-6. Cloud management (API) Virtualization requires a person In cloud computing, (admin) to communicate with a communication is handled by an hypervisor to create and manage API (Application Programmable virtual machines. interface) rather than a person. The API automates all interactions with the hypervisor. CIS-4403-Week3&4-Resource virtualization and pooling 15 Virtualization in Cloud computing (3/5) 16 Virtualization is a part of cloud computing, Data center virtualization is one foundation of cloud computing. Accesses to pooled resources is provided using resource virtualization. Virtualization is considered a major step in the direction of cloud computing Reduce Real Estate Needs Increase Up Time Reduce CO2 Emissions, Power and Cooling Requirements Increase Flexibility Reduce Overall Costs CIS-4403-Week3&4-Resource virtualization and pooling 16 17 Virtualization in Cloud computing (4/5) Virtualization is the key concept in the delivery of cloud services. Data center virtualization serves as a fundamental pillar of cloud computing. It enables access to pooled resources through resource virtualization, making it a key enabler of cloud computing, means that users access only virtual resources rather than the physical hardware itself. CIS-4403-Week3&4-Resource virtualization and pooling 17 18 Virtualization in Cloud computing (5/5) In cloud computing, resource pooling is a key feature where resources (such as processor, memory, storage and network) are pooled together at data centers and virtualized to create a layer of abstraction. Resources are dynamically and rapidly adjusted based on changing conditions and needs. Fig-7. Resource pooling in cloud CIS-4403-Week3&4-Resource virtualization and pooling 18 19 Benefits of Data center virtualization (1/2) Watch the video, take notes, and then present the benefits of datacenter virtualization. CIS-4403-Week3&4-Resource virtualization and pooling 19 20 Benefits of Data center virtualization (2/2) Reduces Cost on Acquiring new hardware and software Better backup Flexible scaling Enhanced disaster recovery Simplified management Agility and flexibility Fig-8. Benefits of data center virtualization Reduce CO2 Emissions, Power and Cooling Requirements CIS-4403-Week3&4-Resource virtualization and pooling 20 21 Types of virtualization (1/8) Watch the video, take notes, and then present the different types of virtualization. CIS-4403-Week3&4-Resource virtualization and pooling 21 22 Types of virtualization (2/8) There are various types of virtualizations, each with its unique advantages and purposes. Here are some of the most common ones: Fig 9. Different types of virtualization CIS-4403-Week3&4-Resource virtualization and pooling 22 Types of virtualization (3/8) : Server virtualization With server virtualization (hardware virtualization), users can partition their physical services into smaller virtual servers to maximize server resources. Each virtual server runs its own unique operating system and apps, independent of the other virtual servers on the physical machine. Without server virtualization, physical servers use only a small amount of their processing capacities, which leave devices Fig 10. Server virtualization idle. CIS-4403-Week3&4-Resource virtualization and pooling 23 24 Network virtualization https://www.youtube.com/watch?v=ni8ZOlUP4Ws CIS-4403-Week3&4-Resource virtualization and pooling 24 Types of virtualization (4/8) : Network virtualization 25 Any computer network has hardware elements such as switches, routers, and firewalls. An organization with offices in multiple geographic locations can have several different network technologies working together to create its enterprise network. Network virtualization is a process that combines all of these network resources to centralize administrative tasks. Administrators can adjust and control these elements virtually without touching the physical components, which greatly simplifies network management. (source: https://aws.amazon.com/what-is/virtualization/). Fig 11. Network virtualization CIS-4403-Week3&4-Resource virtualization and pooling 25 26 Types of virtualization (5/8) : Storage virtualization Storage virtualization is the process of abstracting physical storage resources and presenting them as logical storage units to be used by applications or other systems. to improve the efficiency and speed of data storage as well as better utilization, management, and flexibility of storage infrastructure. It is commonly used in Storage area Fig 12. Storage virtualization : networks (SAN). CIS-4403-Week3&4-Resource virtualization and pooling 26 Types of virtualization (6/8) : Application 27 virtualization This is the process of separating the application layer from the hardware and operating system. The app is able to run without being dependent on the physical machine’s operating system. This way, users can run a Fig 13. Example of Application virtualization Windows app on Linux OS and vice versa without needing to have two CIS-4403-Week3&4-Resource virtualization and pooling 27 Types of virtualization (7/8) : Desktop 28 virtualization With desktop virtualization, an admin can deploy simulated desktop environments on a hosted, centralized or remote server. Users can access their desktops on any workstation or device. Furthermore, it makes it easy for admins to perform updates, security checks and mass configurations on all virtual desktops. CIS-4403-Week3&4-Resource virtualization and pooling 28 29 Types of virtualization (8/8) : Data virtualization Since modern enterprises store data in multiple locations, it becomes necessary to ensure that the apps can access all that data irrespective of the location, format or source. Data virtualization involves gathering data from different sources, which can be viewed in one place, giving users a single point of access to their data. CIS-4403-Week3&4-Resource virtualization and pooling 29 30 Evaluating your understanding https://create.kahoot.it/details/283c12bc-191d-451c-b174-9a2efedf7 9fb CIS-4403-Week3&4-Resource virtualization and pooling 30 31 Containerization in cloud : Dockers (1/8) Watch the video, take notes, and then present the key information gathered from it. CIS-4403-Week3&4-Resource virtualization and pooling 31 32 Containerization in cloud : Dockers (2/8) Limitations of VMs - Each VM still requires: o CPU allocation o Storage capacity o RAM (Memory capacity) o Entire guest operating system - The more VMs you run, the more resources you need - Guest OS means wasted resources - If we need more Flexible Resource sharing and pooling in the cloud, containerization can rather be used. CIS-4403-Week3&4-Resource virtualization and pooling 32 33 Containerization in cloud : Dockers (3/8) VMS Vs. Containers Fig 14. VMS Vs. containers VMS are infrastructure level construct to Containers are an App level turn one machine into many servers construct CIS-4403-Week3&4-Resource virtualization and pooling 33 34 Containerization in cloud : Dockers (4/8) Modern Operating Systems offer another kind of virtualization called containers. Containers are packages of software (software and dependencies) that include everything needed to run software in any environment, allowing them to operate on various platforms. Developers can build their application once, and then know that it can run consistently anywhere. Operators can configure their servers once, and then know that they can run any application. Containers are much more lightweight then VMs. Example: From Gmail to YouTube to Search, everything at Google runs in containers. CIS-4403-Week3&4-Resource virtualization and pooling 34 Containerization in cloud : Dockers (5/8) 35 What is Docker? Watch the video, take notes, and then present the key information gathered from it. CIS-4403-Week3&4-Resource virtualization and pooling 35 36 Containerization in cloud : Dockers (6/8) What is Docker? Docker addresses one of the biggest challenges in application deployment cloud service operations management – component complex, multi-node interoperability environments CIS-4403-Week3&4-Resource virtualization and pooling 36 37 Containerization in cloud : Dockers (6/8) What is Docker? Docker is an open-source software container system, developed by DotCloud and supported by the community. It has revolutionized cloud computing delivery. Docker creates encapsulated application environment using Linux containers to achieve isolation. Docker provides an open platform for Fig 15. Docker container developers and system administrators to build, ship, and run distributed applications. CIS-4403-Week3&4-Resource virtualization and pooling 37 38 Containerization in cloud : Dockers (7/8) Main advantages of Docker Highly portable, able to run in any environment with minimal dependencies between process layers. Lightweight with outstanding scalability. Faster startup: no need to boot an OS, bringing applications online in seconds. Cost-efficient due to high-density, allowing more containers per machine. Easy to deploy in both cloud and on-premises environments. Flexible in resource sharing and pooling. CIS-4403-Week3&4-Resource virtualization and pooling 38 39 Containerization in cloud : Dockers (8/8) Docker enabler for resource sharing and pooling in Cloud Docker plays a crucial role in resource sharing and pooling within cloud environments by enabling efficient use of infrastructure through containerization. Sharing resources: Docker allows multiple containers to share the same infrastructure resources (CPU, memory, storage) while keeping them logically isolated. This efficient sharing of resources reduces overhead and allows for more effective use of the physical hardware. With Docker's flexible resource sharing, each container can be allocated a specific amount of resources, and Docker can dynamically adjust the resource allocation as needed based on the demands of the applications running in the containers. Pooling of Resources: Docker can manage pools of resources, such as storage and network bandwidth, distributing them across containers as needed. This dynamic allocation ensures that resources are used efficiently and can be quickly reallocated based on demand. CIS-4403-Week3&4-Resource virtualization and pooling 39 40 Evaluating your understanding https://create.kahoot.it/details/5746cb30-a166-42a3-8d1d-c498eab fee15 CIS-4403-Week3&4-Resource virtualization and pooling 40 41 References E-Textbook : Cloud Computing, Sandeep Bhowmik, 2017 Textbook : CompTIA Cloud+ Guide to Cloud Computing | 2nd Edition. Jill West, August 2022, : https://www.starwindsoftware.com/blog/virtualization/) https://www.c-sharpcorner.com/article/introduction-and-what-is-n etwork-virtualization// https://forum.huawei.com/enterprise/en/what-is-storage-virtualiza tion/thread/667285635377020928-667213859733254144 / CIS-4403-Week3&4-Resource virtualization and pooling 41 CIS 4403 800 MyHCT (800 www.hct.ac.ae 69428)