IT Service Management AWS Compute and Storage PDF

DAB 202 IT Service Management Week 4 LABS FEEDBACK 2  Lab Feedback It is just a lab Step back (trace back your steps and try to identify what might have happened) Think logically (Establish a hypothesis of what might be wrong and t...

DAB 202 IT Service Management Week 4 LABS FEEDBACK 2  Lab Feedback It is just a lab Step back (trace back your steps and try to identify what might have happened) Think logically (Establish a hypothesis of what might be wrong and test for it) Stay positive Take a break! Try again COMPUTE  AWS LightSail Amazon LightSail is the easiest way to launch and manage a Web server using AWS. https://aws.amazon.com/free/compute/lightsail/ AWS compute services Amazon Web Services (AWS) offers many compute services. This module will discuss the highlighted services. Amazon EC2 Amazon EC2 Amazon Elastic Amazon Elastic VMware Cloud Auto Scaling Container Registry Container Service on AWS (Amazon ECR) (Amazon ECS) AWS Elastic AWS Lambda Amazon Elastic Amazon Lightsail AWS Batch Beanstalk Kubernetes Service (Amazon EKS) AWS Fargate AWS Outposts AWS Serverless Application Repository Categorizing compute services Services Key Concepts Characteristics Ease of Use Amazon EC2 Infrastructure as a service (IaaS) Provision virtual machines that you A familiar concept to many IT Instance-based can manage as you choose professionals. Virtual machines AWS Lambda Serverless computing Write and deploy code that runs on A relatively new concept for Function-based a schedule or that can be triggered many IT staff members, but easy Low-cost by events to use after you learn how. Use when possible (architect for the cloud) Amazon ECS Container-based computing Spin up and run jobs more quickly AWS Fargate reduces Amazon EKS Instance-based administrative overhead, but AWS Fargate you can use options that give Amazon ECR you more control. AWS Elastic Platform as a service (PaaS) Focus on your code (building your Fast and easy to get started. Beanstalk For web applications application) Can easily tie into other services— databases, Domain Name System (DNS), etc. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 7  Compute Services ▪ Provide virtual server hosting, container management, and serverless computing ▪ Instead of hosting servers themselves, organizations can “rent” server compute space and capabilities ▪ No longer have to purchase physical servers or maintain data centers on-premises 8 AWS Elastic Compute Cloud (EC2) ▪ Amazon Elastic Compute Cloud (Amazon EC2) – Provides virtual machines—referred to as EC2 instances—in the cloud. – Gives you full control over the guest operating system (Windows or Linux) on each instance. ▪ You can launch instances of any size into an Availability Zone anywhere in the world. – Launch instances from Amazon Machine Images (AMIs). Amazon – Launch instances with a few clicks or a line of code, and they are ready in minutes. EC2 ▪ You can control traffic to and from instances.  AWS Elastic Compute Cloud (EC2) ▪ Allows users to create virtual computers called instances also called EC2 – CPU, Network card, OS, Hard drive, Firewall, RAM ▪ Pay per use to run your own computer applications ▪ Quickly allows scale capacity, both up and down, as your computing requirements change ▪ Full control over the geographical location of the instance you create ▪ EC2 is fully integrated with most of the AWS services (S3, RDS) AWS Elastic Compute Cloud (EC2) https://aws.amazon.com/ec2  AWS Elastic Compute Cloud (EC2) Select instance type based on use case General Compute Memory Accelerated Storage Purpose Optimized Optimized Computing Optimized Instance a1, m4, m5, r4, r5, f1, g3, g4, c4, c5 d2, h1, i3 Types t2, t3 x1, z1 p2, p3 High In-memory Machine Distributed Use Case Broad performance databases learning file systems Amazon EC2 storage options ▪ Amazon Elastic Block Store (Amazon EBS) – – Durable, block-level storage volumes. – You can stop the instance and start it again, and the data will still be there. ▪ Amazon EC2 Instance Store – – Ephemeral storage is provided on disks that are attached to the host computer where the EC2 instance is running. – If the instance stops, data stored here is deleted. ▪ Other options for storage (not for the root volume) – – Mount an Amazon Elastic File System (Amazon EFS) file system. – Connect to Amazon Simple Storage Service (Amazon S3). © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 13 EC2 COST OPTIMIZATION 14 Amazon EC2 pricing models On-Demand Instances Reserved Instances Spot Instances ▪ Pay by the hour ▪ Full, partial, or no upfront payment ▪ Instances run as long as they are for instance you reserve. available and your bid is above the ▪ No long-term commitments. Spot Instance price. ▪ Discount on hourly charge for that ▪ Eligible for the AWS Free Tier. instance. ▪ They can be interrupted by AWS with a 2-minute notification. ▪ 1-year or 3-year term. ▪ Interruption options include Dedicated Hosts Scheduled Reserved terminated, stopped or hibernated. Instances ▪ Prices can be significantly less ▪ A physical server with EC2 instance expensive compared to On-Demand capacity fully dedicated to your use. ▪ Purchase a capacity reservation that is Instances always available on a recurring schedule you specify. ▪ Good choice when you have flexibility in when your applications can run. Dedicated Instances ▪ 1-year term. ▪ Instances that run in a VPC on hardware that is dedicated to a single customer. Per second billing available for On-Demand Instances, Reserved Instances, and Spot Instances that run Amazon Linux or Ubuntu. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 15 Amazon EC2 pricing models: Benefits On-Demand Instances Spot Instances Reserved Instances Dedicated Hosts Low cost and flexibility Large scale, dynamic Predictability ensures Save money on licensing workload compute capacity is costs available when needed Help meet compliance and regulatory requirements © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 16 Amazon EC2 pricing models: Use cases Spiky Workloads Time-Insensitive Steady-State Workloads Highly Sensitive Workloads Workloads On-Demand Instances Spot Instances Reserved Instances Dedicated Hosts Short-term, spiky, or Applications with flexible start Steady state or predictable Bring your own license (BYOL) unpredictable workloads and end times usage workloads Compliance and regulatory Application development or Applications only feasible at Applications that require restrictions testing very low compute prices reserved capacity, including disaster recovery Usage and licensing tracking Users with urgent computing needs for large amounts of Users able to make upfront additional capacity payments to reduce total Control instance placement computing costs even further © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 17 Container Services Virtual Machines vs. Containers Virtual Machines Container  Virtual Machines vs. Containers Three virtual machines on three EC2 instances Example VM 1 VM 2 VM 3 Three containers on one EC2 instance Container App 1 App 2 App 3 Container Container Container Bins/Libs Bins/Libs Bins/Libs instance 1 instance 2 instance 3 Docker App 1 App 2 App 3 EC2 EC2 EC2 engine Bins/Libs Bins/Libs Bins/Libs instance instance instance guest OS guest OS guest OS EC2 instance guest OS Hypervisor Part of Host operating system AWS Global Infrastructure Physical server © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 20 Container basics ▪ Containers are a method of operating system virtualization. Your Container ▪ Benefits – Your application – Repeatable. – Self-contained environments. Dependencies – Software runs the same in different environments. Configurations ▪ Developer's laptop, test, production. Hooks into OS – Faster to launch and stop or terminate than virtual machines © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 21 What is Docker? ▪ Docker is a software platform that enables you to build, test, and deploy applications quickly. Container ▪ You run containers on Docker. – Containers are created from a Containers have everything the template called an image. software needs to run: ▪ A container has everything a software System application needs to run. Libraries Code Runtime tools © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 22  Docker Containers ▪ Container: A standard unit of software that holds the complete runtime environment including an application, all application dependencies, libraries, binaries, and configuration files. ▪ Think of Containers as Lightweight VM ▪ https://www.docker.com/ ▪ https://www.ibm.com/cloud/learn/docker ▪ https://aws.amazon.com/docker/ AWS Elastic Container Services (ECS) Container orchestration services https://aws.amazon.com/ecs/ Amazon Elastic Container Service (Amazon ECS) ▪ Amazon Elastic Container Service (Amazon ECS) – – A highly scalable, fast, container management service ▪ Key benefits – – Orchestrates the running of Docker containers Amazon Elastic – Maintains and scales the fleet of nodes that run your containers Container Service – Removes the complexity of standing up the infrastructure ▪ Integrated with features that are familiar to Amazon EC2 service users – – Elastic Load Balancing – Amazon EC2 security groups – Amazon EBS volumes – IAM roles © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 25 Amazon ECS orchestrates containers EC2 instance Requests to run containers x3 x2 Container A EC2 instance Container B Amazon Elastic Container Service (Amazon ECS) ECS cluster © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 26 What is Kubernetes? ▪ Kubernetes is open source software for container orchestration. – Deploy and manage containerized applications at scale. – The same toolset can be used on premises and in the cloud. ▪ Complements Docker. – Docker enables you to run multiple containers on a single OS host. – Kubernetes orchestrates multiple Docker hosts (nodes). ▪ Automates – – Container provisioning. – Networking. – Load distribution. – Scaling. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 27  Kubernetes Container Management ▪ Useful to isolate processes ▪ Autoscaling parameters ▪ Kubernetes handles monitoring and management of containers is done for you (Ex: auto restart failed container) ▪ Kubernetes handles server monitoring, auto repair, auto scale https://www.ibm.com/cloud/kubernetes-service/kubernetes-tutorials AWS LAMBDA 29 AWS Lambda https://aws.amazon.com/lambda/ Benefits of Lambda It supports multiple programming languages Completely automated administration Built-in fault tolerance AWS It supports the orchestration of multiple functions Lambda Pay-per-use pricing AWS Lambda event sources Event sources Configure other AWS services as event sources to invoke your function as shown here. Amazon S3 Alternatively, invoke a Lambda function from the Lambda console, AWS SDK, or AWS CLI. Amazon DynamoDB Amazon Simple Notification Service (Amazon SNS) Lambda Running of your code Amazon Simple Queue function (only when triggered) Service (Amazon SQS) AWS Lambda Amazon API Gateway Logging, monitoring, and metrics Application Load Balancer Amazon Many more… CloudWatch © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 32 AWS ELASTIC BEANSTALK 33 AWS Elastic Beanstalk ▪ An easy way to get web applications up and running ▪ A managed service that automatically handles – – Infrastructure provisioning and configuration – Deployment – Load balancing – Automatic scaling AWS Elastic – Health monitoring Beanstalk – Analysis and debugging – Logging ▪ No additional charge for Elastic Beanstalk – Pay only for the underlying resources that are used © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 34 AWS Elastic Beanstalk deployments ▪ It supports web applications written for common platforms – Java,.NET, PHP, Node.js, Python, Ruby, Go, and Docker You Your code manage HTTP server ▪ You upload your code Application server AWS – Elastic Beanstalk automatically manages Language interpreter handles the deployment Operating system Host – Deploys on servers such as Apache, NGINX, Passenger, Puma, and Microsoft Internet Information Services (IIS) © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 35 STORAGE 36  AWS Storage Services ▪ Provide storage for both in-use and archival files ▪ Different costs are associated with how often you need to access the files and how durable or available you want them to be ▪ Storage type for almost every level of need with very granular costs to meet budget requirements ▪ https://aws.amazon.com/products/storage 37  AWS Storage Services 01 02 03 04 Simple Elastic Block Glacier Storage Storage Store (EBS) Gateway Service (S3)  Simple Storage Service (S3) ▪ Simple Storage Service (S3) – Object Storage – Distributed across at least three Availability Zones (by default) ▪ 1A (1 zone, least expensive)  Simple Storage Service (S3) ▪ Simple Storage Service (S3) – Supports automatic data classification (automatically move less frequently accessed data to less expensive storage) – Big data analytics can run directly against data stored in S3.  Simple Storage Service (S3) ▪ Simple Storage Service (S3) – https://aws.amazon.com/s3/ – https://aws.amazon.com/s3/storage-classes – https://www.youtube.com/watch?v=77lMCii Milo  Simple Storage Service (S3) ▪ A simple web service interface to store and retrieve any amount of data from anywhere on the web. ▪ Large unlimited storage bucket ▪ Like a Dropbox ▪ Simple, durable, scalable, secure, low-cost option for mass storage and long- term storage ▪ You do not want to store information on EC2 local storage because the instances in most cases are not permanent  Amazon Simple Storage Service (S3) ▪ Object storage service: storing each file as separate entity (object) ▪ 99.999999999% durable (11 9s) ▪ Use cases include uploaded files for a websites, mobile apps, backup and archiving, enterprise applications, IoT devices, big data analytics ▪ Easy to use management features to fine tune access controls  S3 Storage Classes 1. Standard 2. Intelligent-Tiering 3. Standard-Infrequent Access 4. One Zone-Infrequent Access 5. Glacier 6. Glacier Deep Archive  S3 Storage Classes ▪ Many storage classes available to fit your budget and needs ▪ You can setup S3 lifecycle policies to automatically transfer files from one storage class to a cheaper one after a certain number of days https://aws.amazon.com/s3/ Storage Amazon Elastic Block Store (Amazon EBS) © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 46  Amazon Elastic Block Store (EBS) ▪ Provides raw block-level storage ▪ Can be attached to EC2 instances ▪ Used by the Amazon Relational Database Services (RDS) – https://aws.amazon.com/ebs/ Block storage versus object storage What if you want to change one character in a 1-GB file? Block storage Object storage Change one block (piece of the file) Entire file must be updated that contains the character © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 48  Elastic Block Store (EBS) ▪ Raw, unformatted block storage attached to an EC2 instance ▪ You can add multiple EBS volumes to one EC2 instance ▪ Use as file systems or hard drives ▪ Dynamically change configurations to attached volumes via management console ▪ Automatically replicated within its availability zone  Elastic Block Store (EBS) ▪ Different types of EBS storage types for your needs and budgets ▪ Can be encrypted ▪ Exist independently of EC2 instances so can be moved to other instances ▪ Think of EBS as an external hard drive for your EC2 servers https://aws.amazon.com/ebs/  Amazon Glacier ▪ Cheaper to store and more expensive to retrieve – https://aws.amazon.com/s3/glacier/  Snowball & Snowmobile https://aws.amazon.com/snowball/ https://aws.amazon.com/snowmobile/ https://aws.amazon.com/snow/  Snowball ▪ Data migration tool ▪ It is designed for cases when you have so much data that it is not practical to move it using your network connection ▪ Hardware solution: AWS will physically ship you a Snowball to move your data and ship back ▪ Can move 50 terabytes with regular Snowball up and to 100 petabytes with Snowmobile  Snowball ▪ Usage fee: free for 10 days of onsite usage; extra usage fees for every extra day you keep it ▪ Service fee per job ▪ Storage fee: storage fee for data transferred into S3 (but no transfer fee) ▪ Snowmobile: expensive!  AWS Snowball ▪ Physical device ▪ Data migration tool that can function as a storage device ▪ AWS ships you a “snowball” to move your data onto ana mail back ▪ AWS uploads mailed back data onto AWS S3 ▪ Faster to upload to the cloud than using your network connection  Amazon Storage Gateway ▪ Acts as a VPN connection to the AWS cloud so that you can access your AWS storage as if it were local storage ▪ Data can be stored locally and replicated to the AWS cloud ▪ Data can be stored in the cloud and appear local – https://aws.amazon.com/storagegateway/ STORAGE USE CASE  Use Case - Web Hosting ▪ Static websites – require no actions to take place on the server – does not change based on user interactions; typically built using HTML and Cascading Style Sheets (CSS) – It can be stored on an S3 bucket (storage). ▪ Dynamic websites – require interactions with the server to respond to requests made on the client machines – changes based on user interactions, often built using Python, JavaScript, PHP, or ASP with Hypertext Markup Language (HTML). – It needs to be hosted on a virtual machine. KEY TERMS  AWS Infrastructure Key Terms ▪ Amazon Elastic Block Store (Amazon EBS) – Storage for specific Amazon Elastic Compute Cloud (Amazon EC2) instances. Think of it as the storage drive for your EC2 instance. ▪ Amazon Elastic Compute Cloud (Amazon EC2) – A web service that provides secure, resizable computing capacity in the cloud. Think of it as renting a computer in the cloud (virtual machine).  AWS Infrastructure Key Terms ▪ Hard disk drive (HDD) – Slower storage that uses a spinning disk to store data. ▪ Solid state drive (SSD) – Very fast storage that uses flash memory instead of a spinning disk. ▪ Input/Output Operations Per Second (IOPS) – A common performance measurement used to benchmark computer storage devices like hard disk drives (HDDs) and solid-state drives (SSDs).