Introduction à l'échelle sur AWS

Introduction to Scaling on AWS

• The presentation focuses on scaling applications on Amazon Web Services (AWS) to handle up to 10 million users.
• The presenter, Giulio Iannazzo, is a Solution Architect at Amazon Web Services.

How to Scale Application on AWS

• Managing users, maintaining performance (including across multiple geographic locations), detecting and responding swiftly to incidents, preserving business continuity, and overseeing security and compliance are vital for scale.
• Developing and testing, managing changes, tracking and controlling costs, optimizing for cost-effectiveness, and minimizing the carbon footprint are essential for large-scale operation.

AWS Global Infrastructure

• AWS operates a global infrastructure spanning 34 regions and 108 Availability Zones (AZs).
• A private backbone network connects these regions, facilitating seamless data transfer.
• More than 600 points of presence are in use.
• Information can be found at www.infrastructure.aws

Key Characteristics of AWS Regions/Availability Zones

• AWS regions define the data location.
• Regions provide robust protection against legal risks, such as GDPR.
• Regions also enable disaster recovery.
• Availability Zones (AZs) are clusters of data centers within a region. Each region has multiple AZs to prevent single points of failure.

AWS Points of Presence

• Points of presence are used for content delivery services, including but not limited to Amazon CloudFront.

AWS Local Zones

• AWS Local Zones enhance region capabilities and are located in significant urban and industrial centers.

AWS Wavelength

• This service is designed for high-speed applications that handle enormous volumes of data, like those used by stadiums/venues and other high-bandwidth situations.

AWS Outposts

• AWS Outposts allows the extension of AWS infrastructure to on-premises data centers. Features include ultra-low latency application processing and local data storage.

Breadth and Depth of AWS Services

• Over 200 fully-featured services are offered by AWS in various categories (Analytics, Business Apps, Blockchain, Security, Identity, Compliance, Storage, Compute, Media, Database, Hybrid Architecture, Internet of Things, Machine Learning, Al, Chat).

Considerations for Scaling

• Decisions are reversible, like "two-way doors."
• Iterative development using the Build-Measure-Learn cycle is encouraged.

Scaling Challenges Summary

• Single instance applications pose challenges regarding failover, redundancy and the ability to scale individual components independently, often constrained by technological choices.

Database Options

• Self-managed options are available, including Amazon EC2.
• Fully-managed options are also present; for example, Amazon RDS, Amazon DynamoDB, Amazon Neptune, and Amazon Aurora, along with Amazon Timestream are provided.

Amazon Relational Database Service (RDS)

• Amazon RDS offers a managed relational database service.
• RDS handles daily maintenance.
• Security patches and software updates are managed.
• Supported database engines include MySQL, MariaDB, PostgreSQL, Oracle, SQL Server, and Amazon Aurora.

Amazon Aurora

• Compatible with MySQL and PostgreSQL, offering automatic storage scaling, read replicas (up to 15) , continuous backups, and six-way replication across three Availability Zones.

Aurora Serverless v2

• This solution provides on-demand, automatic scaling for applications with fluctuating workloads. Functions start when needed and stop when not in use.

NoSQL Databases

• NoSQL databases may be a suitable solution for handling latency-sensitive applications or large datasets requiring rapid ingestion.

Amazon DynamoDB

• DynamoDB is a managed NoSQL database service supporting adjustable database provision and on-demand pricing.
• DynamoDB is fully distributed for fault-tolerance, performance predictability, and global multi-region support.

Application Modernization

• Modernizing applications with containers or serverless architectures using Amazon CloudFront, Application Load Balancers, EC2 instances, Amazon ECS, Amazon EKS, AWS Batch and Lambda functions is possible.
• A serverless approach eliminates the need to manage servers and infrastructure, benefiting developers.

Loose Coupling - Amazon SQS and Amazon SNS

• Amazon SQS and Amazon SNS support reliable, scalable, and secure distributed message queues.
• They allow messages to be published to queues and topics, and received or subscribed to independently.

Event-driven Computing - AWS Lambda

• AWS Lambda supports event-driven computing.
• Functions, written in numerous languages such as Java, Go, PowerShell, Node.js, C#, Ruby, and Python, can respond to events initiated by other services and applications.
• The service enables effective scaling.

Web Application Using Serverless Components

• Using various AWS services like CloudFront, S3, Cognito, API Gateway, Lambda, and DynamoDB, a serverless web application can be designed, offering scalability, high reliability, cost-effectiveness, and ease of development.

Loose Coupling Summary

• Loosening coupling in applications boosts scalability and reliability, encouraging the use of pre-built components and avoiding internal management of interactions between various services.

Microservices Architecture

• The microservices architecture entails splitting an application into numerous independent, self-contained services. AWS tools are available to aid this approach.

AWS X-Ray

• AWS X-Ray assists in analyzing application performance, isolating bottlenecks, pinpointing errors in specific components, understanding the impact of these issues on users, and visualizing service call graphs.

Scaling to >1 Million Users

• Fine-tuning and multi-region capabilities of the solution need assessment.
• Database performance issues and custom in-house tools should also be considered. Various potential options should be discussed and explored.

Purpose Built Database

• Use databases designed for specific use cases like graph data (Amazon Neptune), ledgers, geo-location (Amazon Location Service) and key-value stores (Amazon DynamoDB) where relevant.

Database Issues and Solutions

• Possible solutions for database issues include federation (multiple DBs), sharding (splitting the data), purpose-built databases (NoSQL, Graph), and multi-region replication (potentially multi-master).

Summary of AWS Amplify

• AWS Amplify helps provide quick development and setup of front-end applications using various technologies (React, Vue.js, Angular).
• Amplify Studio greatly assists development workflow.

Important Design Considerations for Scale

• Multi-AZ infrastructure allows applications to be more robust and resilient, providing redundancy in the case of failures.
• Self-scaling services (Load Balancer, S3, Lambda, SNS, SQS, Step Functions) support applications to handle varying loads, maintaining a good performance baseline.
• Using SQL (Structured Query Language) as the database solution is strongly advised for many enterprise-level applications, and cached data is essential for quick responses.