EMR Cluster Concepts Quiz

<p>Manages the cluster, tracks task status, and monitors cluster health (A)</p> Signup and view all the answers

<p>A transient cluster is terminated after all steps are completed while a long-running cluster continues to run until manually terminated (D)</p> Signup and view all the answers

<p>First adds core nodes, then task nodes, up to the maximum units specified (C)</p> Signup and view all the answers

<p>All of the above (D)</p> Signup and view all the answers

<p>Task nodes are removed first, followed by core nodes, up to the minimum constraints (B)</p> Signup and view all the answers

<p>To retrieve only specific attributes of an item. (A)</p> Signup and view all the answers

<p>PutItem creates a new item, while UpdateItem only updates the existing item's attributes. (A)</p> Signup and view all the answers

<p>To avoid performance issues when accessing popular items. (A)</p> Signup and view all the answers

<p>Implement a retry mechanism (D)</p> Signup and view all the answers

<p>Increase maxRecords per call (B)</p> Signup and view all the answers

<p>Insufficient shard number (A)</p> Signup and view all the answers

<p>Insufficient write capacity on DynamoDB (C)</p> Signup and view all the answers

<p>IteratorAgeMilliseconds and MillisBehindLatest (C)</p> Signup and view all the answers

<p>Implement exponential backoff (D)</p> Signup and view all the answers

<p>When records get skipped (D)</p> Signup and view all the answers

<p>Proper permissions on the execution role (C)</p> Signup and view all the answers

<p>Implement a retry mechanism (A)</p> Signup and view all the answers

<p>Number of shards and retention period (B)</p> Signup and view all the answers

<p>Creates a new column for each instance of a field name. (D)</p> Signup and view all the answers

<p>Jupyter Notebook on local machine (C)</p> Signup and view all the answers

<p>They persist the state from job runs to process only new data. (B)</p> Signup and view all the answers

<p>Granular access control with row and cell level security. (A)</p> Signup and view all the answers

<p>Jobs follow a recurring schedule like CRON. (A)</p> Signup and view all the answers

<p>Projects all data types to a specified type. (D)</p> Signup and view all the answers

<p>Involves IAM permissions and AWS Resource Access Manager. (B)</p> Signup and view all the answers

<p>Number of data sources accessed. (B)</p> Signup and view all the answers

<p>ACID transactions across multiple tables. (A)</p> Signup and view all the answers

<p>Optimizing query performance by merging small files. (C)</p> Signup and view all the answers

<p>It requires a dedicated master node and UltraWarm to be enabled. (B)</p> Signup and view all the answers

<p>Balance shard allocations across nodes. (D)</p> Signup and view all the answers

<p>To manage index policies such as deleting old indices. (B)</p> Signup and view all the answers

<p>To avoid split brain scenarios. (B)</p> Signup and view all the answers

<p>Capacity for indexing and searching. (A)</p> Signup and view all the answers

<p>When facing JVM memory pressure errors. (A)</p> Signup and view all the answers

<p>They can be configured to store data in S3. (C)</p> Signup and view all the answers

<p>Using RDS for transaction-oriented workloads. (B)</p> Signup and view all the answers

<p>They organize data efficiently for retrieval. (A)</p> Signup and view all the answers

<p>To enhance data availability and geographical redundancy. (A)</p> Signup and view all the answers

<p>Users must be mapped to the cold_manager role for access. (C)</p> Signup and view all the answers

<p>Three nodes. (B)</p> Signup and view all the answers

<p>They reduce the size of the data by summarizing it. (C)</p> Signup and view all the answers

<p>It offers real-time data processing. (B)</p> Signup and view all the answers

<p>By Kinesis Processing Units (KPUs) consumed per hour. (B)</p> Signup and view all the answers

<p>MSK has a default message size of 1MB but can be configured for larger sizes. (A)</p> Signup and view all the answers

<p>Anomaly detection on numeric columns in a stream. (B)</p> Signup and view all the answers

<p>MSK can use mutual TLS and Kafka ACLs for security. (D)</p> Signup and view all the answers

<p>Auto recovery for common Kafka failures. (B)</p> Signup and view all the answers

<p>Hot and UltraWarm storage types. (D)</p> Signup and view all the answers

<p>Auto scaling capabilities for workers. (B)</p> Signup and view all the answers

<p>Streaming ETL. (D)</p> Signup and view all the answers

<p>They transport data between Kafka and external systems. (B)</p> Signup and view all the answers

<p>Kinesis streams data without dedicated storage options. (D)</p> Signup and view all the answers

<p>Messages have a maximum size limit of 1MB. (C)</p> Signup and view all the answers

<p>Deployable in multiple AZs for high availability. (C)</p> Signup and view all the answers

A service for querying data stored in Amazon S3 using standard SQL.

Units used to measure compute capacity in Athena for query executions.

A managed Hadoop framework to process vast amounts of data on EC2.

Managed environment in EMR for data preparation, visualization, and collaboration.

A collection of EC2 instances running Hadoop for data processing.

An EMR cluster that terminates after completing all tasks, saving costs.

The node that manages the EMR cluster, tracks status, and health.

Approach to adding or removing nodes in an EMR cluster for efficiency.

Particularly popular items leading to uneven workload distribution across partitions.

A strategy to increase wait time between retries to reduce load on services.

DynamoDB adjusts reads/writes automatically based on workloads, charging for actual usage.

Read and Write Request Units, measuring capacity used for reads and writes in DynamoDB.

An API call that creates a new item or replaces an existing item with the same primary key.

An API call used to modify an item's attributes or add it if it doesn't exist.

Reads data based on a primary key, retrieving attributes as specified.

A strategy to manage concurrent queries, prioritizing faster queries over slower ones.

Creates a new column for each occurrence of the same field name.

Converts all values in a column to a specified data type.

Projects every data type to a specific type, such as string.

Keeps track of the last processed state in ETL jobs to prevent reprocessing.

A service built on AWS Glue to create and manage secure data lakes.

Supports ACID transactions and automatic data compaction in data management.

Allows access to data that was modified within a defined time period.

Controls access to data at various levels (row, column, etc.) using IAM roles.

Security applied to data when granting SELECT permissions on tables.

Triggers notifications or functions when ETL jobs succeed or fail.

An error indicating an error rate above 1% in Kinesis streams.

A strategy to attempt operations again after a failure.

Shards that receive more traffic than others, causing throttling.

A strategy that increases the wait time between retries exponentially.

An API call to retrieve records from a Kinesis stream.

A metric showing how far behind the consumer is in record processing.

AWS service to run Apache Flink applications with support for Python and Scala.

An API in Flink for processing data streams.

Destinations where processed data is sent in a Flink application.

The process of triggering a Lambda function to execute in response to events.

A storage option using S3 for infrequent access to old data.

A dedicated node that manages cluster state and metadata in a database.

Moving data between different storage types for efficiency.

Pieces of an index that allow for distribution across nodes in a cluster.

Automates policies for managing the lifecycle of indices.

Replicates indices across different domains for redundancy.

Performance issues relating to memory overload in Java applications.

Backing up indices to S3 for disaster recovery and storage management.

Metrics for measuring capacity in a serverless OpenSearch implementation.

Summarizes old data into fewer, larger files to save storage costs.

A feature for capturing changes in your DynamoDB tables.

A tool for building visual reports and dashboards from big data sets.

Security feature that protects data stored on disk from unauthorized access.

Temporary and specific queries made to retrieve data as needed.

Detailed management of user permissions to specific data or functions.

Billing unit for Kinesis services; 1 KPU = 1vCPU + 4GB.

Analyzing incoming stream data while setting up the stream.

SQL function for anomaly detection in numeric streams.

AWS service for fully managed Apache Kafka for streaming data.

MSK's ability to recover from common Kafka failures automatically.

Elastic Block Store used for data storage in MSK.

Framework for moving data to/from Kafka using connectors.

Imports data into Kafka topics from external systems.

Exports data from Kafka topics to external systems.

Default message size limit of 1 MB in Kinesis Data Streams.

Transport Layer Security used for encrypting data in transit.

A scalable search and analytics engine for large datasets.

Fast storage solution used by standard data nodes in OpenSearch.

Storage using S3 for less frequent writes in OpenSearch.

Virtual Private Cloud for deploying resources on AWS.