19 Questions
What is the default number of jobs that a Matillion ETL instance allows to run concurrently?
16 jobs
How does the number of vCPUs on a Matillion ETL instance affect the maximum number of processes that can run in a single job?
Each vCPU allows 2 processes
What happens when a job queue consists of running one job 16 times?
All jobs run sequentially
What is an unbound queue in the context of Matillion ETL's job submission?
A queue with no imposed limit on size
How do long-running jobs submitted in multiple instances affect scheduled jobs?
They prevent the scheduled jobs from running
What determines the maximum number of processes that can run inside a single Matillion ETL job?
Number of vCPUs on the instance
What happens when you launch Matillion ETL with an instance having many more vCPUs than suggested?
It can increase the number of processes that can run in a single job
How does running multiple instances of a long-running job affect job scheduling?
It can conflict with scheduled jobs
What could happen if long-running jobs conflict with a scheduled job?
"The scheduled job may not run at its scheduled time"
What is recommended to use in these scenarios?
Micro-batching pattern
How are validation tasks submitted in Matillion ETL?
Via the task runner
What happens when the maximum concurrency limit is reached in Matillion ETL?
Validation times may increase
In an HA Cluster, how are jobs distributed across nodes?
Randomly
What is important for jobs running on an HA Cluster when a node fails?
Making the job idempotent
What does the warning about transformation jobs highlight?
Multiple instances of the same transformation job cannot run in parallel
What behavior is observed when using a Run Orchestration component?
Jobs are queued at the sub-job level
What does Matillion's Multiple Environment Connections feature enable users to do?
Run multiple ETL jobs across multiple connections
Why should users avoid running multiple instances of the same transformation job at once?
'Deadlocks' can occur and high availability may be compromised
What is the number of default threads allocated for each pool when a job is running?
$2 \times n$ Vcores
Learn about Matillion ETL job queues and how jobs are concurrently run in Matillion ETL. Understand the process of running jobs through Message Queues, the API, and the Scheduler in this overview.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free
