airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ananth Durai <vanant...@gmail.com>
Subject Airflow parallelism
Date Mon, 17 Jul 2017 06:54:41 GMT
Hi there,
I'm having a hard time to understand airflow parallelism. I'm running
Airflow with the following configuration

Executor: LocalExecutor
parallelism: 156
Airflow version: 1.8.1

I assume the maximum number of "Task Instances" would be 156 at any given
time, but I constantly see the active "Task Instance" around 250 sometimes.
Wonder why I'm seeing this behavior.

Regards,
Ananth.P,

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message