airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1612) Per-task level concurrency
Date Thu, 14 Sep 2017 19:48:00 GMT
Dan Davydov created AIRFLOW-1612:
------------------------------------

             Summary: Per-task level concurrency
                 Key: AIRFLOW-1612
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1612
             Project: Apache Airflow
          Issue Type: New Feature
          Components: core
            Reporter: Dan Davydov


It would be useful to be able to specify per-task level concurrency, that way you could have
multiple tasks in a DAG that have different limits. Pools kind of offer a solution for this,
but they don't work well with dynamically created tasks since you don't want to manually create/remove
pools.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message