airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1612) Per-task level concurrency
Date Thu, 14 Sep 2017 19:48:00 GMT
Dan Davydov created AIRFLOW-1612:

             Summary: Per-task level concurrency
                 Key: AIRFLOW-1612
             Project: Apache Airflow
          Issue Type: New Feature
          Components: core
            Reporter: Dan Davydov

It would be useful to be able to specify per-task level concurrency, that way you could have
multiple tasks in a DAG that have different limits. Pools kind of offer a solution for this,
but they don't work well with dynamically created tasks since you don't want to manually create/remove

This message was sent by Atlassian JIRA

View raw message