airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victor Vianna (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks
Date Wed, 22 Aug 2018 10:21:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Victor Vianna updated AIRFLOW-2934:
-----------------------------------
    Description: I'm trying to have some subdags execute one task at a time. The way I found
was to create a first pool for the SubdagOperators (pool1 in the attached code file) and a
second one for the internal tasks (pool2). However, it appears that pools for subdag elements
are not being respected. Running airflow 1.9.0 with LocalExecutor.  (was: I'm trying to have some
subdags execute one task at a time. The way I found was to create a first pool for the SubdagOperators
(pool1 in the attached code file) and a second one for the internal tasks (pool2). However,
it appears that pools for subdag elements are not being respected. Running airflow 1.9.0.)

> Pools not respected for internal subdag tasks
> ---------------------------------------------
>
>                 Key: AIRFLOW-2934
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2934
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: pools, subdag
>    Affects Versions: 1.9.0
>         Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56
UTC 2018 x86_64 GNU/Linux
>            Reporter: Victor Vianna
>            Priority: Blocker
>         Attachments: dag_pool.py
>
>
> I'm trying to have some subdags execute one task at a time. The way I found was to create
a first pool for the SubdagOperators (pool1 in the attached code file) and a second one for
the internal tasks (pool2). However, it appears that pools for subdag elements are not being
respected. Running airflow 1.9.0 with LocalExecutor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message