airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victor Vianna (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2934) Pools not respected for internal subdag tasks
Date Wed, 22 Aug 2018 10:20:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588664#comment-16588664
] 

Victor Vianna commented on AIRFLOW-2934:
----------------------------------------

I added a DummyOperator at the beggining of each subgraph and now it got even stranger, it
will execute only one of the subgraphs and then hang

> Pools not respected for internal subdag tasks
> ---------------------------------------------
>
>                 Key: AIRFLOW-2934
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2934
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: pools, subdag
>    Affects Versions: 1.9.0
>         Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56
UTC 2018 x86_64 GNU/Linux
>            Reporter: Victor Vianna
>            Priority: Blocker
>         Attachments: dag_pool.py
>
>
> I'm trying to have some subdags execute one task at a time. The way I found was to create
a first pool for the SubdagOperators (pool1 in the attached code file) and a second one for
the internal tasks (pool2). However, it appears that pools for subdag elements are not being
respected. Running airflow 1.9.0.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message