airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victor Vianna (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-2934) Pools not respected for internal subdag tasks
Date Wed, 22 Aug 2018 10:20:00 GMT


Victor Vianna commented on AIRFLOW-2934:

I added a DummyOperator at the beggining of each subgraph and now it got even stranger, it
will execute only one of the subgraphs and then hang

> Pools not respected for internal subdag tasks
> ---------------------------------------------
>                 Key: AIRFLOW-2934
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: pools, subdag
>    Affects Versions: 1.9.0
>         Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56
UTC 2018 x86_64 GNU/Linux
>            Reporter: Victor Vianna
>            Priority: Blocker
>         Attachments:
> I'm trying to have some subdags execute one task at a time. The way I found was to create
a first pool for the SubdagOperators (pool1 in the attached code file) and a second one for
the internal tasks (pool2). However, it appears that pools for subdag elements are not being
respected. Running airflow 1.9.0.

This message was sent by Atlassian JIRA

View raw message