airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christoph Paulik (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2356) Support queues in dask using worker resources
Date Sat, 21 Apr 2018 18:28:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446929#comment-16446929
] 

Christoph Paulik commented on AIRFLOW-2356:
-------------------------------------------

I could implement this if the idea is accepted.

> Support queues in dask using worker resources
> ---------------------------------------------
>
>                 Key: AIRFLOW-2356
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2356
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Christoph Paulik
>            Priority: Minor
>
> Dask in Airflow does at the moment not support queues. I suggest to implement this by
using [worker resources](https://distributed.readthedocs.io/en/latest/resources.html#example).

> A queue name would be a necessary worker resource that a dask worker must have to be
able to compute a specific task.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message