airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1963) Allow setting a default value in configuration for the mapred_queue in the HiveOperator
Date Wed, 03 Jan 2018 22:24:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310382#comment-16310382
] 

ASF subversion and git services commented on AIRFLOW-1963:
----------------------------------------------------------

Commit b3489b99e9140e25bdd08b78f57ba845c3edb358 in incubator-airflow's branch refs/heads/master
from [~erod]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=b3489b9 ]

[AIRFLOW-1963] Add config for HiveOperator mapred_queue

Adding configuration setting for specifying a
default mapred_queue for
hive jobs using the HiveOperator.

Closes #2915 from edgarRd/erod-hive-mapred-queue-
config


> Allow setting a default value in configuration for the mapred_queue in the HiveOperator
> ---------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-1963
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1963
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Edgar Rodriguez
>            Assignee: Edgar Rodriguez
>
> There are some use cases where the user may need a default value for the {{mapred_queue}}
for {{HiveOperator}} in order to direct jobs to an specific queue if they don't override it
in the task parameters.
> This is particularly helpful when users have a default airflow queue provided with specific
resources to handle the load.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message