hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12611) Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch]
Date Sat, 16 Jan 2016 03:00:44 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102946#comment-15102946
] 

Xuefu Zhang commented on HIVE-12611:
------------------------------------

It also looks like the problem with parquet was fixed based on the result. We had to go to
the test machine to cleanup /thirdparty tarball.

> Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename
if given [Spark Branch]
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-12611
>                 URL: https://issues.apache.org/jira/browse/HIVE-12611
>             Project: Hive
>          Issue Type: Improvement
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Rui Li
>         Attachments: HIVE-12611.1-spark.patch
>
>
> Hive users sometimes specifies a job queue name for the submitted MR jobs. For spark,
the property name is spark.yarn.queue. We need to make sure that user is able to submit spark
jobs to the given queue. If user specifies the MR property, then Hive on Spark should take
that as well to make it backward compatible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message