hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9449) Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]
Date Mon, 26 Jan 2015 22:59:56 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292575#comment-14292575
] 

Xuefu Zhang commented on HIVE-9449:
-----------------------------------

[~leftylev], thanks for bringing this up. It doesn't look like so. None of the changes is
user facing.

> Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]
> ------------------------------------------------------------------------
>
>                 Key: HIVE-9449
>                 URL: https://issues.apache.org/jira/browse/HIVE-9449
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>             Fix For: spark-branch
>
>         Attachments: HIVE-9449.1-spark.patch, HIVE-9449.1-spark.patch, HIVE-9449.2-spark.patch
>
>
> We only push Spark configuration and RSC configuration to Spark while launch Spark cluster
now, for Spark on YARN mode, Spark need extra YARN configuration to launch Spark cluster.
Besides this, to support dynamically configuration setting for RSC configuration/YARN configuration,
we need to recreate SparkSession while RSC configuration/YARN configuration update as well,
as they may influence the Spark cluster deployment as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message