hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]
Date Fri, 18 Dec 2015 22:19:46 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064865#comment-15064865
] 

Szehon Ho commented on HIVE-12708:
----------------------------------

+1 lgtm.  One question about the log message, I might be not understanding it, but are these
properties from hbase configuration file instead of hive configuration?

> Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]
> ---------------------------------------------------------------
>
>                 Key: HIVE-12708
>                 URL: https://issues.apache.org/jira/browse/HIVE-12708
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: 1.2.0, 1.1.0, 2.0.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>         Attachments: HIVE-12708.1-spark.patch
>
>
> Spark application launcher (spark-submit) acquires HBase delegation token on Hive user's
behalf when the application is launched. This mechanism, which doesn't work for long-running
sessions, is not in line with what Hive is doing. Hive actually acquires the token automatically
whenever a job needs it. The right approach for Spark should be allowing applications to dynamically
add whatever tokens they need to the spark context. While this needs work on Spark side, we
provide a workaround solution in Hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message