hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]
Date Fri, 18 Dec 2015 18:02:46 GMT
Xuefu Zhang created HIVE-12708:
----------------------------------

             Summary: Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]
                 Key: HIVE-12708
                 URL: https://issues.apache.org/jira/browse/HIVE-12708
             Project: Hive
          Issue Type: Bug
          Components: Spark
    Affects Versions: 1.1.0, 1.2.0, 2.0.0
            Reporter: Xuefu Zhang
            Assignee: Xuefu Zhang


Spark application launcher (spark-submit) acquires HBase delegation token on Hive user's behalf
when the application is launched. This mechanism, which doesn't work for long-running sessions,
is not in line with what Hive is doing. Hive actually acquires the token automatically whenever
a job needs it. The right approach for Spark should be allowing applications to dynamically
add whatever tokens they need to the spark context. While this needs work on Spark side, we
provide a workaround solution in Hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message