Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EEF0118E8B for ; Fri, 18 Dec 2015 22:19:46 +0000 (UTC) Received: (qmail 67530 invoked by uid 500); 18 Dec 2015 22:19:46 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 67500 invoked by uid 500); 18 Dec 2015 22:19:46 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 67479 invoked by uid 99); 18 Dec 2015 22:19:46 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Dec 2015 22:19:46 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id AC0D92C1F56 for ; Fri, 18 Dec 2015 22:19:46 +0000 (UTC) Date: Fri, 18 Dec 2015 22:19:46 +0000 (UTC) From: "Szehon Ho (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064865#comment-15064865 ] Szehon Ho commented on HIVE-12708: ---------------------------------- +1 lgtm. One question about the log message, I might be not understanding it, but are these properties from hbase configuration file instead of hive configuration? > Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] > --------------------------------------------------------------- > > Key: HIVE-12708 > URL: https://issues.apache.org/jira/browse/HIVE-12708 > Project: Hive > Issue Type: Bug > Components: Spark > Affects Versions: 1.2.0, 1.1.0, 2.0.0 > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Attachments: HIVE-12708.1-spark.patch > > > Spark application launcher (spark-submit) acquires HBase delegation token on Hive user's behalf when the application is launched. This mechanism, which doesn't work for long-running sessions, is not in line with what Hive is doing. Hive actually acquires the token automatically whenever a job needs it. The right approach for Spark should be allowing applications to dynamically add whatever tokens they need to the spark context. While this needs work on Spark side, we provide a workaround solution in Hive. -- This message was sent by Atlassian JIRA (v6.3.4#6332)