Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4A6EA180BF for ; Fri, 18 Dec 2015 18:35:47 +0000 (UTC) Received: (qmail 88777 invoked by uid 500); 18 Dec 2015 18:35:46 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 88400 invoked by uid 500); 18 Dec 2015 18:35:46 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 88276 invoked by uid 99); 18 Dec 2015 18:35:46 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Dec 2015 18:35:46 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id B0A182C1F6B for ; Fri, 18 Dec 2015 18:35:46 +0000 (UTC) Date: Fri, 18 Dec 2015 18:35:46 +0000 (UTC) From: "Xuefu Zhang (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-12708) Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-12708: ------------------------------- Attachment: HIVE-12708.1-spark.patch > Hive on Spark doesn't work with Kerboresed HBase [Spark Branch] > --------------------------------------------------------------- > > Key: HIVE-12708 > URL: https://issues.apache.org/jira/browse/HIVE-12708 > Project: Hive > Issue Type: Bug > Components: Spark > Affects Versions: 1.2.0, 1.1.0, 2.0.0 > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Attachments: HIVE-12708.1-spark.patch > > > Spark application launcher (spark-submit) acquires HBase delegation token on Hive user's behalf when the application is launched. This mechanism, which doesn't work for long-running sessions, is not in line with what Hive is doing. Hive actually acquires the token automatically whenever a job needs it. The right approach for Spark should be allowing applications to dynamically add whatever tokens they need to the spark context. While this needs work on Spark side, we provide a workaround solution in Hive. -- This message was sent by Atlassian JIRA (v6.3.4#6332)