From issues-return-161433-archive-asf-public=cust-asf.ponee.io@hive.apache.org Wed Jun 26 11:21:02 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id DC1A218064D for ; Wed, 26 Jun 2019 13:21:01 +0200 (CEST) Received: (qmail 14174 invoked by uid 500); 26 Jun 2019 11:21:01 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 14132 invoked by uid 99); 26 Jun 2019 11:21:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Jun 2019 11:21:01 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 8F86BE2E2A for ; Wed, 26 Jun 2019 11:21:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 42D6425814 for ; Wed, 26 Jun 2019 11:21:00 +0000 (UTC) Date: Wed, 26 Jun 2019 11:21:00 +0000 (UTC) From: "Hive QA (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-21922) Allow keytabs to be reused in LLAP yarn applications through Yarn localization MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-21922?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1687= 3236#comment-16873236 ]=20 Hive QA commented on HIVE-21922: -------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0= m 0s{color} | {color:green} The patch does not contain any @author tags. {= color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 46s= {color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}= 7m 11s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1= m 46s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}= 1m 10s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 3= 3s{color} | {color:blue} common in master has 62 extant Findbugs warnings. = {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m = 2s{color} | {color:blue} ql in master has 2253 extant Findbugs warnings. {c= olor} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 4= 3s{color} | {color:blue} llap-server in master has 82 extant Findbugs warni= ngs. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1= m 26s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 28s= {color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}= 2m 10s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1= m 47s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m = 47s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}= 1m 9s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m = 0s{color} | {color:red} The patch 8 line(s) with tabs. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} = 5m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1= m 30s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green}= 0m 14s{color} | {color:green} The patch does not generate ASF License war= nings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 32m 34s{colo= r} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compi= le | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16= .43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-17748/de= v-support/hive-personality.sh | | git revision | master / 967a1cc | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-17748/yetu= s/whitespace-tabs.txt | | modules | C: common ql llap-server U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-17748/= yetus.txt | | Powered by | Apache Yetus http://yetus.apache.org | This message was automatically generated. > Allow keytabs to be reused in LLAP yarn applications through Yarn localiz= ation > -------------------------------------------------------------------------= ----- > > Key: HIVE-21922 > URL: https://issues.apache.org/jira/browse/HIVE-21922 > Project: Hive > Issue Type: New Feature > Reporter: Adam Szita > Assignee: Adam Szita > Priority: Major > Attachments: HIVE-21922.0.patch, HIVE-21922.1.patch, HIVE-21922.2= .patch > > > In secure clusters LLAP has to=C2=A0be able to reach=C2=A0keytab files fo= r kerberos login. > Currently=C2=A0_hive.llap.task.scheduler.am.registry.keytab.file_ and=C2= =A0_hive.llap.daemon.keytab.file_ configs are used to define the path of su= ch keytabs on the Tez AM and LLAP daemon side respectively. Both presume lo= cal file system paths only - hence all nodes in the LLAP cluster (even thos= e that eventually don't end up executing a daemon...) have to have Hive's k= eytab preinstalled on them. > The above=C2=A0is described by this strategy: [Pre-installed_Keytabs_for_= AM_and_containers|https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop= -yarn-site/YarnApplicationSecurity.html#Pre-installed_Keytabs_for_AM_and_co= ntainers] > Another approach can be=C2=A0[Keytabs_for_AM_and_containers_distributed_v= ia_YARN|https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site= /YarnApplicationSecurity.html#Keytabs_for_AM_and_containers_distributed_via= _YARN]=C2=A0where we rely on HDFS and Yarn resource localization, and no pr= ior keytab distribution is required. I intend to make this strategy an opti= on for Hive-LLAP in this jira. -- This message was sent by Atlassian JIRA (v7.6.3#76005)