From issues-return-4703-archive-asf-public=cust-asf.ponee.io@phoenix.apache.org Wed Feb 20 02:32:06 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 8AA0318060E for ; Wed, 20 Feb 2019 03:32:05 +0100 (CET) Received: (qmail 30811 invoked by uid 500); 20 Feb 2019 02:32:04 -0000 Mailing-List: contact issues-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list issues@phoenix.apache.org Received: (qmail 30802 invoked by uid 99); 20 Feb 2019 02:32:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Feb 2019 02:32:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 05641189E44 for ; Wed, 20 Feb 2019 02:32:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.5 X-Spam-Level: X-Spam-Status: No, score=-109.5 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id buWBFNg8Dgmm for ; Wed, 20 Feb 2019 02:32:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 2DADF60E40 for ; Wed, 20 Feb 2019 02:32:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C8521E2799 for ; Wed, 20 Feb 2019 02:32:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 25EC924518 for ; Wed, 20 Feb 2019 02:32:00 +0000 (UTC) Date: Wed, 20 Feb 2019 02:32:00 +0000 (UTC) From: "MariaCarrie (JIRA)" To: issues@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PHOENIX-5145) GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PHOENIX-5145?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D16= 772552#comment-16772552 ]=20 MariaCarrie commented on PHOENIX-5145: -------------------------------------- [~elserj]=C2=A0Hi, I rerun the program in my test environment and have uplo= aded the full log.I have seen in the log that the driver side has successfu= lly logged in and parsed out the SQL statement, but it always shows no logi= n on the excutor side. Do I need to log in with UserGroupInformation on the= excutor side? > GSSException: No valid credentials provided (Mechanism level: Failed to f= ind any Kerberos tgt)=20 > -------------------------------------------------------------------------= ---------------------- > > Key: PHOENIX-5145 > URL: https://issues.apache.org/jira/browse/PHOENIX-5145 > Project: Phoenix > Issue Type: Bug > Affects Versions: 5.0.0 > Environment: >HDP 3.0.0 > >Phoenix 5.0.0 > >HBase 2.0.0 > >Spark 2.3.1 > >Hadoop 3.0.1 > Reporter: MariaCarrie > Priority: Major > Attachments: application_1548138380177_1772.txt > > Original Estimate: 72h > Remaining Estimate: 72h > > I can successfully read the data using the local mode. Here is my code: > ^val sqlContext: SQLContext =3D missionSession.app.ss.sqlContext^ > ^System.setProperty("sun.security.krb5.debug", "true")^ > ^System.setProperty("sun.security.spnego.debug", "true")^ > ^UserGroupInformation.loginUserFromKeytab("dmp@DEVDIP.ORG", "devdmp.keyt= ab")^ > ^// Load as a DataFrame directly using a Configuration object^ > ^val df: DataFrame =3D sqlContext.phoenixTableAsDataFrame(missionSession= .config.tableName, Seq("ID"), zkUrl =3D Some(missionSession.config.zkUrl))^ > ^df.show(5)^ > But when I submit this to YARN for execution, an exception will be thrown= . The following is the exception information: > ^Tue Feb 19 13:07:53 CST 2019, RpcRetryingCaller\{globalStartTime=3D15505= 52873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to test= -dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.IO= Exception: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:53 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:53 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:54 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:54 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:55 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:07:57 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: java.io.I= OException: Can not send request because relogin is in progress.^ > ^Tue Feb 19 13:08:01 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:08:11 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:08:21 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:08:31 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:08:41 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:09:01 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:09:22 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:09:42 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:10:02 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:10:22 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:10:42 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:11:02 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:11:22 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:11:42 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:12:02 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:12:23 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:12:43 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:13:03 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:13:23 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:13:43 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:14:03 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:14:23 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:14:43 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:15:03 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:15:23 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:15:44 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:16:04 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:16:24 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^Tue Feb 19 13:16:44 CST 2019, RpcRetryingCaller\{globalStartTime=3D1550= 552873361, pause=3D100, maxAttempts=3D36}, java.io.IOException: Call to tes= t-dmp5.fengdai.org/10.200.162.26:16020 failed on local exception: javax.sec= urity.sasl.SaslException: GSS initiate failed [Caused by GSSException: No v= alid credentials provided (Mechanism level: Failed to find any Kerberos tgt= )]^ > ^at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries= (RpcRetryingCallerImpl.java:145)^ > ^at org.apache.hadoop.hbase.client.HTable.get(HTable.java:386)^ > ^at org.apache.hadoop.hbase.client.HTable.get(HTable.java:360)^ > ^at org.apache.hadoop.hbase.MetaTableAccessor.getTableState(MetaTableAcc= essor.java:1076)^ > ^at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAcces= sor.java:399)^ > ^at org.apache.hadoop.hbase.client.HBaseAdmin$6.rpcCall(HBaseAdmin.java:= 437)^ > ^at org.apache.hadoop.hbase.client.HBaseAdmin$6.rpcCall(HBaseAdmin.java:= 434)^ > ^at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingC= allable.java:58)^ > ^at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries= (RpcRetryingCallerImpl.java:107)^ > ^... 55 more^ > ^Caused by: java.io.IOException: Call to test-dmp5.fengdai.org/10.200.16= 2.26:16020 failed on local exception: javax.security.sasl.SaslException: GS= S initiate failed [Caused by GSSException: No valid credentials provided (M= echanism level: Failed to find any Kerberos tgt)]^ > ^at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:180)^ > ^at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(Abstrac= tRpcClient.java:390)^ > ^at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpc= Client.java:95)^ > ^at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClien= t.java:410)^ > ^at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClien= t.java:406)^ > ^at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)^ > ^at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)^ > ^at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTri= ggered(BufferCallBeforeInitHandler.java:92)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:329)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:315)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.fireUserEventTriggered(AbstractChannelHandlerContext.java:307)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.ChannelInboundHandlerAd= apter.userEventTriggered(ChannelInboundHandlerAdapter.java:108)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:329)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:315)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.fireUserEventTriggered(AbstractChannelHandlerContext.java:307)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.ChannelInboundHandlerAd= apter.userEventTriggered(ChannelInboundHandlerAdapter.java:108)^ > ^at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDeco= der.userEventTriggered(ByteToMessageDecoder.java:353)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:329)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:315)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.fireUserEventTriggered(AbstractChannelHandlerContext.java:307)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$= HeadContext.userEventTriggered(DefaultChannelPipeline.java:1377)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:329)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerC= ontext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:315)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.= fireUserEventTriggered(DefaultChannelPipeline.java:929)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConn= ection.java:179)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$500(NettyRpcCo= nnection.java:71)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(N= ettyRpcConnection.java:247)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListener0(DefaultPromise.java:507)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListenersNow(DefaultPromise.java:481)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListeners(DefaultPromise.java:420)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= addListener(DefaultPromise.java:163)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection.saslNegotiate(NettyRp= cConnection.java:201)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$800(NettyRpcCo= nnection.java:71)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(N= ettyRpcConnection.java:273)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(N= ettyRpcConnection.java:261)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListener0(DefaultPromise.java:507)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListeners0(DefaultPromise.java:500)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListenersNow(DefaultPromise.java:479)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= notifyListeners(DefaultPromise.java:420)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.= trySuccess(DefaultPromise.java:104)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.t= rySuccess(DefaultChannelPromise.java:82)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$= AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:306)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$= AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:341)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.proces= sSelectedKey(NioEventLoop.java:633)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.proces= sSelectedKeysOptimized(NioEventLoop.java:580)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.proces= sSelectedKeys(NioEventLoop.java:497)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(Ni= oEventLoop.java:459)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEve= ntExecutor$5.run(SingleThreadEventExecutor.java:858)^ > ^at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFa= ctory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)^ > ^... 1 more^ > ^Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caus= ed by GSSException: No valid credentials provided (Mechanism level: Failed = to find any Kerberos tgt)]^ > ^at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb= 5Client.java:211)^ > ^at org.apache.hadoop.hbase.security.AbstractHBaseSaslRpcClient.getIniti= alResponse(AbstractHBaseSaslRpcClient.java:131)^ > ^at org.apache.hadoop.hbase.security.NettyHBaseSaslRpcClientHandler$1.ru= n(NettyHBaseSaslRpcClientHandler.java:110)^ > ^at org.apache.hadoop.hbase.security.NettyHBaseSaslRpcClientHandler$1.ru= n(NettyHBaseSaslRpcClientHandler.java:106)^ > ^at java.security.AccessController.doPrivileged(Native Method)^ > ^at javax.security.auth.Subject.doAs(Subject.java:422)^ > ^at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInform= ation.java:1688)^ > ^at org.apache.hadoop.hbase.security.NettyHBaseSaslRpcClientHandler.hand= lerAdded(NettyHBaseSaslRpcClientHandler.java:106)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.= callHandlerAdded0(DefaultChannelPipeline.java:606)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.= addFirst(DefaultChannelPipeline.java:187)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.= addFirst(DefaultChannelPipeline.java:380)^ > ^at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.= addFirst(DefaultChannelPipeline.java:359)^ > ^at org.apache.hadoop.hbase.ipc.NettyRpcConnection.saslNegotiate(NettyRp= cConnection.java:200)^ > ^... 18 more^ > ^Caused by: GSSException: No valid credentials provided (Mechanism level= : Failed to find any Kerberos tgt)^ > ^at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCreden= tial.java:147)^ > ^at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5Mech= Factory.java:122)^ > ^at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechF= actory.java:187)^ > ^at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.= java:224)^ > ^at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:= 212)^ > ^at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:= 179)^ > ^at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb= 5Client.java:192)^ > ^... 30 more^=C2=A0 > The following are my submission parameters: > ^spark-submit^=C2=A0 =C2=A0 > ^--master yarn^=C2=A0 > =C2=A0^--name PHOENIX_SPARK_PLUGIN^=C2=A0 =C2=A0 > ^--deploy-mode cluster^=C2=A0 =C2=A0 > ^--keytab /tesdmp/keytabs/nnjKorRc37PPPjLf/dmp/testdmp.keytab^=C2=A0 =C2= =A0 > ^--principal dmp@TESTDIP.ORG^=C2=A0 > ^--jars /usr/hdp/3.0.0.0-1634/phoenix/phoenix-5.0.0.3.0.0.0-1634-client.j= ar^=C2=A0 =C2=A0 > ^--conf spark.yarn.maxAppAttempts=3D1^ > ^/path/phoenix-spark-plugin.jar^ > This program runs on YARN. Do I need to do something extra? Can anyone gi= ve me some advice? > =C2=A0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)