spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunayan Saikia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-13478) Fetching delegation tokens for Hive fails when using proxy users
Date Mon, 15 Oct 2018 14:38:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650302#comment-16650302
] 

Sunayan Saikia commented on SPARK-13478:
----------------------------------------

[~vanzin] As we know 'spark-submit' command by itself doesn't officially allow the '\-\-proxy\-user'
and '\-\-principal/\-ketab' options to be used together. So, how this patch working?

> Fetching delegation tokens for Hive fails when using proxy users
> ----------------------------------------------------------------
>
>                 Key: SPARK-13478
>                 URL: https://issues.apache.org/jira/browse/SPARK-13478
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.6.0, 2.0.0
>            Reporter: Marcelo Vanzin
>            Assignee: Marcelo Vanzin
>            Priority: Minor
>             Fix For: 1.6.4, 2.0.0
>
>
> If you use spark-submit's proxy user support, the code that fetches delegation tokens
for the Hive Metastore fails. It seems like the Hive library tries to connect to the Metastore
as the proxy user, and it doesn't have a Kerberos TGT for that user, so it fails.
> I don't know whether the same issue exists in the HBase code, but I'll make a similar
change so that both behave similarly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message