spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-26929) table owner should use user instead of principal when use kerberos
Date Mon, 16 Sep 2019 18:09:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcelo Vanzin resolved SPARK-26929.
------------------------------------
    Fix Version/s: 3.0.0
       Resolution: Fixed

Issue resolved by pull request 23952
[https://github.com/apache/spark/pull/23952]

> table owner should use user instead of principal when use kerberos
> ------------------------------------------------------------------
>
>                 Key: SPARK-26929
>                 URL: https://issues.apache.org/jira/browse/SPARK-26929
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.4.0
>            Reporter: hong dongdong
>            Assignee: hong dongdong
>            Priority: Major
>             Fix For: 3.0.0
>
>
> In kerberos cluster, when use spark-sql or beeline to create table,  the owner will
be whole info of principal. the _issue_  was fixed in SPARK-19970 and modify by SPARK-22846,
so it occur again. It will causes some problems when using role., and this time should resolved
two issues together.
> Use  org.apache.hadoop.hive.shims.Utils.getUGI  directly to get ugi.getShortUserName
> instead of use  conf.getUser which return principal info.
> Code change
> {code:java}
> private val userName: String = try {
> val ugi = HiveUtils.getUGI
> ugi.getShortUserName
> } catch {
> case e: LoginException => throw new IOException(e)
> }
> {code}
> Berfore
> {code}
> scala> sql("create table t(a int)").show
>  scala> sql("desc formatted t").show(false)
>  ...
> |Owner:|spark@EXAMPLE.COM| |
> {code}
> After:
> {code}
>  scala> sql("create table t(a int)").show
>  scala> sql("desc formatted t").show(false)
>  ...
> |Owner:|spark| |
> {code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message