spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Gummelt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos
Date Mon, 10 Apr 2017 22:42:41 GMT

    [ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963601#comment-15963601
] 

Michael Gummelt commented on SPARK-16742:
-----------------------------------------

bq. So, assuming that Mesos is configured properly, then it should be OK for Spark code to
distribute user credentials.

Right.  It's just a matter of the cluster admin syncing Mesos credentials and kerberos credentials
properly.  In summary, it's simpler in YARN because YARN is Kerberos-aware, whereas Mesos
isn't.

bq. That sounds like you might need the current code that distributes keytabs and logs in
the cluster to make even client mode work in this setup.

Since client mode requires network access to the Mesos master, we generally assume that the
user is on the same network as their datacenter, and can thus kinit against the KDC.


> Kerberos support for Spark on Mesos
> -----------------------------------
>
>                 Key: SPARK-16742
>                 URL: https://issues.apache.org/jira/browse/SPARK-16742
>             Project: Spark
>          Issue Type: New Feature
>          Components: Mesos
>            Reporter: Michael Gummelt
>
> We at Mesosphere have written Kerberos support for Spark on Mesos.  We'll be contributing
it to Apache Spark soon.
> Mesosphere design doc: https://docs.google.com/document/d/1xyzICg7SIaugCEcB4w1vBWp24UDkyJ1Pyt2jtnREFqc/edit#heading=h.tdnq7wilqrj6
> Mesosphere code: https://github.com/mesosphere/spark/commit/73ba2ab8d97510d5475ef9a48c673ce34f7173fa



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message