spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mccheah <...@git.apache.org>
Subject [GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.
Date Wed, 18 Jul 2018 18:17:28 GMT
Github user mccheah commented on the issue:

    https://github.com/apache/spark/pull/21748
  
    > agreed with @echarles that it would be great if the submission client will still
create a headless service for the driver if the driver is running in a pod in client mode.
    
    The goal of this approach that specifically does not create a headless service is so that
the client mode implementation here is identical to the client mode implementation of the
other cluster managers. That is to say, the other cluster managers for client mode don't make
any assumptions about connectivity, nor do they set up their own networking layers. Therefore
I think it's appropriate here to avoid the extra complexity.
    
    > my pod has access to my host, so there is nothing to do on network level. In other
words, which are the steps to make this PR work in client mode for Out-Cluster (assuming the
network connectivity is OK)?
    
    Can you share on how you know that your executor pod has access to your host set by `spark.driver.host`
and `spark.driver.port` over the network?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message