spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjia Wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-3512) yarn-client through socks proxy
Date Fri, 12 Sep 2014 16:43:33 GMT
Yongjia Wang created SPARK-3512:
-----------------------------------

             Summary: yarn-client through socks proxy
                 Key: SPARK-3512
                 URL: https://issues.apache.org/jira/browse/SPARK-3512
             Project: Spark
          Issue Type: Wish
          Components: YARN
            Reporter: Yongjia Wang


I believe this would be a common scenario that the yarn cluster runs behind a firewall, while
people want to run spark driver locally for best interactivity experience. For example, using
ipython notebook, or more fancy IDEs, etc. A potential solution is to setup socks proxy on
the local machine outside of the firewall through shh tunneling into some work station inside
the firewall. Then the client only needs to talk through this proxy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message