Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2D50918438 for ; Mon, 26 Oct 2015 20:36:09 +0000 (UTC) Received: (qmail 33585 invoked by uid 500); 26 Oct 2015 20:35:59 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 33486 invoked by uid 500); 26 Oct 2015 20:35:58 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 33476 invoked by uid 99); 26 Oct 2015 20:35:58 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Oct 2015 20:35:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 70C80180992 for ; Mon, 26 Oct 2015 20:35:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.314 X-Spam-Level: * X-Spam-Status: No, score=1.314 tagged_above=-999 required=6.31 tests=[URIBL_BLOCKED=0.001, URI_HEX=1.313] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 94VWx7mJrqTA for ; Mon, 26 Oct 2015 20:35:50 +0000 (UTC) Received: from mwork.nabble.com (mwork.nabble.com [162.253.133.43]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTP id 9962E43A12 for ; Mon, 26 Oct 2015 20:35:49 +0000 (UTC) Received: from mben.nabble.com (unknown [162.253.133.72]) by mwork.nabble.com (Postfix) with ESMTP id 9817F2C26187 for ; Mon, 26 Oct 2015 13:36:43 -0700 (PDT) Date: Mon, 26 Oct 2015 13:35:48 -0700 (MST) From: markluk To: user@spark.apache.org Message-ID: <1445891748928-25207.post@n3.nabble.com> Subject: Submitting Spark Applications - Do I need to leave ports open? MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit I want to submit interactive applications to a remote Spark cluster running in standalone mode. I understand I need to connect to master's 7077 port. It also seems like the master node need to open connections to my local machine. And the ports that it needs to open are different every time. If I have firewall enabled on my local machine, spark-submit fails since the ports it needs to open on my local machine are unreachable, so spark-submit fails to connect to the master. I was able to get it to work if i disable firewall on my local machine. But that's not a real solution. Is there some config that I'm not aware of that solves this problem? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Submitting-Spark-Applications-Do-I-need-to-leave-ports-open-tp25207.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail: user-help@spark.apache.org