Return-Path: X-Original-To: apmail-spark-commits-archive@minotaur.apache.org Delivered-To: apmail-spark-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2422A107F8 for ; Wed, 3 Dec 2014 21:19:52 +0000 (UTC) Received: (qmail 29411 invoked by uid 500); 3 Dec 2014 21:19:52 -0000 Delivered-To: apmail-spark-commits-archive@spark.apache.org Received: (qmail 29383 invoked by uid 500); 3 Dec 2014 21:19:51 -0000 Mailing-List: contact commits-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list commits@spark.apache.org Received: (qmail 29374 invoked by uid 99); 3 Dec 2014 21:19:51 -0000 Received: from tyr.zones.apache.org (HELO tyr.zones.apache.org) (140.211.11.114) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Dec 2014 21:19:51 +0000 Received: by tyr.zones.apache.org (Postfix, from userid 65534) id AB48A9BD8CB; Wed, 3 Dec 2014 21:19:51 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: andrewor14@apache.org To: commits@spark.apache.org Message-Id: <6883fe3bd87941b0852c04f0f96229ab@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: spark git commit: [SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document. Date: Wed, 3 Dec 2014 21:19:51 +0000 (UTC) Repository: spark Updated Branches: refs/heads/branch-1.2 1ee65b4f9 -> 4a71e0853 [SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document. Added descriptions about these parameters. - spark.yarn.queue Modified description about the defalut value of this parameter. - spark.yarn.submit.file.replication Author: Masayoshi TSUZUKI Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits: ce99655 [Masayoshi TSUZUKI] better gramatically. 21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties. 88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update (cherry picked from commit 692f49378f7d384d5c9c5ab7451a1c1e66f91c50) Signed-off-by: Andrew Or Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4a71e085 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4a71e085 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4a71e085 Branch: refs/heads/branch-1.2 Commit: 4a71e08534b92710fd8d1eb17b077c6c7b78e55d Parents: 1ee65b4 Author: Masayoshi TSUZUKI Authored: Wed Dec 3 13:16:24 2014 -0800 Committer: Andrew Or Committed: Wed Dec 3 13:19:48 2014 -0800 ---------------------------------------------------------------------- docs/running-on-yarn.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/4a71e085/docs/running-on-yarn.md ---------------------------------------------------------------------- diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index a98259c..abfd716 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes spark.yarn.submit.file.replication - 3 + The default HDFS replication (usually 3) HDFS replication level for the files uploaded into HDFS for the application. These include things like the Spark jar, the app jar, and any distributed cache files/archives. @@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes + spark.yarn.queue + default + + The name of the YARN queue to which the application is submitted. + + + spark.yarn.jar (none) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org For additional commands, e-mail: commits-help@spark.apache.org