spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrewo...@apache.org
Subject spark git commit: [SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document.
Date Wed, 03 Dec 2014 21:19:51 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.2 1ee65b4f9 -> 4a71e0853


[SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document.

Added descriptions about these parameters.
- spark.yarn.queue

Modified description about the defalut value of this parameter.
- spark.yarn.submit.file.replication

Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>

Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits:

ce99655 [Masayoshi TSUZUKI] better gramatically.
21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties.
88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update

(cherry picked from commit 692f49378f7d384d5c9c5ab7451a1c1e66f91c50)
Signed-off-by: Andrew Or <andrew@databricks.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4a71e085
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4a71e085
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4a71e085

Branch: refs/heads/branch-1.2
Commit: 4a71e08534b92710fd8d1eb17b077c6c7b78e55d
Parents: 1ee65b4
Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>
Authored: Wed Dec 3 13:16:24 2014 -0800
Committer: Andrew Or <andrew@databricks.com>
Committed: Wed Dec 3 13:19:48 2014 -0800

----------------------------------------------------------------------
 docs/running-on-yarn.md | 9 ++++++++-
 1 file changed, 8 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/4a71e085/docs/running-on-yarn.md
----------------------------------------------------------------------
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index a98259c..abfd716 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment
modes
 </tr>
 <tr>
   <td><code>spark.yarn.submit.file.replication</code></td>
-  <td>3</td>
+  <td>The default HDFS replication (usually 3)</td>
   <td>
     HDFS replication level for the files uploaded into HDFS for the application. These include
things like the Spark jar, the app jar, and any distributed cache files/archives.
   </td>
@@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment
modes
   </td>
 </tr>
 <tr>
+  <td><code>spark.yarn.queue</code></td>
+  <td>default</td>
+  <td>
+    The name of the YARN queue to which the application is submitted.
+  </td>
+</tr>
+<tr>
   <td><code>spark.yarn.jar</code></td>
   <td>(none)</td>
   <td>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message