spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From joshro...@apache.org
Subject spark git commit: [SPARK-4931][Yarn][Docs] Fix the format of running-on-yarn.md
Date Tue, 23 Dec 2014 19:19:41 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.2 f86fe0897 -> 9fb86b80a


[SPARK-4931][Yarn][Docs] Fix the format of running-on-yarn.md

Currently, the format about log4j in running-on-yarn.md is a bit messy.

![running-on-yarn](https://cloud.githubusercontent.com/assets/1000778/5535248/204c4b64-8ab4-11e4-83c3-b4722ea0ad9d.png)

Author: zsxwing <zsxwing@gmail.com>

Closes #3774 from zsxwing/SPARK-4931 and squashes the following commits:

4a5f853 [zsxwing] Fix the format of running-on-yarn.md

(cherry picked from commit 2d215aebaad4b4596354f1543d997d06ef340bd5)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9fb86b80
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9fb86b80
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/9fb86b80

Branch: refs/heads/branch-1.2
Commit: 9fb86b80a20807a0c797050aebb098f94a12e5ea
Parents: f86fe08
Author: zsxwing <zsxwing@gmail.com>
Authored: Tue Dec 23 11:18:06 2014 -0800
Committer: Josh Rosen <joshrosen@databricks.com>
Committed: Tue Dec 23 11:19:35 2014 -0800

----------------------------------------------------------------------
 docs/running-on-yarn.md | 10 +++++-----
 1 file changed, 5 insertions(+), 5 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/9fb86b80/docs/running-on-yarn.md
----------------------------------------------------------------------
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 0b5ce5e..d5af816 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -201,18 +201,18 @@ settings and a restart of all node managers. Thus, this is not applicable
to hos
 
 To use a custom log4j configuration for the application master or executors, there are two
options:
 
-- upload a custom log4j.properties using spark-submit, by adding it to the "--files" list
of files
+- upload a custom `log4j.properties` using `spark-submit`, by adding it to the `--files`
list of files
   to be uploaded with the application.
-- add "-Dlog4j.configuration=<location of configuration file>" to "spark.driver.extraJavaOptions"
-  (for the driver) or "spark.executor.extraJavaOptions" (for executors). Note that if using
a file,
-  the "file:" protocol should be explicitly provided, and the file needs to exist locally
on all
+- add `-Dlog4j.configuration=<location of configuration file>` to `spark.driver.extraJavaOptions`
+  (for the driver) or `spark.executor.extraJavaOptions` (for executors). Note that if using
a file,
+  the `file:` protocol should be explicitly provided, and the file needs to exist locally
on all
   the nodes.
 
 Note that for the first option, both executors and the application master will share the
same
 log4j configuration, which may cause issues when they run on the same node (e.g. trying to
write
 to the same log file).
 
-If you need a reference to the proper location to put log files in the YARN so that YARN
can properly display and aggregate them, use "${spark.yarn.app.container.log.dir}" in your
log4j.properties. For example, log4j.appender.file_appender.File=${spark.yarn.app.container.log.dir}/spark.log.
For streaming application, configuring RollingFileAppender and setting file location to YARN's
log directory will avoid disk overflow caused by large log file, and logs can be accessed
using YARN's log utility.
+If you need a reference to the proper location to put log files in the YARN so that YARN
can properly display and aggregate them, use `spark.yarn.app.container.log.dir` in your log4j.properties.
For example, `log4j.appender.file_appender.File=${spark.yarn.app.container.log.dir}/spark.log`.
For streaming application, configuring `RollingFileAppender` and setting file location to
YARN's log directory will avoid disk overflow caused by large log file, and logs can be accessed
using YARN's log utility.
 
 # Important notes
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message