spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrewo...@apache.org
Subject spark git commit: fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode
Date Fri, 27 Feb 2015 07:07:23 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.2 d0bf938ec -> d4ce702c4


fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode

jira case spark-6033 https://issues.apache.org/jira/browse/SPARK-6033

In standalone deploy mode, the cleanup will only remove the stopped application's directories.

The original description about the cleanup behavior is incorrect.

Author: 许鹏 <peng.xu@fraudmetrix.cn>

Closes #4803 from hseagle/spark-6033 and squashes the following commits:

927a6a0 [许鹏] fix the incorrect description about the spark.worker.cleanup in standalone
mode


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d4ce702c
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d4ce702c
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d4ce702c

Branch: refs/heads/branch-1.2
Commit: d4ce702c44665bfed0a48118eaa16126badd89c6
Parents: d0bf938
Author: 许鹏 <peng.xu@fraudmetrix.cn>
Authored: Thu Feb 26 23:05:56 2015 -0800
Committer: Andrew Or <andrew@databricks.com>
Committed: Thu Feb 26 23:07:18 2015 -0800

----------------------------------------------------------------------
 docs/spark-standalone.md | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/d4ce702c/docs/spark-standalone.md
----------------------------------------------------------------------
diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md
index 5c6084f..74d8653 100644
--- a/docs/spark-standalone.md
+++ b/docs/spark-standalone.md
@@ -222,8 +222,7 @@ SPARK_WORKER_OPTS supports the following system properties:
   <td>false</td>
   <td>
     Enable periodic cleanup of worker / application directories.  Note that this only affects
standalone
-    mode, as YARN works differently. Applications directories are cleaned up regardless of
whether
-    the application is still running.
+    mode, as YARN works differently. Only the directories of stopped applications are cleaned
up.
   </td>
 </tr>
 <tr>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message