spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode
Date Fri, 27 Feb 2015 07:07:23 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-1.2 d0bf938ec -> d4ce702c4

fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode

jira case spark-6033

In standalone deploy mode, the cleanup will only remove the stopped application's directories.

The original description about the cleanup behavior is incorrect.

Author: 许鹏 <>

Closes #4803 from hseagle/spark-6033 and squashes the following commits:

927a6a0 [许鹏] fix the incorrect description about the spark.worker.cleanup in standalone


Branch: refs/heads/branch-1.2
Commit: d4ce702c44665bfed0a48118eaa16126badd89c6
Parents: d0bf938
Author: 许鹏 <>
Authored: Thu Feb 26 23:05:56 2015 -0800
Committer: Andrew Or <>
Committed: Thu Feb 26 23:07:18 2015 -0800

 docs/ | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/docs/ b/docs/
index 5c6084f..74d8653 100644
--- a/docs/
+++ b/docs/
@@ -222,8 +222,7 @@ SPARK_WORKER_OPTS supports the following system properties:
     Enable periodic cleanup of worker / application directories.  Note that this only affects
-    mode, as YARN works differently. Applications directories are cleaned up regardless of
-    the application is still running.
+    mode, as YARN works differently. Only the directories of stopped applications are cleaned

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message