spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-11857][MESOS] Deprecate fine grained
Date Sat, 09 Jul 2016 03:20:41 GMT
Repository: spark
Updated Branches:
  refs/heads/master d8b06f18d -> b1db26acc

[SPARK-11857][MESOS] Deprecate fine grained

## What changes were proposed in this pull request?

Documentation changes to indicate that fine-grained mode is now deprecated.  No code changes
were made, and all fine-grained mode instructions were left in place.  We can remove all of
that once the deprecation cycle completes (Does Spark have a standard deprecation cycle? 
One major version?)

Blocked on

## How was this patch tested?

Viewed in Github

Author: Michael Gummelt <>

Closes #14078 from mgummelt/deprecate-fine-grained.


Branch: refs/heads/master
Commit: b1db26acc51003e68e4e8d7d324cf74e3aa03cfd
Parents: d8b06f1
Author: Michael Gummelt <>
Authored: Fri Jul 8 20:20:26 2016 -0700
Committer: Reynold Xin <>
Committed: Fri Jul 8 20:20:26 2016 -0700

 docs/ | 9 +++++++--
 1 file changed, 7 insertions(+), 2 deletions(-)
diff --git a/docs/ b/docs/
index 8ab5f30..5219e99 100644
--- a/docs/
+++ b/docs/
@@ -181,7 +181,7 @@ Note that jars or python files that are passed to spark-submit should
be URIs re
 # Mesos Run Modes
 Spark can run over Mesos in two modes: "coarse-grained" (default) and
+"fine-grained" (deprecated).
 ## Coarse-Grained
@@ -213,7 +213,12 @@ the application.  To configure your job to dynamically adjust to its
 resource requirements, look into
 [Dynamic Allocation](#dynamic-resource-allocation-with-mesos).
-## Fine-Grained
+## Fine-Grained (deprecated)
+**NOTE:** Fine-grained mode is deprecated as of Spark 2.0.0.  Consider
+ using [Dynamic Allocation](#dynamic-resource-allocation-with-mesos)
+ for some of the benefits.  For a full explanation see
+ [SPARK-11857](
 In "fine-grained" mode, each Spark task inside the Spark executor runs
 as a separate Mesos task. This allows multiple instances of Spark (and

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message