spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: [SPARK-22133][DOCS] Documentation for Mesos Reject Offer Configurations
Date Wed, 08 Nov 2017 17:55:26 GMT
Repository: spark
Updated Branches:
  refs/heads/master 87343e155 -> 6447d7bc1


[SPARK-22133][DOCS] Documentation for Mesos Reject Offer Configurations

## What changes were proposed in this pull request?
Documentation about Mesos Reject Offer Configurations

## Related PR
https://github.com/apache/spark/pull/19510 for `spark.mem.max`

Author: Li, YanKit | Wilson | RIT <yankit.li@rakuten.com>

Closes #19555 from windkit/spark_22133.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6447d7bc
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6447d7bc
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6447d7bc

Branch: refs/heads/master
Commit: 6447d7bc1de4ab1d99a8dfcd3fea07f5a2da363d
Parents: 87343e1
Author: Li, YanKit | Wilson | RIT <yankit.li@rakuten.com>
Authored: Wed Nov 8 17:55:21 2017 +0000
Committer: Sean Owen <sowen@cloudera.com>
Committed: Wed Nov 8 17:55:21 2017 +0000

----------------------------------------------------------------------
 docs/running-on-mesos.md | 26 +++++++++++++++++++++++++-
 1 file changed, 25 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/6447d7bc/docs/running-on-mesos.md
----------------------------------------------------------------------
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md
index b7e3e64..7a443ff 100644
--- a/docs/running-on-mesos.md
+++ b/docs/running-on-mesos.md
@@ -203,7 +203,7 @@ details and default values.
 
 Executors are brought up eagerly when the application starts, until
 `spark.cores.max` is reached.  If you don't set `spark.cores.max`, the
-Spark application will reserve all resources offered to it by Mesos,
+Spark application will consume all resources offered to it by Mesos,
 so we of course urge you to set this variable in any sort of
 multi-tenant cluster, including one which runs multiple concurrent
 Spark applications.
@@ -680,6 +680,30 @@ See the [configuration page](configuration.html) for information on Spark
config
     driver disconnects, the master immediately tears down the framework.
   </td>
 </tr>
+<tr>
+  <td><code>spark.mesos.rejectOfferDuration</code></td>
+  <td><code>120s</code></td>
+  <td>
+    Time to consider unused resources refused, serves as a fallback of
+    `spark.mesos.rejectOfferDurationForUnmetConstraints`,
+    `spark.mesos.rejectOfferDurationForReachedMaxCores`
+  </td>
+</tr>
+<tr>
+  <td><code>spark.mesos.rejectOfferDurationForUnmetConstraints</code></td>
+  <td><code>spark.mesos.rejectOfferDuration</code></td>
+  <td>
+    Time to consider unused resources refused with unmet constraints
+  </td>
+</tr>
+<tr>
+  <td><code>spark.mesos.rejectOfferDurationForReachedMaxCores</code></td>
+  <td><code>spark.mesos.rejectOfferDuration</code></td>
+  <td>
+    Time to consider unused resources refused when maximum number of cores
+    <code>spark.cores.max</code> is reached
+  </td>
+</tr>
 </table>
 
 # Troubleshooting and Debugging


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message