spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: [SPARK-17449][DOCUMENTATION] Relation between heartbeatInterval and…
Date Wed, 14 Sep 2016 08:03:19 GMT
Repository: spark
Updated Branches:
  refs/heads/master a454a4d86 -> def7c265f


[SPARK-17449][DOCUMENTATION] Relation between heartbeatInterval and…

## What changes were proposed in this pull request?

The relation between spark.network.timeout and spark.executor.heartbeatInterval should be
mentioned in the document.

… network timeout]

Author: Jagadeesan <as2@us.ibm.com>

Closes #15042 from jagadeesanas2/SPARK-17449.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/def7c265
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/def7c265
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/def7c265

Branch: refs/heads/master
Commit: def7c265f539f3e119f068b6e9050300d05b14a4
Parents: a454a4d
Author: Jagadeesan <as2@us.ibm.com>
Authored: Wed Sep 14 09:03:16 2016 +0100
Committer: Sean Owen <sowen@cloudera.com>
Committed: Wed Sep 14 09:03:16 2016 +0100

----------------------------------------------------------------------
 core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala | 1 +
 docs/configuration.md                                        | 3 ++-
 2 files changed, 3 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/def7c265/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala b/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
index c3764ac..5242ab6 100644
--- a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
+++ b/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
@@ -32,6 +32,7 @@ import org.apache.spark.util._
  * A heartbeat from executors to the driver. This is a shared message used by several internal
  * components to convey liveness or execution information for in-progress tasks. It will
also
  * expire the hosts that have not heartbeated for more than spark.network.timeout.
+ * spark.executor.heartbeatInterval should be significantly less than spark.network.timeout.
  */
 private[spark] case class Heartbeat(
     executorId: String,

http://git-wip-us.apache.org/repos/asf/spark/blob/def7c265/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index ebd0aa7..8aea745 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -987,7 +987,8 @@ Apart from these, the following properties are also available, and may
be useful
     <td>10s</td>
     <td>Interval between each executor's heartbeats to the driver.  Heartbeats let
     the driver know that the executor is still alive and update it with metrics for in-progress
-    tasks.</td>
+    tasks. spark.executor.heartbeatInterval should be significantly less than
+    spark.network.timeout</td>
 </tr>
 <tr>
   <td><code>spark.files.fetchTimeout</code></td>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message