spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ehnalis <>
Subject [GitHub] spark pull request: [SPARK-7533] [YARN] Decrease spacing between A...
Date Tue, 12 May 2015 21:04:03 GMT
Github user ehnalis commented on a diff in the pull request:
    --- Diff: docs/ ---
    @@ -74,6 +74,14 @@ Most of the configs are the same for Spark on YARN as for other deployment
         The interval in ms in which the Spark application master heartbeats into the YARN
    +    To avoid the application master to be expired by late reporting, if a higher value
is provided, the interval will be set to the half of the expiry interval in YARN's configuration
<code>( / 2)</code>.
    +  </td>
    +  <td><code>spark.yarn.scheduler.allocation.interval-ms</code></td>
    +  <td>200</td>
    +  <td>
    +    The interval in ms in which the Spark application master eagerly heartbeats to the
YARN ResourceManager on pending container allocations. It should be no larger than <code>spark.yarn.scheduler.heartbeat.interval-ms</code>.
The allocation interval will double on successive eager heartbeats if pending containers still
exist, until <code>spark.yarn.scheduler.heartbeat.interval-ms</code> reached.
    --- End diff --

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message