spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gaborgsomogyi <...@git.apache.org>
Subject [GitHub] spark pull request #19826: [SPARK-22428][DOC] Add spark application garbage ...
Date Tue, 28 Nov 2017 09:12:48 GMT
Github user gaborgsomogyi commented on a diff in the pull request:

    https://github.com/apache/spark/pull/19826#discussion_r153431216
  
    --- Diff: docs/configuration.md ---
    @@ -2306,6 +2306,50 @@ showDF(properties, numRows = 200, truncate = FALSE)
       </tr>
     </table>
     
    +### Spark Application Garbage Collector
    +
    +<table class="table">
    +  <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr>
    +  <tr>
    +    <td><code>spark.cleaner.periodicGC.interval</code></td>
    +    <td>30min</td>
    +    <td>
    +      Controls how often to trigger a garbage collection.
    +    </td>
    +  </tr>
    +  <tr>
    +    <td><code>spark.cleaner.referenceTracking</code></td>
    +    <td>true</td>
    +    <td>
    +      Controls whether a ContextCleaner should be created when a SparkContext initializes.
    +    </td>
    +  </tr>
    +  <tr>
    +    <td><code>spark.cleaner.referenceTracking.blocking</code></td>
    +    <td>true</td>
    +    <td>
    +      Controls whether the cleaning thread should block on cleanup tasks (other than
shuffle, which is controlled by
    +      spark.cleaner.referenceTracking.blocking.shuffle Spark property).<br><br>
    +      It is true as a workaround to <a href="https://issues.apache.org/jira/browse/SPARK-3015">
    --- End diff --
    
    Removed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message