spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vanzin <>
Subject [GitHub] spark pull request: [SPARK-3562]Periodic cleanup event logs
Date Tue, 23 Sep 2014 22:29:15 GMT
Github user vanzin commented on a diff in the pull request:
    --- Diff: docs/ ---
    @@ -135,6 +135,29 @@ follows:
           <code>spark.ui.view.acls</code> when the application was run will also
have authorization
           to view that application. 
           If disabled, no access control checks are made. 
    +    </td>  
    +  </tr>   
    +  <tr>
    +    <td>spark.history.fs.cleaner.enable</td>
    +    <td>false</td>
    +    <td>
    +      Specifies whether job history cleaner should check for files to delete.
    +    </td>
    +  </tr>
    +  <tr>
    +    <td>spark.history.fs.cleaner.interval-s</td>
    +    <td>86400</td>
    +    <td>
    +      How often the job history cleaner checks for files to delete, in seconds. Defaults
to 864000 (one day).
    --- End diff --
    Hmmm. Wonder if we should add a version of `Utils.memoryStringToMb` for time (so that
you could write `1d` instead of that big number).

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message