hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Gustavsson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4583) Resource manager should purge generic history data when using FileSystemApplicationHistoryStore
Date Wed, 13 Jan 2016 00:55:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-4583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095342#comment-15095342
] 

Johan Gustavsson commented on YARN-4583:
----------------------------------------

If FileSystemWriter is deprecated, you can go ahead and void this. I originally wrote this
patch for 2.4.1 then noticed there were no similar function in trunk so I ported it and submitted
it. I am planning on using ATS ones I upgrade to 2.7.* but haven't had time to look into the
setup yet.

> Resource manager should purge generic history data when using FileSystemApplicationHistoryStore
> -----------------------------------------------------------------------------------------------
>
>                 Key: YARN-4583
>                 URL: https://issues.apache.org/jira/browse/YARN-4583
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.4.1, 2.7.0, 2.7.1
>            Reporter: Johan Gustavsson
>         Attachments: YARN-4583.001.patch, YARN-4583.patch
>
>
> In it's current state when enabling `yarn.timeline-service.generic-application-history.enabled`
and setting `yarn.timeline-service.generic-application-history.store-class` to `org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore`
files keep building up in dir until it reaches max files for dir. There should be a way to
set the RM to purge these files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message