hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prabhu Joseph (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates
Date Thu, 04 Apr 2019 18:10:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16810164#comment-16810164

Prabhu Joseph commented on YARN-9080:

[~snemeth] [~pbacsko] Have changed the logic to below way:

1. For each clusterTimeStamp directory part of ATS Done Directory 
         -> recursively check for App Log Dir using the existing cleanLogs logic and delete
older ones
         -> If there is no App Log Directory and the modificationTime of clusterTimeStamp
directory is older then delete clusterTimeStamp directory.

Have removed reference to bucket1 and bucket2.

> Bucket Directories as part of ATS done accumulates
> --------------------------------------------------
>                 Key: YARN-9080
>                 URL: https://issues.apache.org/jira/browse/YARN-9080
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Major
>         Attachments: 0001-YARN-9080.patch, 0002-YARN-9080.patch, 0003-YARN-9080.patch,
YARN-9080-004.patch, YARN-9080-005.patch, YARN-9080-006.patch, YARN-9080-007.patch
> Have observed older bucket directories cluster_timestamp, bucket1 and bucket2 as part
of ATS done accumulates. The cleanLogs part of EntityLogCleaner removes only the app directories
and not the bucket directories.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message