hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir
Date Sat, 16 Jul 2016 19:11:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380901#comment-15380901
] 

Varun Saxena commented on MAPREDUCE-6380:
-----------------------------------------

[~lewuathe], why not simply catch FileNotFoundException in deleteOldLogDirsFrom method ?
We are calling FileSystem#listStatus on the user log directory in this method anyways. 
Is the additional call to FileSystem#listStatusIterator in run() method required ?

> AggregatedLogDeletionService will throw exception when there are some other directories
in remote-log-dir
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6380
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6380
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>            Reporter: Zhang Wei
>            Assignee: Kai Sasaki
>            Priority: Trivial
>         Attachments: MAPREDUCE-6380.01.patch, MAPREDUCE-6380.02.patch, MAPREDUCE-6380.03.patch,
MAPREDUCE-6380.04.patch, MAPREDUCE-6380.05.patch, MAPREDUCE-6380.06.patch, MAPREDUCE-6380.07.patch
>
>
> AggregatedLogDeletionService will throw FileNotFoundException when there are some extraneous
directories put in remote-log-dir. The deletion function will try to listStatus against the
"extraneous-dir + suffix"  dir.  I think it would be better  if  the function can ignore these
directories.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message