hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Sasaki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir
Date Thu, 21 Jul 2016 13:08:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387643#comment-15387643
] 

Kai Sasaki commented on MAPREDUCE-6380:
---------------------------------------

[~varun_saxena] 
Sorry I overlooked the inside of {{deleteOldLogDirsFrom}}. As you said, it is not necessary
to call {{listStatus}} or {{listStatusIterator}} since it is called inside the method. Moreover
{{deleteOldLogDirsFrom}} handles {{IOException}} including {{FileNotFoundException}}, it seems
no chance to skip succeeding user log dirs.
Sorry about that and thank you so much for pointing out!


> AggregatedLogDeletionService will throw exception when there are some other directories
in remote-log-dir
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6380
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6380
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>            Reporter: Zhang Wei
>            Assignee: Kai Sasaki
>            Priority: Trivial
>         Attachments: MAPREDUCE-6380.01.patch, MAPREDUCE-6380.02.patch, MAPREDUCE-6380.03.patch,
MAPREDUCE-6380.04.patch, MAPREDUCE-6380.05.patch, MAPREDUCE-6380.06.patch, MAPREDUCE-6380.07.patch
>
>
> AggregatedLogDeletionService will throw FileNotFoundException when there are some extraneous
directories put in remote-log-dir. The deletion function will try to listStatus against the
"extraneous-dir + suffix"  dir.  I think it would be better  if  the function can ignore these
directories.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message