hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Niranjan Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5575) History files deleted from the intermediate directory never get removed from the JobListCache
Date Thu, 10 Oct 2013 18:45:42 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791832#comment-13791832
] 

Niranjan Singh commented on MAPREDUCE-5575:
-------------------------------------------

Sandy are you working on this if not I will take it up.

> History files deleted from the intermediate directory never get removed from the JobListCache
> ---------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5575
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5575
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>    Affects Versions: 2.2.0
>            Reporter: Sandy Ryza
>
> The JobHistoryServer periodically scans through the intermediate directory. It adds all
files to the JobListCache. It deletes job files that are older than the max age and moves
all other files to the done directory.  Later, when files in the done directory become too
old, they're deleted from the JobListCache.  Jobs that were deleted in the intermediate directory
(and thus never moved to the done directory) end up in the JobListCache but can never be deleted
from it.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message