hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5575) History files deleted from the intermediate directory never get removed from the JobListCache
Date Thu, 10 Oct 2013 17:45:42 GMT
Sandy Ryza created MAPREDUCE-5575:
-------------------------------------

             Summary: History files deleted from the intermediate directory never get removed
from the JobListCache
                 Key: MAPREDUCE-5575
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5575
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver
    Affects Versions: 2.2.0
            Reporter: Sandy Ryza


The JobHistoryServer periodically scans through the intermediate directory. It adds all files
to the JobListCache. It deletes job files that are older than the max age and moves all other
files to the done directory.  Later, when files in the done directory become too old, they're
deleted from the JobListCache.  Jobs that were deleted in the intermediate directory (and
thus never moved to the done directory) end up in the JobListCache but can never be deleted
from it.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message