hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit
Date Fri, 26 Feb 2010 04:30:29 GMT
TrackerDistributedCacheManager can fail because the number of subdirectories reaches system
limit
-------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1538
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1538
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tasktracker
    Affects Versions: 0.22.0
            Reporter: Scott Chen
            Assignee: Scott Chen
             Fix For: 0.22.0


TrackerDistributedCacheManager deletes the cached files when the size goes up to a configured
number.
But there is no such limit for the number of subdirectories. Therefore the number of subdirectories
may grow large and exceed system limit.
This will make TT cannot create directory when getLocalCache and fails the tasks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message