hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3025) ChecksumFileSystem needs to support the new delete method
Date Sun, 16 Mar 2008 13:40:24 GMT
ChecksumFileSystem needs to support the new delete method

                 Key: HADOOP-3025
                 URL: https://issues.apache.org/jira/browse/HADOOP-3025
             Project: Hadoop Core
          Issue Type: Bug
          Components: fs
    Affects Versions: 0.17.0
            Reporter: Devaraj Das
            Assignee: dhruba borthakur
            Priority: Blocker
             Fix For: 0.17.0

The method FileSystem.delete(path) has been deprecated in favor of the new method delete(path,
recursive). Temporary files gets created in the MapReduce framework and when the time for
deletion comes, they are deleted via delete(path, recursive). This doesn't delete the associated
checksum files. This has a big impact when the FileSystem is the InMemoryFileSystem, where
space is at a premium and wasting space here might hurt the performance of MapReduce jobs
overall. One solution to this problem is to implement the method delete(path, recursive) in
the ChecksumFileSystem but is there is a reason why it was left out as part of HADOOP-771?

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message