hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3025) ChecksumFileSystem needs to support the new delete method
Date Wed, 19 Mar 2008 09:40:30 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580288#action_12580288
] 

Hadoop QA commented on HADOOP-3025:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
http://issues.apache.org/jira/secure/attachment/12378157/HADOOP_3025_4.patch
against trunk revision 619744.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 4 new or modified tests.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new javac compiler warnings.

    release audit +1.  The applied patch does not generate any new release audit warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1993/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1993/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1993/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1993/console

This message is automatically generated.

> ChecksumFileSystem needs to support the new delete method
> ---------------------------------------------------------
>
>                 Key: HADOOP-3025
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3025
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.17.0
>            Reporter: Devaraj Das
>            Assignee: Mahadev konar
>            Priority: Blocker
>             Fix For: 0.17.0
>
>         Attachments: HADOOP_3025_1.patch, HADOOP_3025_2.patch, HADOOP_3025_3.patch, HADOOP_3025_4.patch
>
>
> The method FileSystem.delete(path) has been deprecated in favor of the new method delete(path,
recursive). Temporary files gets created in the MapReduce framework and when the time for
deletion comes, they are deleted via delete(path, recursive). This doesn't delete the associated
checksum files. This has a big impact when the FileSystem is the InMemoryFileSystem, where
space is at a premium and wasting space here might hurt the performance of MapReduce jobs
overall. One solution to this problem is to implement the method delete(path, recursive) in
the ChecksumFileSystem but is there is a reason why it was left out as part of HADOOP-771?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message