hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-7045) TestDU fails on systems with local file systems with extended attributes
Date Fri, 19 Nov 2010 03:42:14 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eli Collins updated HADOOP-7045:
--------------------------------

    Attachment: hadoop-7045-1.patch

Patch attached. Modifies the test to pass if the disk usage is greater than the written size,
but no greater than a given amount of slack (4k).  The test now passes on local ext3 file
systems with extended attributes.

> TestDU fails on systems with local file systems with extended attributes
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-7045
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7045
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: hadoop-7045-1.patch
>
>
> The test reports that the file takes an extra 4k on disk:
> {noformat}
> Testcase: testDU took 5.74 sec
>         FAILED
> expected:<32768> but was:<36864>
> junit.framework.AssertionFailedError: expected:<32768> but was:<36864>
>         at org.apache.hadoop.fs.TestDU.testDU(TestDU.java:79)
> {noformat}
> This is because du reports 32k for the file and 4k because the file system it lives on
uses extended attributes.
> {noformat}
> common-branch-0.20 $ dd if=/dev/zero of=data bs=4096 count=8
> 8+0 records in
> 8+0 records out
> 32768 bytes (33 kB) copied, 9.6e-05 seconds, 341 MB/s
> common-branch-0.20 $ du data
> 36	data
> common-branch-0.20 $ du --apparent-size data
> 32	data
> {noformat}
> We should modify the test to allow for some extra on-disk slack. The on-disk usage could
also be smaller if the file data is all zeros or compression is enabled. The test currently
handles the former by writing random data, we're punting on the latter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message