hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-7045) TestDU fails on systems with local file systems with extended attributes
Date Fri, 19 Nov 2010 03:26:14 GMT
TestDU fails on systems with local file systems with extended attributes
------------------------------------------------------------------------

                 Key: HADOOP-7045
                 URL: https://issues.apache.org/jira/browse/HADOOP-7045
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs
            Reporter: Eli Collins
            Assignee: Eli Collins
            Priority: Minor
             Fix For: 0.23.0


The test reports that the file takes an extra 4k on disk:

{noformat}
Testcase: testDU took 5.74 sec
        FAILED
expected:<32768> but was:<36864>
junit.framework.AssertionFailedError: expected:<32768> but was:<36864>
        at org.apache.hadoop.fs.TestDU.testDU(TestDU.java:79)
{noformat}

This is because du reports 32k for the file and 4k because the file system it lives on uses
extended attributes.

{noformat}
common-branch-0.20 $ dd if=/dev/zero of=data bs=4096 count=8
8+0 records in
8+0 records out
32768 bytes (33 kB) copied, 9.6e-05 seconds, 341 MB/s
common-branch-0.20 $ du data
36	data
common-branch-0.20 $ du --apparent-size data
32	data
{noformat}

We should modify the test to allow for some extra on-disk slack. The on-disk usage could also
be smaller if the file data is all zeros or compression is enabled. The test currently handles
the former by writing random data, we're punting on the latter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message