hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John George (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1189) Quota counts missed between clear quota and set quota
Date Mon, 28 Feb 2011 21:30:37 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000526#comment-13000526

John George commented on HDFS-1189:

Ran ant test locally (both with and without the patch). Got the same output:

    [mkdir] Created dir: /home/johngeo/hadoop/hdfs_apache/hadoop-hdfs/build-fi/test/data
    [mkdir] Created dir: /home/johngeo/hadoop/hdfs_apache/hadoop-hdfs/build-fi/test/logs
     [copy] Copying 1 file to /home/johngeo/hadoop/hdfs_apache/hadoop-hdfs/build-fi/test/extraconf
     [copy] Copying 1 file to /home/johngeo/hadoop/hdfs_apache/hadoop-hdfs/build-fi/test/extraconf
    [junit] WARNING: multiple versions of ant detected in path for junit 
    [junit]          jar:file:/hadoop/config/apache-ant-1.8.2/lib/ant.jar!/org/apache/tools/ant/Project.class
    [junit]      and jar:file:/home/johngeo/.ivy2/cache/ant/ant/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
    [junit] Running org.apache.hadoop.fs.TestFiListPath
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.445 sec
    [junit] Running org.apache.hadoop.fs.TestFiRename
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 18.176 sec
    [junit] Running org.apache.hadoop.hdfs.TestFiHFlush
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 48.84 sec
    [junit] Running org.apache.hadoop.hdfs.TestFiHftp
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 43.284 sec
    [junit] Running org.apache.hadoop.hdfs.TestFiPipelines
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 17.021 sec
    [junit] Running org.apache.hadoop.hdfs.server.datanode.TestFiDataTransferProtocol
    [junit] Tests run: 29, Failures: 0, Errors: 0, Time elapsed: 292.307 sec
    [junit] Running org.apache.hadoop.hdfs.server.datanode.TestFiDataTransferProtocol2
    [junit] Tests run: 10, Failures: 0, Errors: 0, Time elapsed: 455.929 sec
    [junit] Running org.apache.hadoop.hdfs.server.datanode.TestFiPipelineClose
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 40.212 sec




/home/johngeo/hadoop/hdfs_apache/hadoop-hdfs/build.xml:746: Tests failed!

Total time: 132 minutes 29 seconds

> Quota counts missed between clear quota and set quota
> -----------------------------------------------------
>                 Key: HDFS-1189
>                 URL: https://issues.apache.org/jira/browse/HDFS-1189
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: name-node
>    Affects Versions: 0.20.2, 0.22.0
>            Reporter: Kang Xiao
>            Assignee: John George
>              Labels: hdfs, quota
>             Fix For: 0.22.0
>         Attachments: HDFS-1189.patch, HDFS-1189.patch, HDFS-1189.patch, hdfs-1189-1.patch
> HDFS Quota counts will be missed between a clear quota operation and a set quota.
> When setting quota for a dir, the INodeDirectory will be replaced by INodeDirectoryWithQuota
and dir.isQuotaSet() becomes true. When INodeDirectoryWithQuota  is newly created, quota counting
will be performed. However, when clearing quota, the quota conf is set to -1 and dir.isQuotaSet()
becomes false while INodeDirectoryWithQuota will NOT be replaced back to INodeDirectory.
> FSDirectory.updateCount just update the quota count for inodes that isQuotaSet() is true.
So after clear quota for a dir, its quota counts will not be updated and it's reasonable.
But when re seting quota for this dir, quota counting will not be performed and some counts
will be missed.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message