hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4289) FsDatasetImpl#updateReplicaUnderRecovery throws errors validating replica byte count on Windows
Date Fri, 07 Dec 2012 21:47:22 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526804#comment-13526804
] 

Chris Nauroth commented on HDFS-4289:
-------------------------------------

This was discovered while researching HDFS-4261.  All subsequent notes assume that HDFS-4261
has been fixed first.

Running {{TestBalancerWithNodeGroup#testBalancerWithRackLocality}} shows this in the output:

{code}
java.io.IOException: THIS IS NOT SUPPOSED TO HAPPEN: replica.getBytesOnDisk() !=
 block.getNumBytes(), block=BP-TEST:blk_1000_2000, replica=ReplicaUnderRecovery,
 blk_1000_2000, RUR
{code}

That log message came from this check in {{FsDatasetImpl#updateReplicaUnderRecovery}}:

{code}
    //check replica's byte on disk
    if (replica.getBytesOnDisk() != oldBlock.getNumBytes()) {
      throw new IOException("THIS IS NOT SUPPOSED TO HAPPEN:"
          + " replica.getBytesOnDisk() != block.getNumBytes(), block="
          + oldBlock + ", replica=" + replica);
    }
{code}

This is causing the current {{Balancer}} iteration to move 0 bytes.  Then, the {{Balancer}}
logic returns {{NO_MOVE_PROGRESS}} after exceeding the maximum iterations.

                
> FsDatasetImpl#updateReplicaUnderRecovery throws errors validating replica byte count
on Windows
> -----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-4289
>                 URL: https://issues.apache.org/jira/browse/HDFS-4289
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: trunk-win
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>
> {{FsDatasetImpl#updateReplicaUnderRecovery}} throws errors validating replica byte count
on Windows.  This can be seen by running {{TestBalancerWithNodeGroup#testBalancerWithRackLocality}},
which fails on Windows.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message