hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhouyingchao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7868) Use proper blocksize to choose target for blocks
Date Mon, 02 Mar 2015 12:56:05 GMT
zhouyingchao created HDFS-7868:

             Summary: Use proper blocksize to choose target for blocks
                 Key: HDFS-7868
                 URL: https://issues.apache.org/jira/browse/HDFS-7868
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: zhouyingchao
            Assignee: zhouyingchao

In BlockPlacementPolicyDefault.java:isGoodTarget, the passed-in blockSize is used to determine
if there is enough room for a new block on a data node. However, in two conditions the blockSize
might not be proper for the purpose: (a) the passed in block size is just the size of the
last block of a file, which might be very small (for e.g., called from BlockManager.ReplicationWork.chooseTargets).
(b) A file which might be created with a smaller blocksize.
In these conditions, the calculated scheduledSize might be smaller than the actual value,
which finally might lead to following failure of writing or replication.

This message was sent by Atlassian JIRA

View raw message