hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhouyingchao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks
Date Mon, 02 Mar 2015 13:01:05 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

zhouyingchao updated HDFS-7868:
    Attachment: HDFS-7868-001.patch

> Use proper blocksize to choose target for blocks
> ------------------------------------------------
>                 Key: HDFS-7868
>                 URL: https://issues.apache.org/jira/browse/HDFS-7868
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: zhouyingchao
>            Assignee: zhouyingchao
>         Attachments: HDFS-7868-001.patch
> In BlockPlacementPolicyDefault.java:isGoodTarget, the passed-in blockSize is used to
determine if there is enough room for a new block on a data node. However, in two conditions
the blockSize might not be proper for the purpose: (a) the passed in block size is just the
size of the last block of a file, which might be very small (for e.g., called from BlockManager.ReplicationWork.chooseTargets).
(b) A file which might be created with a smaller blocksize.
> In these conditions, the calculated scheduledSize might be smaller than the actual value,
which finally might lead to following failure of writing or replication.

This message was sent by Atlassian JIRA

View raw message