hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks
Date Mon, 02 Mar 2015 19:22:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343610#comment-14343610
] 

Jing Zhao commented on HDFS-7826:
---------------------------------

So I think we may need to update several places for quota and file size computation:
# {{computeFileSize(boolean, boolean)}} currently only takes into account the contiguous block
for the last block. Similar for {{storagespaceConsumedNoReplication}}. We should also consider
the BlockInfoStripedUC in these places.
{code}
    if (blocks[last] instanceof BlockInfoContiguousUnderConstruction) {
       if (!includesLastUcBlock) {
         size = 0;
       } else if (usePreferredBlockSize4LastUcBlock) {
         size = getPreferredBlockSize();
       }
    }
{code} 
# The {{storagespaceConsumed}} method also only works for contiguous blocks since it uses
{{getBlockReplication}}

> Erasure Coding: Update INodeFile quota computation for striped blocks
> ---------------------------------------------------------------------
>
>                 Key: HDFS-7826
>                 URL: https://issues.apache.org/jira/browse/HDFS-7826
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Kai Sasaki
>
> Currently INodeFile's quota computation only considers contiguous blocks (i.e., {{INodeFile#blocks}}).
We need to update it to support striped blocks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message