hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4990) Block placement for storage types
Date Thu, 12 Sep 2013 03:27:53 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765129#comment-13765129

Tsz Wo (Nicholas), SZE commented on HDFS-4990:

I am going to clean up the code in HDFS-5188 before adding storage type to BlockPlacementPolicy.
> Block placement for storage types
> ---------------------------------
>                 Key: HDFS-4990
>                 URL: https://issues.apache.org/jira/browse/HDFS-4990
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Suresh Srinivas
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: h4990_20130909.patch
> Currently block location for writes are made based on:
> # Datanode load (number of transceivers)
> # Space left on datanode
> # Topology
> With storage abstraction, namenode must choose a storage instead of a datanode for block
placement. It also needs to consider storage type, load on the storage etc.
> As an additional benefit, currently HDFS support heterogeneous nodes (nodes with different
number of spindles etc.) poorly. This work should help solve that issue as well.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message