hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space
Date Tue, 05 Apr 2011 15:22:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015956#comment-13015956
] 

Todd Lipcon commented on HDFS-1804:
-----------------------------------

One way might be to simply choose each disk with probability relative to the amount of available
space on it. So, if one disk has 2T free and another has 1T free, choose the 2T drive 2/3
of the time. Only downside is that, if two disks have an equal amount of free space, it would
be better to degenerate to round-robin rather than random selection.

> Modify or add a new block-volume device choosing policy that looks at free space
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-1804
>                 URL: https://issues.apache.org/jira/browse/HDFS-1804
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: data-node
>            Reporter: Harsh J Chouraria
>            Priority: Minor
>             Fix For: 0.23.0
>
>
> HDFS-1120 introduced pluggable block-volume choosing policies, but still carries the
vanilla RoundRobin as its default.
> An additional implementation that also takes into consideration the free space remaining
on the disk (or other params) should be a good addition as an alternative to vanilla RR.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message