hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage
Date Wed, 11 Sep 2013 00:09:52 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763745#comment-13763745
] 

Junping Du commented on HDFS-5157:
----------------------------------

bq. Since #2 has a global view of the entire cluster, it seems that #2 is more powerful. One
drawback of #2 is that it may increase the load of NN. Since the number of storages is in
order of tens/hundreds of thousands. I think it should be okay.
Agree. It is more powerful and we can even take volume status into consideration in replica
choosing to achieve auto-balanced. Isn't it? Do you think we should create a separated JIRA
to handle this. If so, it should be against HDFS-2832 or trunk?
                
> Datanode should allow choosing the target storage
> -------------------------------------------------
>
>                 Key: HDFS-5157
>                 URL: https://issues.apache.org/jira/browse/HDFS-5157
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: Heterogeneous Storage (HDFS-2832)
>            Reporter: Arpit Agarwal
>            Assignee: Junping Du
>         Attachments: HDFS-5157-v1.patch, HDFS-5157-v2.patch
>
>
> Datanode should allow should choosing a target Storage or target Storage Type as a parameter
when creating a new block. Currently there are two ways in which the target volume is chosen
(via {{VolumeChoosingPolicy#chooseVolume}}.
> # AvailableSpaceVolumeChoosingPolicy
> # RoundRobinVolumeChoosingPolicy
> BlockReceiver and receiveBlock should also accept a new parameter for target storage
or storage type.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message