hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-4989) Balancer needs to consider storage type in balancing
Date Wed, 21 Jan 2015 06:15:35 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arpit Agarwal resolved HDFS-4989.
    Resolution: Duplicate

Resolving a duplicate of HDFS-6685 since that one is fixed.

I am sorry about that [~djp]. Some of the HDFS-2832 follow-up tasks that were pushed out were
fixed as part of HDFS-6584.

> Balancer needs to consider storage type in balancing
> ----------------------------------------------------
>                 Key: HDFS-4989
>                 URL: https://issues.apache.org/jira/browse/HDFS-4989
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover, datanode, namenode
>            Reporter: Suresh Srinivas
>            Assignee: Junping Du
> Balancer needs to balance with in a storage tier. A couple of works:
> - add an option of storageType in balancer CLI to balance data on a specific storage
> - add storageType to BalancingPolicy 
> - need new API (getDatanodeReport(StorageType) peer with getDatanodeReport() before)
in ClientProtocol to get storage related info from NN so that balancer can choose storages
as <source, target> balancing pair.
> - update chooseDatanodes() algorithm to choose storages on the same DN first in setting
up <under-utilization, over-load> pairs.

This message was sent by Atlassian JIRA

View raw message