hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Plamen Jeliazkov (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-8921) Add an option to Balancer for specifying the k-most over-utilized DNs or all over-utilized DNs as sources.
Date Wed, 18 Oct 2017 23:27:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210274#comment-16210274
] 

Plamen Jeliazkov edited comment on HDFS-8921 at 10/18/17 11:26 PM:
-------------------------------------------------------------------

Yes, I am interested. I have a rough first patch. Would you help review it?

I can confirm it caps over-utilized sources but we should consider whether we should cap above-average
and the other possible sources as well.


was (Author: zero45):
Yes, I am interested. I have a rough first patch. Would you help review it with me?

I can confirm it caps over-utilized sources but we should consider whether we should cap above-average
and the other possible sources as well.

> Add an option to Balancer for specifying the k-most over-utilized DNs or all over-utilized
DNs as sources.
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-8921
>                 URL: https://issues.apache.org/jira/browse/HDFS-8921
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Plamen Jeliazkov
>         Attachments: HDFS-8921.patch
>
>
> Arpit suggested to add a separate option to source from the most over-utilized DataNodes
first so the administrator does not have to pass the source DNs manually; see [this comment|https://issues.apache.org/jira/browse/HDFS-8826?focusedCommentId=14700576&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14700576].
 The new option could allow specifying the k-most over-utilized DNs or all over-utilized DNs
as sources.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message