hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Tianyi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance
Date Fri, 02 Oct 2015 15:29:26 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941264#comment-14941264

He Tianyi commented on HDFS-9149:

Thanks, [~hexiaoqiao].

The simpler idea sounds good! But I'm not quite sure adding one if statement could cover all
We'll need to assume that grandparent represents a IDC node if we go with it, which does not
always hold (since {{NetworkTopology}} did not imply that). e.g. I have a real scenario that
location are configured like {{/DC/BUILDING/RACK/NODE}}. In this case, it is true that locality
will happen to be better, but perhaps not better enough.

> Consider multi datacenter when sortByDistance
> ---------------------------------------------
>                 Key: HDFS-9149
>                 URL: https://issues.apache.org/jira/browse/HDFS-9149
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>            Reporter: He Xiaoqiao
>            Assignee: He Tianyi
> {{sortByDistance}} doesn't consider multi-datacenter when read data, so there my be reading
data via other datacenter when hadoop deployment with multi-IDC.

This message was sent by Atlassian JIRA

View raw message