hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fei Hui (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client
Date Wed, 26 Sep 2018 09:12:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628461#comment-16628461
] 

Fei Hui commented on HDFS-13248:
--------------------------------

{quote}
How does the rack locality and so on work in this case? Would it try to place it in the rack
itself?
{quote}
Client node is 10.83.79.39, and it is on the same rack with 10.83.79.36.
Pipeline log is following
{quote}
2018-09-25 20:06:18,268 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-158347504-10.83.62.66-1508752583786:blk_1101953203_28301053
src: /10.83.79.39:55362 dest: /10.83.79.39:50010
2018-09-25 20:06:18,271 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-158347504-10.83.62.66-1508752583786:blk_1101953203_28301053
src: /10.83.79.39:35082 dest: /10.83.79.36:50010
2018-09-25 20:06:18,272 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-158347504-10.83.62.66-1508752583786:blk_1101953203_28301053
src: /10.83.79.36:58584 dest: /10.83.78.57:50010
{quote}

> RBF: Namenode need to choose block location for the client
> ----------------------------------------------------------
>
>                 Key: HDFS-13248
>                 URL: https://issues.apache.org/jira/browse/HDFS-13248
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Weiwei Wu
>            Assignee: Íñigo Goiri
>            Priority: Major
>         Attachments: HDFS-13248.000.patch, HDFS-13248.001.patch, HDFS-13248.002.patch,
clientMachine-call-path.jpeg, debug-info-1.jpeg, debug-info-2.jpeg
>
>
> When execute a put operation via router, the NameNode will choose block location for
the router, not for the real client. This will affect the file's locality.
> I think on both NameNode and Router, we should add a new addBlock method, or add a parameter
for the current addBlock method, to pass the real client information.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message