hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client
Date Fri, 19 Apr 2019 13:31:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821920#comment-16821920

Brahma Reddy Battula commented on HDFS-13248:

thanks all for useful discussion.

Do you guys ran any MR job and seen % of data locality.?

any chances application will *always* try to connect to different router.(random order can
be disabled).?


> RBF: Namenode need to choose block location for the client
> ----------------------------------------------------------
>                 Key: HDFS-13248
>                 URL: https://issues.apache.org/jira/browse/HDFS-13248
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Wu Weiwei
>            Assignee: Íñigo Goiri
>            Priority: Major
>         Attachments: HDFS-13248.000.patch, HDFS-13248.001.patch, HDFS-13248.002.patch,
HDFS-13248.003.patch, HDFS-13248.004.patch, HDFS-13248.005.patch, HDFS-Router-Data-Locality.odt,
RBF Data Locality Design.pdf, clientMachine-call-path.jpeg, debug-info-1.jpeg, debug-info-2.jpeg
> When execute a put operation via router, the NameNode will choose block location for
the router, not for the real client. This will affect the file's locality.
> I think on both NameNode and Router, we should add a new addBlock method, or add a parameter
for the current addBlock method, to pass the real client information.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message