hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom
Date Tue, 07 Mar 2017 01:23:33 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chen Liang updated HDFS-11482:
------------------------------
    Attachment: HDFS-11482.003.patch

v001 and v002 patch were missing the change to one more file. Fixed in v003 patch.

Also, there is potential race condition that can cause the code to loop forever when choosing
a random node. This issue also exists in current NetworkTopology, tracked in HDFS-11507

> Add storage type demand to into DFSNetworkTopology#chooseRandom
> ---------------------------------------------------------------
>
>                 Key: HDFS-11482
>                 URL: https://issues.apache.org/jira/browse/HDFS-11482
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11482.001.patch, HDFS-11482.002.patch, HDFS-11482.003.patch
>
>
> HDFS-11450 adds storage type info into network topology, with on this info we may change
chooseRandom to take storage type requirement as parameter, only checking subtrees required
storage type available. This way we avoid blindly picking up nodes that are not applicable.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message