hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom
Date Tue, 07 Mar 2017 21:58:38 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chen Liang updated HDFS-11482:
------------------------------
    Attachment: HDFS-11482.004.patch

The race condition mentioned earlier in HDFS-11507 turns out to be a false alarm, the race
condition is avoided by having a global lock before and after {{chooseRandom}}. Upload v004
patch with a similar fix.

> Add storage type demand to into DFSNetworkTopology#chooseRandom
> ---------------------------------------------------------------
>
>                 Key: HDFS-11482
>                 URL: https://issues.apache.org/jira/browse/HDFS-11482
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11482.001.patch, HDFS-11482.002.patch, HDFS-11482.003.patch,
HDFS-11482.004.patch
>
>
> HDFS-11450 adds storage type info into network topology, with on this info we may change
chooseRandom to take storage type requirement as parameter, only checking subtrees required
storage type available. This way we avoid blindly picking up nodes that are not applicable.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message