hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages
Date Wed, 20 Jan 2016 13:01:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108486#comment-15108486

Wei Zhou commented on HDFS-9608:

Thanks for your work! Code refined as your suggestion. 
For question 2, I planed to open another JIRA because RR policy is used by AvailableSpaceVolumeChoosingPolicy.
It is now included in this patch, thanks!

> Disk IO imbalance in HDFS with heterogeneous storages
> -----------------------------------------------------
>                 Key: HDFS-9608
>                 URL: https://issues.apache.org/jira/browse/HDFS-9608
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Wei Zhou
>            Assignee: Wei Zhou
>         Attachments: HDFS-9608.01.patch, HDFS-9608.02.patch, HDFS-9608.03.patch, HDFS-9608.04.patch,
HDFS-9608.05.patch, HDFS-9608.06.patch
> Currently RoundRobinVolumeChoosingPolicy use a shared index to choose volumes in HDFS
with heterogeneous storages, this leads to non-RR choosing mode for certain type of storage.
> Besides, it uses a shared lock for synchronization which limits the concurrency of volume
choosing process. Volume choosing threads that operating on different storage types should
be able to run concurrently. 

This message was sent by Atlassian JIRA

View raw message