hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages
Date Fri, 15 Jan 2016 19:25:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102339#comment-15102339

Andrew Wang commented on HDFS-9608:

Patch doesn't apply for me either, also a small nit when you rebase, javadoc is associated
with the immediately following member, so recommend either splitting the syncLocks doc out
to be above the syncLocks variable, or just change it to a plain block comment instead of
javadoc e.g.:


Unit test failures also look related.

> Disk IO imbalance in HDFS with heterogeneous storages
> -----------------------------------------------------
>                 Key: HDFS-9608
>                 URL: https://issues.apache.org/jira/browse/HDFS-9608
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Wei Zhou
>            Assignee: Wei Zhou
>         Attachments: HDFS-9608.01.patch, HDFS-9608.02.patch, HDFS-9608.03.patch
> Currently RoundRobinVolumeChoosingPolicy use a shared index to choose volumes in HDFS
with heterogeneous storages, this leads to non-RR choosing mode for certain type of storage.
> Besides, it uses a shared lock for synchronization which limits the concurrency of volume
choosing process. Volume choosing threads that operating on different storage types should
be able to run concurrently. 

This message was sent by Atlassian JIRA

View raw message