hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages
Date Wed, 17 Feb 2016 19:31:18 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Andrew Wang updated HDFS-9608:
       Resolution: Fixed
    Fix Version/s: 2.9.0
           Status: Resolved  (was: Patch Available)

Committed to trunk and branch-2, thanks Wei for find and fix, Vinay for reviewing!

> Disk IO imbalance in HDFS with heterogeneous storages
> -----------------------------------------------------
>                 Key: HDFS-9608
>                 URL: https://issues.apache.org/jira/browse/HDFS-9608
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Wei Zhou
>            Assignee: Wei Zhou
>             Fix For: 2.9.0
>         Attachments: HDFS-9608.01.patch, HDFS-9608.02.patch, HDFS-9608.03.patch, HDFS-9608.04.patch,
HDFS-9608.05.patch, HDFS-9608.06.patch, HDFS-9608.07.patch
> Currently RoundRobinVolumeChoosingPolicy use a shared index to choose volumes in HDFS
with heterogeneous storages, this leads to non-RR choosing mode for certain type of storage.
> Besides, it uses a shared lock for synchronization which limits the concurrency of volume
choosing process. Volume choosing threads that operating on different storage types should
be able to run concurrently. 

This message was sent by Atlassian JIRA

View raw message