Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 50DB0188A9 for ; Fri, 15 Jan 2016 19:25:40 +0000 (UTC) Received: (qmail 9776 invoked by uid 500); 15 Jan 2016 19:25:40 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 9722 invoked by uid 500); 15 Jan 2016 19:25:40 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 9703 invoked by uid 99); 15 Jan 2016 19:25:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jan 2016 19:25:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id C33352C14F7 for ; Fri, 15 Jan 2016 19:25:39 +0000 (UTC) Date: Fri, 15 Jan 2016 19:25:39 +0000 (UTC) From: "Andrew Wang (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102339#comment-15102339 ] Andrew Wang commented on HDFS-9608: ----------------------------------- Patch doesn't apply for me either, also a small nit when you rebase, javadoc is associated with the immediately following member, so recommend either splitting the syncLocks doc out to be above the syncLocks variable, or just change it to a plain block comment instead of javadoc e.g.: {noformat} /* {noformat} Unit test failures also look related. > Disk IO imbalance in HDFS with heterogeneous storages > ----------------------------------------------------- > > Key: HDFS-9608 > URL: https://issues.apache.org/jira/browse/HDFS-9608 > Project: Hadoop HDFS > Issue Type: Bug > Affects Versions: 2.6.0 > Reporter: Wei Zhou > Assignee: Wei Zhou > Attachments: HDFS-9608.01.patch, HDFS-9608.02.patch, HDFS-9608.03.patch > > > Currently RoundRobinVolumeChoosingPolicy use a shared index to choose volumes in HDFS with heterogeneous storages, this leads to non-RR choosing mode for certain type of storage. > Besides, it uses a shared lock for synchronization which limits the concurrency of volume choosing process. Volume choosing threads that operating on different storage types should be able to run concurrently. -- This message was sent by Atlassian JIRA (v6.3.4#6332)