hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7603) The background replication queue initialization may not let others run
Date Fri, 30 Jan 2015 14:15:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298660#comment-14298660
] 

Hudson commented on HDFS-7603:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk #2021 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2021/])
HDFS-7603. The background replication queue initialization may not let others run. Contributed
by Kihwal Lee. (kihwal: rev 89b07490f8354bb83a67b7ffc917bfe99708e615)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt


> The background replication queue initialization may not let others run
> ----------------------------------------------------------------------
>
>                 Key: HDFS-7603
>                 URL: https://issues.apache.org/jira/browse/HDFS-7603
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: rolling upgrades
>            Reporter: Kihwal Lee
>            Assignee: Kihwal Lee
>            Priority: Critical
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7603.patch, HDFS-7603.patch
>
>
> The background replication queue initialization processes configured number of blocks
at a time and releases the namesystem write lock.  This was to let namenode start serving
right after a standby to active transition or leaving safe mode.  However, this does not allow
others to run much if the lock fairness is set to "unfair" for the higher throughput.
> I propose adding a delay between unlocking and locking in the async repl queue init thread.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message