hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12049) Recommissioning live nodes stalls the NN
Date Tue, 06 Feb 2018 03:17:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353288#comment-16353288

Wangda Tan commented on HDFS-12049:

We plan to start merge vote of 3.1.0 on Feb 18, please let me know if any plan to finish this
by Feb 18 or we need to move it to 3.2.0.

> Recommissioning live nodes stalls the NN
> ----------------------------------------
>                 Key: HDFS-12049
>                 URL: https://issues.apache.org/jira/browse/HDFS-12049
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Daryn Sharp
>            Priority: Critical
> A node refresh will recommission included nodes that are alive and in decommissioning
or decommissioned state.  The recommission will scan all blocks on the node, find over replicated
blocks, chose an excess, queue an invalidate.
> The process is expensive and worsened by overhead of storage types (even when not in
use).  It can be especially devastating because the write lock is held for the entire node
refresh.  _Recommissioning 67 nodes with ~500k blocks/node stalled rpc services for over 4

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message