Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Sun, 5 Mar 2017 20:12:33 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13048381.1488744070000.2484.1488744753067@Atlassian.JIRA>
In-Reply-To: <JIRA.13048381.1488744070000@Atlassian.JIRA>
References: <JIRA.13048381.1488744070000@Atlassian.JIRA> <JIRA.13048381.1488744070457@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HDFS-11499) Decommissioning stuck because of
 failing recovery
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sun, 05 Mar 2017 20:12:38 -0000


    [ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896532#comment-15896532 ] 

ASF GitHub Bot commented on HDFS-11499:
---------------------------------------

GitHub user lukmajercak opened a pull request:

    https://github.com/apache/hadoop/pull/199

    HDFS-11499 Decommissioning stuck because of failing recovery

    
You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/lukmajercak/hadoop HDFS-11499

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hadoop/pull/199.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #199
    
----
commit 3609b1353e64a24dee4746b8fa23ed7547768d68
Author: Lukas Majercak <lumajerc@microsoft.com>
Date:   2017-03-05T20:04:06Z

    HDFS-11499 add TestDecommission.testDecommissionWithOpenFileAndDatanodeFailing for testing recovery

commit 3f97d89f75d8a20f878da8c438141f9b6adf7da0
Author: Lukas Majercak <lumajerc@microsoft.com>
Date:   2017-03-05T20:05:08Z

    HDFS-11499 count decommissioning replicas when completing last block in BlockManager.commitOrCompleteLastBlock

----


> Decommissioning stuck because of failing recovery
> -------------------------------------------------
>
>                 Key: HDFS-11499
>                 URL: https://issues.apache.org/jira/browse/HDFS-11499
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs, namenode
>    Affects Versions: 2.7.1, 2.7.2, 2.7.3, 3.0.0-alpha2
>            Reporter: Lukas Majercak
>            Assignee: Lukas Majercak
>
> Block recovery will fail to finalize the file if the locations of the last, incomplete block are being decommissioned. Vice versa, the decommissioning will be stuck, waiting for the last block to be completed.
> {code:xml}
> org.apache.hadoop.ipc.RemoteException(java.lang.IllegalStateException): Failed to finalize INodeFile testRecoveryFile since blocks[255] is non-complete, where blocks=[blk_1073741825_1001, blk_1073741826_1002...
> {code}
> The fix is to count replicas on decommissioning nodes when completing last block in BlockManager.commitOrCompleteLastBlock, as we know that the DecommissionManager will not decommission a node that has UC blocks.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org