hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-2804) SBN should not mark blocks under-replicated when exiting safemode
Date Sat, 21 Jan 2012 00:24:40 GMT

     [ https://issues.apache.org/jira/browse/HDFS-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Todd Lipcon updated HDFS-2804:
------------------------------

    Attachment: hdfs-2804.txt

Reasonably simple patch with unit test. I've also been running this patch on a cluster for
a couple days.
                
> SBN should not mark blocks under-replicated when exiting safemode
> -----------------------------------------------------------------
>
>                 Key: HDFS-2804
>                 URL: https://issues.apache.org/jira/browse/HDFS-2804
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hdfs-2804.txt
>
>
> In testing on a cluster, I restarted with one fewer datanodes than previously. This caused
a few thousand blocks to be under-replicated. Similar to HDFS-2795, I saw the under-replicated
blocks on the SBN, slowly decreasing as the replication thread ran. This seems to be because
we process the replication queue when exiting safemode, even if in standby mode. It also reports
many "missing blocks" in the NN UI which are slowly decreasing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message