hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-636) SafeMode should count only complete blocks.
Date Sun, 20 Sep 2009 21:36:15 GMT

    [ https://issues.apache.org/jira/browse/HDFS-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757766#action_12757766

Konstantin Shvachko commented on HDFS-636:

tets-core is successful. Here are the test-patch results
.    [exec] There appear to be 151 release audit warnings before the patch and 151 release
audit warnings after applying the patch.
     [exec] +1 overall.  
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]     +1 release audit.  The applied patch does not increase the total number of
release audit warnings.
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]     Finished build.
     [exec] ======================================================================
     [exec] ======================================================================

> SafeMode should count only complete blocks.
> -------------------------------------------
>                 Key: HDFS-636
>                 URL: https://issues.apache.org/jira/browse/HDFS-636
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Append Branch
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: Append Branch
>         Attachments: completeBlockTotal.patch
> During start up the name-node is in safe mode and is counting blocks reported by data-nodes.
When the number of minimally replicated blocks reaches the configured threshold the name-node
leaves safe mode. Currently all blocks are counted towards the threshold including the ones
that are under construction. The under-construction blocks should be excluded from the count,
because they need to be recovered, which may take long time (lease expires in 1 hour by default).
Also the recovery may result in deleting those blocks so counting them in the blocks total
is incorrect.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message