hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HDFS-636) SafeMode should count only complete blocks.
Date Sun, 20 Sep 2009 23:28:15 GMT

     [ https://issues.apache.org/jira/browse/HDFS-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Konstantin Shvachko resolved HDFS-636.

    Resolution: Fixed

I just committed this.

> SafeMode should count only complete blocks.
> -------------------------------------------
>                 Key: HDFS-636
>                 URL: https://issues.apache.org/jira/browse/HDFS-636
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Append Branch
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: Append Branch
>         Attachments: completeBlockTotal.patch
> During start up the name-node is in safe mode and is counting blocks reported by data-nodes.
When the number of minimally replicated blocks reaches the configured threshold the name-node
leaves safe mode. Currently all blocks are counted towards the threshold including the ones
that are under construction. The under-construction blocks should be excluded from the count,
because they need to be recovered, which may take long time (lease expires in 1 hour by default).
Also the recovery may result in deleting those blocks so counting them in the blocks total
is incorrect.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message