hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11090) Leave safemode immediately if all blocks have reported in
Date Wed, 02 Nov 2016 01:09:58 GMT
Andrew Wang created HDFS-11090:
----------------------------------

             Summary: Leave safemode immediately if all blocks have reported in
                 Key: HDFS-11090
                 URL: https://issues.apache.org/jira/browse/HDFS-11090
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
    Affects Versions: 2.7.3
            Reporter: Andrew Wang


Startup safemode is triggered by two thresholds: % blocks reported in, and min # datanodes.
It's extended by an interval (default 30s) until these two thresholds are met.

Safemode extension is helpful when the cluster has data, and the default % blocks threshold
(0.99) is used. It gives DNs a little extra time to report in and thus avoid unnecessary replication
work.

However, we can leave startup safemode early if 100% of blocks have reported in.

Note that operators sometimes change the % blocks threshold to > 1 to never automatically
leave safemode. We should maintain this behavior.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message