hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Xiaoqiao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-14554) Avoid to process duplicate blockreport of when namenode in startup safemode
Date Fri, 07 Jun 2019 14:39:00 GMT
He Xiaoqiao created HDFS-14554:
----------------------------------

             Summary: Avoid to process duplicate blockreport of when namenode in startup safemode
                 Key: HDFS-14554
                 URL: https://issues.apache.org/jira/browse/HDFS-14554
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: namenode
            Reporter: He Xiaoqiao
            Assignee: He Xiaoqiao


When NameNode restart and enter stage of startup safemode, load of NameNode could be very
high since blockreport request storm from datanodes together. Sometimes datanode may request
blockreport times because NameNode doesn't return in time and DataNode meet timeoutexception
then retry, Thus it sharpens load of NameNode.
So we should check and filter duplicate blockreport request from one datannode and reduce
load of Namenode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message