hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-10244) Avoid accumulation of IBRs for SNN when the standby is down for more than expected time
Date Fri, 01 Apr 2016 11:26:25 GMT
Brahma Reddy Battula created HDFS-10244:
-------------------------------------------

             Summary: Avoid accumulation of IBRs for SNN when the standby is down for more
than expected time
                 Key: HDFS-10244
                 URL: https://issues.apache.org/jira/browse/HDFS-10244
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Brahma Reddy Battula
            Assignee: Brahma Reddy Battula


As per discussion in HDFS-9917 and [comment|https://issues.apache.org/jira/browse/HDFS-9917?focusedCommentId=15213947&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15213947]
from [~vinayrpet] 

 Avoid accumulation of IBRs when the standby is down for long time, can we consider as below.
1. IBRs for StandbyNN can have a threshold ( say 100K or 1Million IBRs ).
2. Also not to loose any important IBRs, IBRs can be cleared when "the threshold is reached
AND 'lastIBR' is more than 'heartbeatExpiryInterval'. i.e. DataNode is considered dead in
Namenode side". In that case, for sure re-Register() will be called on reconnection to running
NameNode (if any).




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message