hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing.
Date Fri, 11 Oct 2013 14:44:41 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kihwal Lee updated HDFS-5346:
-----------------------------

    Description: When initial block reports are being processed, checkMode() is called from
incrementSafeBlockCount(). This causes the replication queues to be initialized in the middle
of processing a block report in the IBR processing mode. If there are many block reports waiting
to be processed, SafeModeMonitor won't be able to make name node leave the safe mode soon.
It appears that the block report processing speed degrades considerably during this time.


> Replication queues should not be initialized in the middle of IBR processing.
> -----------------------------------------------------------------------------
>
>                 Key: HDFS-5346
>                 URL: https://issues.apache.org/jira/browse/HDFS-5346
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.23.9, 2.3.0
>            Reporter: Kihwal Lee
>
> When initial block reports are being processed, checkMode() is called from incrementSafeBlockCount().
This causes the replication queues to be initialized in the middle of processing a block report
in the IBR processing mode. If there are many block reports waiting to be processed, SafeModeMonitor
won't be able to make name node leave the safe mode soon. It appears that the block report
processing speed degrades considerably during this time. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message