hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1203) DataNode should sleep before reentering service loop after an exception
Date Thu, 26 Aug 2010 00:31:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902730#action_12902730
] 

Hairong Kuang commented on HDFS-1203:
-------------------------------------

It's better if the sleep interval could take the configured heartbeat interval into consideration.
For example, setting it to be the min of 1000 & the heartbeat interval. 

> DataNode should sleep before reentering service loop after an exception
> -----------------------------------------------------------------------
>
>                 Key: HDFS-1203
>                 URL: https://issues.apache.org/jira/browse/HDFS-1203
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.22.0
>
>         Attachments: hdfs-1203.txt
>
>
> When the DN gets an exception in response to a heartbeat, it logs it and continues, but
there is no sleep. I've occasionally seen bugs produce a case where heartbeats continuously
produce exceptions, and thus the DN floods the NN with bad heartbeats. Adding a 1 second sleep
at least throttles the error messages for easier debugging and error isolation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message