hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5922) DN heartbeat thread can get stuck in tight loop
Date Tue, 25 Feb 2014 02:28:25 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HDFS-5922:
--------------------------------

       Resolution: Fixed
    Fix Version/s: 2.4.0
                   3.0.0
     Hadoop Flags: Reviewed
           Status: Resolved  (was: Patch Available)

Thanks Aaron, and thanks again for root causing it.

I committed it to trunk through branch-2.4.

> DN heartbeat thread can get stuck in tight loop
> -----------------------------------------------
>
>                 Key: HDFS-5922
>                 URL: https://issues.apache.org/jira/browse/HDFS-5922
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.3.0
>            Reporter: Aaron T. Myers
>            Assignee: Arpit Agarwal
>             Fix For: 3.0.0, 2.4.0
>
>         Attachments: HDFS-5922.01.patch, HDFS-5922.02.patch
>
>
> We saw an issue recently on a test cluster where one of the DN threads was consuming
100% of a single CPU. Running jstack indicated that it was the DN heartbeat thread. I believe
I've tracked down the cause to a bug in the accounting around the value of {{pendingReceivedRequests}}.
> More details in the first comment.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message