hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation
Date Fri, 14 Aug 2015 13:58:49 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697034#comment-14697034
] 

Hudson commented on HDFS-7213:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #284 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/284/])
HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne.
(vinayakumarb: rev d25cb8fe12d00faf3e8f3bfd23fd1b01981a340f)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt


> processIncrementalBlockReport performance degradation
> -----------------------------------------------------
>
>                 Key: HDFS-7213
>                 URL: https://issues.apache.org/jira/browse/HDFS-7213
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 2.4.0
>            Reporter: Daryn Sharp
>            Assignee: Eric Payne
>            Priority: Critical
>             Fix For: 2.7.0, 2.6.1
>
>         Attachments: HDFS-7213.1412804753, HDFS-7213.1412806496.txt
>
>
> {{BlockManager#processIncrementalBlockReport}} has a debug line that is missing a {{isDebugEnabled}}
check.  The write lock is being held.  Coupled with the increase in incremental block reports
from receiving blocks, under heavy load this log line noticeably degrades performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message