hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3990) NN's health report has severe performance problems
Date Fri, 28 Sep 2012 13:41:07 GMT
Daryn Sharp created HDFS-3990:

             Summary: NN's health report has severe performance problems
                 Key: HDFS-3990
                 URL: https://issues.apache.org/jira/browse/HDFS-3990
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: name-node
    Affects Versions: 2.0.0-alpha, 0.23.0, 3.0.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical

The dfshealth page will place a read lock on the namespace while it does a dns lookup for
every DN.  On a multi-thousand node cluster, this often results in 10s+ load time for the
health page.  10 concurrent requests were found to cause 7m+ load times during which time
write operations blocked.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message