hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9198) Coalesce IBR processing in the NN
Date Mon, 05 Oct 2015 17:25:27 GMT
Daryn Sharp created HDFS-9198:

             Summary: Coalesce IBR processing in the NN
                 Key: HDFS-9198
                 URL: https://issues.apache.org/jira/browse/HDFS-9198
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
    Affects Versions: 2.0.0-alpha
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp

IBRs from thousands of DNs under load will degrade NN performance due to excessive write-lock
contention from multiple IPC handler threads.  The IBR processing is quick, so the lock contention
may be reduced by coalescing multiple IBRs into a single write-lock transaction.  The handlers
will also be freed up faster for other operations.

This message was sent by Atlassian JIRA

View raw message