hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12140) Remove BPOfferService lock contention to get block pool id
Date Fri, 14 Jul 2017 15:00:00 GMT
Daryn Sharp created HDFS-12140:

             Summary: Remove BPOfferService lock contention to get block pool id
                 Key: HDFS-12140
                 URL: https://issues.apache.org/jira/browse/HDFS-12140
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical

The block pool id is protected by a lock in {{BPOfferService}}.  This creates excessive contention
especially for xceivers threads attempting to queue IBRs and heartbeat processing.  When the
latter is delayed due to excessive FSDataset lock contention, it causes pipelines to collapse.

Accessing the block pool id should be lockless after registration.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message