hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12137) DN dataset lock should be fair
Date Thu, 13 Jul 2017 19:56:01 GMT
Daryn Sharp created HDFS-12137:

             Summary: DN dataset lock should be fair
                 Key: HDFS-12137
                 URL: https://issues.apache.org/jira/browse/HDFS-12137
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: datanode
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical

The dataset lock is very highly contended.  The unfair nature can be especially harmful to
the heartbeat handling.  Under high loads, partially expose by HDFS-12136 introducing disk
i/o within the lock, the heartbeat handling thread may process commands so slowly due to the
contention that the node becomes stale or falsely declared dead.  The unfair lock is not helping
and appears to be causing frequent starvation under load.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message