hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei (Eddy) Xu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.
Date Wed, 17 Jun 2015 21:03:01 GMT
Lei (Eddy) Xu created HDFS-8617:

             Summary: Throttle DiskChecker#checkDirs() speed.
                 Key: HDFS-8617
                 URL: https://issues.apache.org/jira/browse/HDFS-8617
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: HDFS
    Affects Versions: 2.7.0
            Reporter: Lei (Eddy) Xu
            Assignee: Lei (Eddy) Xu

As described in HDFS-8564,  {{DiskChecker.checkDirs(finalizedDir)}} is causing excessive I/Os
because {{finalizedDirs}} might have up to 64K sub-directories (HDFS-6482).

This patch proposes to limit the rate of IO operations in {{DiskChecker.checkDirs()}}. 

This message was sent by Atlassian JIRA

View raw message