hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads
Date Mon, 08 Dec 2014 22:17:14 GMT
Colin Patrick McCabe created HDFS-7492:
------------------------------------------

             Summary: If multiple threads call FsVolumeList#checkDirs at the same time, we
should only do checkDirs once and give the results to all waiting threads
                 Key: HDFS-7492
                 URL: https://issues.apache.org/jira/browse/HDFS-7492
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Colin Patrick McCabe


checkDirs is called when we encounter certain I/O errors.  It's rare to get just a single
I/O error... normally you start getting many errors when a disk is going bad.  For this reason,
we shouldn't start a new checkDirs scan for each error.  Instead, if multiple threads call
FsVolumeList#checkDirs at around the same time, we should only do checkDirs once and give
the results to all the waiting threads.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message