hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error
Date Fri, 29 Jan 2016 04:29:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122928#comment-15122928
] 

Hudson commented on HDFS-7764:
------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #9204 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/9204/])
HDFS-7764. DirectoryScanner shouldn't abort the scan if one directory (cmccabe: rev f67149ab08bb49381def6c535ab4c4610e0a4221)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java


> DirectoryScanner shouldn't abort the scan if one directory had an error
> -----------------------------------------------------------------------
>
>                 Key: HDFS-7764
>                 URL: https://issues.apache.org/jira/browse/HDFS-7764
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.7.0
>            Reporter: Rakesh R
>            Assignee: Rakesh R
>             Fix For: 2.9.0
>
>         Attachments: HDFS-7764-01.patch, HDFS-7764-02.patch, HDFS-7764-03.patch, HDFS-7764-04.patch,
HDFS-7764.patch
>
>
> If there is an exception while preparing the ScanInfo for the blocks in the directory,
DirectoryScanner is immediately throwing exception and coming out of the current scan cycle.
The idea of this jira is to discuss & improve the exception handling mechanism.
> DirectoryScanner.java
> {code}
>     for (Entry<Integer, Future<ScanInfoPerBlockPool>> report :
>         compilersInProgress.entrySet()) {
>       try {
>         dirReports[report.getKey()] = report.getValue().get();
>       } catch (Exception ex) {
>         LOG.error("Error compiling report", ex);
>         // Propagate ex to DataBlockScanner to deal with
>         throw new RuntimeException(ex);
>       }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message