Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 75E3A18859 for ; Wed, 4 Nov 2015 13:23:29 +0000 (UTC) Received: (qmail 15031 invoked by uid 500); 4 Nov 2015 13:23:29 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 14937 invoked by uid 500); 4 Nov 2015 13:23:27 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 14916 invoked by uid 99); 4 Nov 2015 13:23:27 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Nov 2015 13:23:27 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id B386B2C1F5F for ; Wed, 4 Nov 2015 13:23:27 +0000 (UTC) Date: Wed, 4 Nov 2015 13:23:27 +0000 (UTC) From: "Rakesh R (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7764: --------------------------- Attachment: (was: HDFS-7764-01.patch) > DirectoryScanner shouldn't abort the scan if one directory had an error > ----------------------------------------------------------------------- > > Key: HDFS-7764 > URL: https://issues.apache.org/jira/browse/HDFS-7764 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode > Affects Versions: 2.7.0 > Reporter: Rakesh R > Assignee: Rakesh R > Attachments: HDFS-7764.patch > > > If there is an exception while preparing the ScanInfo for the blocks in the directory, DirectoryScanner is immediately throwing exception and coming out of the current scan cycle. It would be good if he can signal #cancel() to the other pending tasks . > DirectoryScanner.java > {code} > for (Entry> report : > compilersInProgress.entrySet()) { > try { > dirReports[report.getKey()] = report.getValue().get(); > } catch (Exception ex) { > LOG.error("Error compiling report", ex); > // Propagate ex to DataBlockScanner to deal with > throw new RuntimeException(ex); > } > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)