Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 6 Jun 2017 17:23:18 +0000 (UTC)
From: "Rushabh S Shah (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13067386.1493301898000.8447.1496769798705@Atlassian.JIRA>
In-Reply-To: <JIRA.13067386.1493301898000@Atlassian.JIRA>
References: <JIRA.13067386.1493301898000@Atlassian.JIRA> <JIRA.13067386.1493301898870@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (HDFS-11711) DN should not delete the block
 On "Too many open files" Exception
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 06 Jun 2017 17:23:23 -0000


    [ https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039292#comment-16039292 ] 

Rushabh S Shah edited comment on HDFS-11711 at 6/6/17 5:23 PM:
---------------------------------------------------------------

bq. The third param vaule should be more than the second param i
[~linyiqun]: Good catch. We should fix this.
Does it make sense to open a new jira for GenericTestUtils to have some assert or preconditions check to make sure 3rd param is _always_ greater than 2nd param.


was (Author: shahrs87):
bq. The third param vaule should be more than the second param i
[~linyiqun]: Good catch. We should fix this.
Does it make sense to open a new jira to make sure GenericTestUtils have some assert or preconditions check to make sure 3rd param is _always_ greater than 2nd param.


> DN should not delete the block On "Too many open files" Exception
> -----------------------------------------------------------------
>
>                 Key: HDFS-11711
>                 URL: https://issues.apache.org/jira/browse/HDFS-11711
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>            Reporter: Brahma Reddy Battula
>            Assignee: Brahma Reddy Battula
>            Priority: Critical
>         Attachments: HDFS-11711-002.patch, HDFS-11711-003.patch, HDFS-11711-branch-2-002.patch, HDFS-11711.patch
>
>
>  *Seen the following scenario in one of our customer environment* 
> * while jobclient writing {{"job.xml"}} there are pipeline failures and written to only one DN.
> * when mapper reading the {{"job.xml"}}, DN got {{"Too many open files"}} (as system exceed limit) and block got deleted. Hence mapper failed to read and job got failed.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org