Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Date: Mon, 27 May 2013 14:59:20 +0000 (UTC)
From: "Vinay (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12649574.1369666678970.26443.1369666760723@arcas>
In-Reply-To: <JIRA.12649574.1369666678970@arcas>
References: <JIRA.12649574.1369666678970@arcas>
Subject: [jira] [Created] (HDFS-4855) DFSOutputStream reference should be
 cleared from DFSClient#filesBeingWritten if the file closure fails.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Vinay created HDFS-4855:
---------------------------

             Summary: DFSOutputStream reference should be cleared from DFSClient#filesBeingWritten if the file closure fails.
                 Key: HDFS-4855
                 URL: https://issues.apache.org/jira/browse/HDFS-4855
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: hdfs-client
    Affects Versions: 2.0.4-alpha
            Reporter: Vinay
            Assignee: Vinay
             Fix For: 2.0.4.1-alpha


If the file closure fails due to some exception, then {{DFSOutputStream}} reference should be removed from the {{DFSClient#filesBeingWritten}}.

Which is useless to keep and also memory consuming.

If the same client is being used for long time,, then there is a chance of client getting OOM due to this.

fix would be simple. 

Just cover complete {{DFSOutputStream#close()}} under try-finally and move {{dfsClient.endFileLease(src);}} to finally block.

Any thoughts..?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira