Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 86370 invoked from network); 3 Dec 2008 04:59:11 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Dec 2008 04:59:11 -0000 Received: (qmail 54823 invoked by uid 500); 3 Dec 2008 04:59:16 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 54779 invoked by uid 500); 3 Dec 2008 04:59:16 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 54756 invoked by uid 99); 3 Dec 2008 04:59:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Dec 2008 20:59:16 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Dec 2008 04:57:56 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5A586234C2A0 for ; Tue, 2 Dec 2008 20:58:44 -0800 (PST) Message-ID: <267327699.1228280324368.JavaMail.jira@brutus> Date: Tue, 2 Dec 2008 20:58:44 -0800 (PST) From: "Suresh Srinivas (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3574) Better Datanode DiskOutOfSpaceException handling. In-Reply-To: <1457387636.1213661745000.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652684#action_12652684 ] Suresh Srinivas commented on HADOOP-3574: ----------------------------------------- Should we create another jira to recover form this condition. We could use mechanism similar to balancer to move some blocks to other datanodes to free up space? Datanodes could also indicate this condition to namenode and trigger freeing up space by moving blocks. Alternatively, this could also be done proactively by the namenode when the free space reported by the datanode (during heartbeat) goes below certain threshold. This will improve robustness. > Better Datanode DiskOutOfSpaceException handling. > ------------------------------------------------- > > Key: HADOOP-3574 > URL: https://issues.apache.org/jira/browse/HADOOP-3574 > Project: Hadoop Core > Issue Type: Improvement > Components: dfs > Reporter: Tsz Wo (Nicholas), SZE > > When a datanode ran out of disk space, it throws DiskOutOfSpaceException internally. However, it does not notify the writing client about the exception. As a result, the client will wait until socket timeout. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.