Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 399 invoked from network); 18 Mar 2008 20:01:27 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 18 Mar 2008 20:01:27 -0000 Received: (qmail 86818 invoked by uid 500); 18 Mar 2008 20:01:12 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 86797 invoked by uid 500); 18 Mar 2008 20:01:12 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 86779 invoked by uid 99); 18 Mar 2008 20:01:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Mar 2008 13:01:12 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Mar 2008 20:00:31 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 9950B234C0AD for ; Tue, 18 Mar 2008 12:59:24 -0700 (PDT) Message-ID: <79216286.1205870364626.JavaMail.jira@brutus> Date: Tue, 18 Mar 2008 12:59:24 -0700 (PDT) From: "Tsz Wo (Nicholas), SZE (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3025) ChecksumFileSystem needs to support the new delete method In-Reply-To: <209044586.1205674824280.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580048#action_12580048 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3025: ------------------------------------------------ +1 > ChecksumFileSystem needs to support the new delete method > --------------------------------------------------------- > > Key: HADOOP-3025 > URL: https://issues.apache.org/jira/browse/HADOOP-3025 > Project: Hadoop Core > Issue Type: Bug > Components: fs > Affects Versions: 0.17.0 > Reporter: Devaraj Das > Assignee: Mahadev konar > Priority: Blocker > Fix For: 0.17.0 > > Attachments: HADOOP_3025_1.patch, HADOOP_3025_2.patch, HADOOP_3025_3.patch, HADOOP_3025_4.patch > > > The method FileSystem.delete(path) has been deprecated in favor of the new method delete(path, recursive). Temporary files gets created in the MapReduce framework and when the time for deletion comes, they are deleted via delete(path, recursive). This doesn't delete the associated checksum files. This has a big impact when the FileSystem is the InMemoryFileSystem, where space is at a premium and wasting space here might hurt the performance of MapReduce jobs overall. One solution to this problem is to implement the method delete(path, recursive) in the ChecksumFileSystem but is there is a reason why it was left out as part of HADOOP-771? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.