From hdfs-issues-return-1664-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org Wed Sep 02 17:08:55 2009 Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 37748 invoked from network); 2 Sep 2009 17:08:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 2 Sep 2009 17:08:55 -0000 Received: (qmail 41143 invoked by uid 500); 2 Sep 2009 17:08:55 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 41103 invoked by uid 500); 2 Sep 2009 17:08:55 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 41082 invoked by uid 99); 2 Sep 2009 17:08:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Sep 2009 17:08:55 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Sep 2009 17:08:53 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id D7A82234C1ED for ; Wed, 2 Sep 2009 10:08:33 -0700 (PDT) Message-ID: <1427009735.1251911313882.JavaMail.jira@brutus> Date: Wed, 2 Sep 2009 10:08:33 -0700 (PDT) From: "Suresh Srinivas (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Updated: (HDFS-173) Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-173: --------------------------------- Attachment: HDFS-173.4.patch In the test the dfs.block.size was not a multiple fo io.bytes.per.checksum. This resulted in cluster not starting up. Setting io.bytes.per.checksum appropriately. > Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes > ----------------------------------------------------------------------------------------------------------------------------------- > > Key: HDFS-173 > URL: https://issues.apache.org/jira/browse/HDFS-173 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Suresh Srinivas > Assignee: Suresh Srinivas > Fix For: 0.21.0 > > Attachments: HDFS-173.1.patch, HDFS-173.2.patch, HDFS-173.3.patch, HDFS-173.4.patch, HDFS-173.patch > > > Delete a directory with millions of files. This could take several minutes (observed 12 mins for 9 million files). While the operation is in progress FSNamesystem lock is held and the requests from clients are not handled until deletion completes. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.