Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 38359 invoked from network); 23 Aug 2007 22:36:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 23 Aug 2007 22:36:55 -0000 Received: (qmail 6688 invoked by uid 500); 23 Aug 2007 22:36:51 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 6532 invoked by uid 500); 23 Aug 2007 22:36:50 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 6523 invoked by uid 99); 23 Aug 2007 22:36:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Aug 2007 15:36:50 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Aug 2007 22:36:51 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 362F671420F for ; Thu, 23 Aug 2007 15:36:31 -0700 (PDT) Message-ID: <17105620.1187908591219.JavaMail.jira@brutus> Date: Thu, 23 Aug 2007 15:36:31 -0700 (PDT) From: "Christophe Taton (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-1708) make files visible in the namespace as soon as they are created In-Reply-To: <14647974.1186793503720.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12522297 ] Christophe Taton commented on HADOOP-1708: ------------------------------------------ I agree. At least in a short term, the semantics should remain as it is when the file is not visible, meaning that a file being created cannot be deleted or renamed before it is completed. Ideally however, renaming and deletion should also work on file being created. Renaming should not interfere with the file creation, while deletion should prevent it to complete. > make files visible in the namespace as soon as they are created > --------------------------------------------------------------- > > Key: HADOOP-1708 > URL: https://issues.apache.org/jira/browse/HADOOP-1708 > Project: Hadoop > Issue Type: Bug > Components: dfs > Reporter: dhruba borthakur > Assignee: dhruba borthakur > Fix For: 0.15.0 > > Attachments: 1708-20070820a.patch, atomicCreation2.patch > > > In the current DFS implementation, a file appears in the namespace only when the creator closes the file. Also, if the namenode or the client dies before closing the file, the file never appears in the namespace. > This issue will make files appear in the namespace as soon as it is created. Also, it will continue to remain in the namespace even if the creator dies before closing the file. > This is related to HADOOP-89. It is different from HADOOP-89 because it does not attempt to make data visible as soon as it is written. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.