Return-Path: Delivered-To: apmail-lucene-hadoop-commits-archive@locus.apache.org Received: (qmail 57878 invoked from network); 26 Sep 2007 18:29:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Sep 2007 18:29:31 -0000 Received: (qmail 8016 invoked by uid 500); 26 Sep 2007 18:29:22 -0000 Delivered-To: apmail-lucene-hadoop-commits-archive@lucene.apache.org Received: (qmail 7983 invoked by uid 500); 26 Sep 2007 18:29:22 -0000 Mailing-List: contact hadoop-commits-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-commits@lucene.apache.org Received: (qmail 7969 invoked by uid 99); 26 Sep 2007 18:29:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Sep 2007 11:29:21 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO eris.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Sep 2007 18:31:47 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 9C46F1A9832; Wed, 26 Sep 2007 11:29:08 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r579750 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/dfs/DistributedFileSystem.java Date: Wed, 26 Sep 2007 18:29:08 -0000 To: hadoop-commits@lucene.apache.org From: dhruba@apache.org X-Mailer: svnmailer-1.0.8 Message-Id: <20070926182908.9C46F1A9832@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: dhruba Date: Wed Sep 26 11:29:07 2007 New Revision: 579750 URL: http://svn.apache.org/viewvc?rev=579750&view=rev Log: HADOOP-1910. Reduce the number of RPCs that DistributedFileSystem.create() makes to the namenode. (Raghu Angadi via dhruba) Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/DistributedFileSystem.java Modified: lucene/hadoop/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/CHANGES.txt?rev=579750&r1=579749&r2=579750&view=diff ============================================================================== --- lucene/hadoop/trunk/CHANGES.txt (original) +++ lucene/hadoop/trunk/CHANGES.txt Wed Sep 26 11:29:07 2007 @@ -64,6 +64,9 @@ OPTIMIZATIONS + HADOOP-1910. Reduce the number of RPCs that DistributedFileSystem.create() + makes to the namenode. (Raghu Angadi via dhruba) + HADOOP-1565. Reduce memory usage of NameNode by replacing TreeMap in HDFS Namespace with ArrayList. (Dhruba Borthakur via dhruba) Modified: lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/DistributedFileSystem.java URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/DistributedFileSystem.java?rev=579750&r1=579749&r2=579750&view=diff ============================================================================== --- lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/DistributedFileSystem.java (original) +++ lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/DistributedFileSystem.java Wed Sep 26 11:29:07 2007 @@ -117,13 +117,6 @@ public FSDataOutputStream create(Path f, boolean overwrite, int bufferSize, short replication, long blockSize, Progressable progress) throws IOException { - if (exists(f) && !overwrite) { - throw new IOException("File already exists:"+f); - } - Path parent = f.getParent(); - if (parent != null && !mkdirs(parent)) { - throw new IOException("Mkdirs failed to create " + parent); - } return new FSDataOutputStream( dfs.create(getPathName(f), overwrite, replication, blockSize,