Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 18895 invoked from network); 9 Aug 2007 18:46:09 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 9 Aug 2007 18:46:09 -0000 Received: (qmail 43378 invoked by uid 500); 9 Aug 2007 18:46:07 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 43353 invoked by uid 500); 9 Aug 2007 18:46:07 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 43344 invoked by uid 99); 9 Aug 2007 18:46:07 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2007 11:46:07 -0700 X-ASF-Spam-Status: No, hits=-99.8 required=10.0 tests=ALL_TRUSTED,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2007 18:46:03 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id E06B871418F for ; Thu, 9 Aug 2007 11:45:42 -0700 (PDT) Message-ID: <26969728.1186685142916.JavaMail.jira@brutus> Date: Thu, 9 Aug 2007 11:45:42 -0700 (PDT) From: "stack (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-1700) Append to files in HDFS MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Append to files in HDFS ----------------------- Key: HADOOP-1700 URL: https://issues.apache.org/jira/browse/HADOOP-1700 Project: Hadoop Issue Type: New Feature Components: dfs Reporter: stack Request for being able to append to files in HDFS has been raised a couple = of times on the list of late. For one example, see http://www.nabble.com/= HDFS%2C-appending-writes-status-tf3848237.html#a10916193. Other mail descr= ibes folks' workarounds because this feature is lacking: e.g. http://www.na= bble.com/Loading-data-into-HDFS-tf4200003.html#a12039480 (Later on this thr= ead, Jim Kellerman re-raises the HBase need of this feature). HADOOP-337 '= DFS files should be appendable' makes mention of file append but it was ope= ned early in the life of HDFS when the focus was more on implementing the b= asics rather than adding new features. Interest fizzled. Because HADOOP-3= 37 is also a bit of a grab-bag -- it includes truncation and being able to = concurrently read/write -- rather than try and breathe new life into HADOOP= -337, instead, here is a new issue focused on file append. Ultimately, bei= ng able to do as the google GFS paper describes -- having multiple concurre= nt clients making 'Atomic Record Append' to a single file would be sweet bu= t at least for a first cut at this feature, IMO, a single client appending = to a single HDFS file letting the application manage the access would be su= fficent. --=20 This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.