Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 79335 invoked from network); 3 Feb 2008 09:32:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Feb 2008 09:32:38 -0000 Received: (qmail 45976 invoked by uid 500); 3 Feb 2008 09:32:29 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 45938 invoked by uid 500); 3 Feb 2008 09:32:29 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 45929 invoked by uid 99); 3 Feb 2008 09:32:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Feb 2008 01:32:29 -0800 X-ASF-Spam-Status: No, hits=-99.8 required=10.0 tests=ALL_TRUSTED,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Feb 2008 09:32:01 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 29F0C714069 for ; Sun, 3 Feb 2008 01:32:09 -0800 (PST) Message-ID: <1124991.1202031129169.JavaMail.jira@brutus> Date: Sun, 3 Feb 2008 01:32:09 -0800 (PST) From: "dhruba borthakur (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-1700) Append to files in HDFS MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1700?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1700: ------------------------------------- Status: Open (was: Patch Available) I am canceling this patch because I am not convinced that the current patch= does error recovery.=20 > Append to files in HDFS > ----------------------- > > Key: HADOOP-1700 > URL: https://issues.apache.org/jira/browse/HADOOP-1700 > Project: Hadoop Core > Issue Type: New Feature > Components: dfs > Affects Versions: 0.15.1 > Reporter: stack > Attachments: append.patch, Appends.doc, Appends.doc, Appends.html > > > Request for being able to append to files in HDFS has been raised a coupl= e of times on the list of late. For one example, see http://www.nabble.co= m/HDFS%2C-appending-writes-status-tf3848237.html#a10916193. Other mail des= cribes folks' workarounds because this feature is lacking: e.g. http://www.= nabble.com/Loading-data-into-HDFS-tf4200003.html#a12039480 (Later on this t= hread, Jim Kellerman re-raises the HBase need of this feature). HADOOP-337= 'DFS files should be appendable' makes mention of file append but it was o= pened early in the life of HDFS when the focus was more on implementing the= basics rather than adding new features. Interest fizzled. Because HADOOP= -337 is also a bit of a grab-bag -- it includes truncation and being able t= o concurrently read/write -- rather than try and breathe new life into HADO= OP-337, instead, here is a new issue focused on file append. Ultimately, b= eing able to do as the google GFS paper describes -- having multiple concur= rent clients making 'Atomic Record Append' to a single file would be sweet = but at least for a first cut at this feature, IMO, a single client appendin= g to a single HDFS file letting the application manage the access would be = sufficent. --=20 This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.