Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5002E18628 for ; Mon, 3 Aug 2015 20:53:02 +0000 (UTC) Received: (qmail 18382 invoked by uid 500); 3 Aug 2015 20:52:56 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 18274 invoked by uid 500); 3 Aug 2015 20:52:56 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 18257 invoked by uid 99); 3 Aug 2015 20:52:56 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2015 20:52:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 8B63DC072B for ; Mon, 3 Aug 2015 20:52:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=ymail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ZXT-aoCJUdtC for ; Mon, 3 Aug 2015 20:52:36 +0000 (UTC) Received: from nm30-vm0.bullet.mail.bf1.yahoo.com (nm30-vm0.bullet.mail.bf1.yahoo.com [98.139.213.126]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 179EC24E14 for ; Mon, 3 Aug 2015 20:52:34 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ymail.com; s=s2048; t=1438635147; bh=7EY7orolJM9YuCxJ1UD0sPRSxhj0lhimMnDQbK0bVX4=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject; b=rH9kexkaVoHBvsg3hf+sbx6dt5QbfDcutC0FnDqYq3kvjSqsoDDw7w6S399Rg1jG+evB1XwsnKs4c+ZmLWwdqm6jRjS2ksPF+3XezqfsWmS1OA1e2UHxCVN/iZ9MELW+BS1z/tw0o6RCT+TmQF70pJecIoFuPm5g1TJcsaMApZkVbEq4SRBXhx0iE+gaMe9gScuGMDFekyGLwB7uhnbFgQ3oHufjKKsEXPknkic67oDCHRitMx3aNLcPX+itEmm/penosFOJQduABWHJLRTjP2Vzkv4CgVAWMCHATX1G4utkGum8BEZJujWSpIvzHUs8IU6vT9TrEmdDJl/sxwvAPw== Received: from [66.196.81.173] by nm30.bullet.mail.bf1.yahoo.com with NNFMP; 03 Aug 2015 20:52:27 -0000 Received: from [98.139.212.225] by tm19.bullet.mail.bf1.yahoo.com with NNFMP; 03 Aug 2015 20:52:27 -0000 Received: from [127.0.0.1] by omp1034.mail.bf1.yahoo.com with NNFMP; 03 Aug 2015 20:52:27 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 959635.27571.bm@omp1034.mail.bf1.yahoo.com X-YMail-OSG: RUkw7ggVM1ksVr5D6XogApuoVEkJV1SSs6eOrYQPGqML.7zSldsyYUFrbMUqxga MYkQ6ubFtysvHo3U6WzlR.lRSn_jiBq7s59Tr5.1lCq5xoypf0vIO7pIDAdLzsbV_RD5ub5T6d13 jF6pDwRSBOlRGWloRfteptAZldwvDmsw4LfPbGBk_kSQGvhBo8uQDLRDmQXM44Pqbu4Eg_eBqKRB tAiq7AibuTv3OXQUTAE0rQh0aGfHni1a_4oAInLhC0qW61mrCfiVSoeI5sNr0PzrgP.UeBWBSCcp R.JqcGxC5Ai19YjJZtgiUnlHVpEnuDHE2NPSjBmm4zoVzRF.soGJq7QhycCaN9kCxoZhVU2yYco1 6MEjQXyV3X4fijH8c8rI9BG0ZK9DdBjcH06d2zez8ElakrBHePFXABAKcJN0M.RaMu4iJgyJ9_Ia e9vbZ6GX35C9Co0bo2pw_X9Lq1l72Aws7omCtmhGhvHmIVleenmLAGQMYx1HBZxpzA1G8SDOEJZM EyjzKrv.JEquy_UNu7adM8HLi Received: by 66.196.80.118; Mon, 03 Aug 2015 20:52:27 +0000 Date: Mon, 3 Aug 2015 20:52:26 +0000 (UTC) From: Ravi Prakash Reply-To: Ravi Prakash To: "user@hadoop.apache.org" Message-ID: <1512831173.613626.1438635146963.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: <004e01d0cd9f$6a7bd960$3f738c20$@tma.com.vn> References: <004e01d0cd9f$6a7bd960$3f738c20$@tma.com.vn> Subject: Re: Documentation inconsistency about append write in HDFS MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_613625_179722093.1438635146957" ------=_Part_613625_179722093.1438635146957 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks Thanh! Yes! Could you please post a patch? =20 On Sunday, August 2, 2015 8:50 PM, Thanh Hong Dai = wrote: =20 In the latest version of the documentation (http://hadoo= p.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html#= Simple_Coherency_Model and also documentation for version 2.x), it=E2=80=99= s mentioned that =E2=80=9CA file once created, written, and closed need not= be changed. =E2=80=9C and =E2=80=9CThere is a plan to support appending-wr= ites to files in the future.=E2=80=9D =C2=A0However, as far as I know, HDF= S has supported append write since 0.21, based on this JIRA (https://issues= .apache.org/jira/browse/HDFS-265) and the old version of the documentation = in 2012 (https://web.archive.org/web/20121221171824/http://hadoop.apache.or= g/docs/hdfs/current/hdfs_design.html#Appending-Writes+and+File+Syncs) =C2= =A0Various posts on the Internet also suggests that append write has been a= vailable in HDFS, and will always be available in Hadoop version 2 branch. = =C2=A0Can we update the documentation to reflect the most recent change? (O= r will append write be deprecated or is it not ready for production use?) ------=_Part_613625_179722093.1438635146957 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks Thanh! Yes! Could you please post a patch?
<= br>


On Sunday, August 2, 2015 = 8:50 PM, Thanh Hong Dai <hdthanh@tma.com.vn> wrote:

In the latest version of the documentation (http://hadoop.a= pache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html#Sim= ple_Coherency_Model and also documentation for version 2.x), it=E2=80= =99s mentioned that =E2=80=9CA file once created, written, and closed need = not be changed. =E2=80=9C and =E2=80=9CThere is a plan to support appending= -writes to files in the future.=E2=80=9D
 
However, as fa= r as I know, HDFS has supported append write since 0.21, based on this JIRA= (ht= tps://issues.apache.org/jira/browse/HDFS-265) and the old version of th= e documentation in 2012 (https://web.archive.org/web/20121221171824/http://hado= op.apache.org/docs/hdfs/current/hdfs_design.html#Appending-Writes+and+File+= Syncs)
 
Various posts on the Internet also suggests = that append write has been available in HDFS, and will always be available = in Hadoop version 2 branch.
&nb= sp;
Can we update the documentat= ion to reflect the most recent change? (Or will append write be deprecated = or is it not ready for production use?)


------=_Part_613625_179722093.1438635146957--