Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 87165 invoked from network); 23 Sep 2009 07:28:51 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 23 Sep 2009 07:28:51 -0000 Received: (qmail 64110 invoked by uid 500); 23 Sep 2009 07:28:49 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 64022 invoked by uid 500); 23 Sep 2009 07:28:49 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 64012 invoked by uid 99); 23 Sep 2009 07:28:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Sep 2009 07:28:48 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stas.oskin@gmail.com designates 209.85.220.222 as permitted sender) Received: from [209.85.220.222] (HELO mail-fx0-f222.google.com) (209.85.220.222) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Sep 2009 07:28:40 +0000 Received: by fxm22 with SMTP id 22so407575fxm.36 for ; Wed, 23 Sep 2009 00:28:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=JZOyPvZ1Y1It4oWH8x2I7h3MmGdwEhosX2T0YTo7F8w=; b=Vr8umN180yaDaKI49qDDFSkkww/Zjkk62RPRGg/SFbbtwFgO+vD8cg391OAZSye74K Irhltfg9Q52UTGpIXlmOV3Uuqjp5oWdApRZelnNCquM7KPbXWmMomccSGhtbZoHE3aYU bd0Nw5I/iDwb7qe7T4k7SgFN+EZzSXRYtYEfo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=tLAMKjftwkhg3LS3FHEZoHXOJbgB/cEW+lFtZQaUXh3u2WteJAhZeDnUK9xonzZ/Ac Fa/DsictEIZxysaF+qOjUkjrM8B82ak5CyWfTvrulQQzrGOgKCobooI137UoobJE3F8p JCuq2nv2x2VovanPs1hGWnhcYwOJXNImIK0qA= MIME-Version: 1.0 Received: by 10.223.27.194 with SMTP id j2mr583488fac.76.1253690899143; Wed, 23 Sep 2009 00:28:19 -0700 (PDT) In-Reply-To: <77938bc20909230021g415a45d5gfcb52f1772f0c7e9@mail.gmail.com> References: <77938bc20905240533v3f1ff7c9s7ca005ff7c9b5a92@mail.gmail.com> <77938bc20905250340o2a7f60c8v548e123ae3be365e@mail.gmail.com> <77938bc20909130308n30e6017fubce1900b039eba29@mail.gmail.com> <56B06038-B1B2-427E-BC6B-759CAA7F2294@apache.org> <77938bc20909201558m22400b02kda23cd341a8ee5e9@mail.gmail.com> <77938bc20909230021g415a45d5gfcb52f1772f0c7e9@mail.gmail.com> Date: Wed, 23 Sep 2009 10:28:19 +0300 Message-ID: <77938bc20909230028l165b4312g137188be23c7bbd3@mail.gmail.com> Subject: Re: RandomAccessFile with HDFS From: Stas Oskin To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=00151747868eb39aff047439a8ca X-Virus-Checked: Checked by ClamAV on apache.org --00151747868eb39aff047439a8ca Content-Type: text/plain; charset=ISO-8859-1 By the way, something that I forgot to ask before: Will the append implementation be as fast, as the write/copy functions? Regards. 2009/9/23 Stas Oskin > Thanks, I exactly wanted to ask this for our R&D roadmap. > > 2009/9/23 Aaron Kimball > > Or maybe more pessimistically, the second "stable" append implementation. >> >> It's not like HADOOP-1700 wasn't intended to work. It was just found not >> to >> after the fact. Hopefully this reimplementation will succeed. If you're >> running a cluster that contains mission-critical data that cannot tolerate >> corruption or loss, you shouldn't jump on the new-feature bandwagon until >> it's had time to prove itself in the wild. >> >> But yes, we hope that appends will really-truly work in 0.21. >> Experimental/R&D projects should be able to plan on having a working >> append >> function in 0.21. >> >> - Aaron >> >> On Sun, Sep 20, 2009 at 3:58 PM, Stas Oskin wrote: >> >> > Hi. >> > >> > Just to understand the road-map, 0.21 will be the first stable "append" >> > implementation? >> > >> > Regards. >> > >> > 2009/9/20 Owen O'Malley >> > >> > > >> > > On Sep 13, 2009, at 3:08 AM, Stas Oskin wrote: >> > > >> > > Hi. >> > >> >> > >> Any idea when the "append" functionality is expected? >> > >> >> > > >> > > A working append is a blocker on HDFS 0.21.0. >> > > >> > > The code for append is expected to be complete in a few weeks. >> Meanwhile, >> > > the rest of Common, HDFS, and MapReduce have feature-frozen and need >> to >> > be >> > > stabilized and all of the critical bugs fixed. I'd expect the first >> > releases >> > > of 0.21.0 in early November. >> > > >> > > -- Owen >> > > >> > >> > --00151747868eb39aff047439a8ca--