Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 3254 invoked from network); 7 May 2010 17:58:38 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 May 2010 17:58:38 -0000 Received: (qmail 26056 invoked by uid 500); 7 May 2010 17:58:37 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 26008 invoked by uid 500); 7 May 2010 17:58:37 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 26000 invoked by uid 99); 7 May 2010 17:58:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 May 2010 17:58:37 +0000 X-ASF-Spam-Status: No, hits=2.9 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 May 2010 17:58:30 +0000 Received: by gyf1 with SMTP id 1so933352gyf.35 for ; Fri, 07 May 2010 10:58:09 -0700 (PDT) Received: by 10.231.190.5 with SMTP id dg5mr155711ibb.44.1273255089593; Fri, 07 May 2010 10:58:09 -0700 (PDT) MIME-Version: 1.0 Received: by 10.231.160.70 with HTTP; Fri, 7 May 2010 10:57:48 -0700 (PDT) In-Reply-To: References: From: Todd Lipcon Date: Fri, 7 May 2010 10:57:48 -0700 Message-ID: Subject: Re: Hadoop support for hbase To: general@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016367b6be852dc9b048604cda4 X-Virus-Checked: Checked by ClamAV on apache.org --0016367b6be852dc9b048604cda4 Content-Type: text/plain; charset=ISO-8859-1 I have a few questions about this proposal: 1) Will we open new JIRAs separately for each change we want to commit, and go through the normal review process? Currently the 20-append work has been mostly going on under HDFS-142 for whatever reason, with ancillary issues only for bugs that also exist in trunk. 2) Do we plan to do a release off the branch, or is it meant only as a repository for sharing patches and a tree? 3) If we do a release, what version number would we give it and how would it be presented on the download/release pages? I'm certainly not against the idea, just would like to open discussion on the above points. The other alternative as I see it is to have those working on this branch do so somewhere like github - the advantages to that would be (a) it provides a more open way for non-committers to contribute, which is important since we're working closely with the HBase team on this, and (b) it doesn't add confusion to the main Hadoop jira and download pages. The disadvantage of course is that it fragments the code repository and we can't really do a release as easily. Thanks -Todd On Fri, May 7, 2010 at 10:34 AM, Dhruba Borthakur wrote: > Hi folks, > > I would like to open a discussion on how we can make HBase work well with a > supported/released version of Hadoop. HBase currently ships with a hadoop > jar and that hadoop jar is from hadoop 0.20 + a set of ten/twenty patches. > Most of these patches are focussed on HDFS append support in hadoop 0.20. > These cannot be ported back to the 0.20 branch without affecting stability > of the hadoop 0.20 branch. On the other hand, it is premature for hbase > deployments to use hadoop 0.21 because hadoop 0.21 is still under testing > and will take some time to stabilize. > > My proposal is to create a new branch off the hadoop 0.20 branch and name > it branch-0.20-hbase. It will have support for append/sync and will be API > compatible with the hadoop 0.20 branch. However, this branch will be marked > "experimental" and API compatibility is subject to change. This branch will > contain all of hdfs/mapreduce/core. > > If the community likes this idea, I will volunteer myself to be the release > manager for this new branch and will propose a formal vote. > > comments/feedback/questions are most welcome. > dhruba > > > -- > Connect to me at http://www.facebook.com/dhruba > -- Todd Lipcon Software Engineer, Cloudera --0016367b6be852dc9b048604cda4--