hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: Hadoop support for hbase
Date Fri, 07 May 2010 17:57:48 GMT
I have a few questions about this proposal:

1) Will we open new JIRAs separately for each change we want to commit, and
go through the normal review process? Currently the 20-append work has been
mostly going on under HDFS-142 for whatever reason, with ancillary issues
only for bugs that also exist in trunk.
2) Do we plan to do a release off the branch, or is it meant only as a
repository for sharing patches and a tree?
3) If we do a release, what version number would we give it and how would it
be presented on the download/release pages?

I'm certainly not against the idea, just would like to open discussion on
the above points. The other alternative as I see it is to have those working
on this branch do so somewhere like github - the advantages to that would be
(a) it provides a more open way for non-committers to contribute, which is
important since we're working closely with the HBase team on this, and (b)
it doesn't add confusion to the main Hadoop jira and download pages. The
disadvantage of course is that it fragments the code repository and we can't
really do a release as easily.


On Fri, May 7, 2010 at 10:34 AM, Dhruba Borthakur <dhruba@gmail.com> wrote:

> Hi folks,
> I would like to open a discussion on how we can make HBase work well with a
> supported/released version of Hadoop. HBase currently ships with a hadoop
> jar and that hadoop jar is from hadoop 0.20 + a set of ten/twenty patches.
> Most of these patches are focussed on HDFS append support in hadoop 0.20.
> These cannot be ported back to the 0.20 branch without affecting stability
> of the hadoop 0.20 branch. On the other hand, it is premature for hbase
> deployments to use hadoop 0.21 because hadoop 0.21 is still under testing
> and will take some time to stabilize.
> My proposal is to create a new branch off the hadoop 0.20 branch and name
> it branch-0.20-hbase. It will have support for append/sync and will be API
> compatible with the hadoop 0.20 branch. However, this branch will be marked
> "experimental" and API compatibility is subject to change. This branch will
> contain all of hdfs/mapreduce/core.
> If the community likes this idea, I will volunteer myself to be the release
> manager for this new branch and will propose a formal vote.
> comments/feedback/questions are most welcome.
> dhruba
> --
> Connect to me at http://www.facebook.com/dhruba

Todd Lipcon
Software Engineer, Cloudera

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message