hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: Update on hadoop-0.23
Date Tue, 27 Sep 2011 19:56:38 GMT
Hi all,

Just an update from the HBase side: I've run some cluster tests on
HDFS 0.23 (as of about a month ago) and it generally works well.
Performance for some workloads is ~2x due to HDFS-941, and can be
improved a bit more if I finish HDFS-2080 in time. I did not do
extensive failure testing (to stress the new append/sync code) but I
do plan to do that in the coming months.

HBase trunk can compile against 0.23 by using -Dhadoop23 on the maven
build. Currently some 15 or so tests are failing - the following HBase
JIRA tracks those issues:

(these may be indicative of HDFS side bugs)

Any help there from the community would be appreciated!


On Tue, Sep 27, 2011 at 12:24 PM, Roman Shaposhnik <rvs@apache.org> wrote:
> Hi Arun!
> Thanks for the quick reply!
> I'm sorry if I had too many questions in my original email, but I can't find
> an answer to my "integration tests" question. Could you, please, share
> a URL with us where I can find out more about them?
> On Mon, Sep 26, 2011 at 11:20 PM, Arun C Murthy <acm@hortonworks.com> wrote:
>> # We made changes to Pig - rather we got help from the Pig team, particularly Daniel.
>> So, we plan to work through the rest of the stack - Hive, Oozie etc. very soon and
>> depend on updated releases from the individual projects.
> Do we have any kinds of commitment from downstream projects as far as those
> updates are concerned? Are they targeting these changes as part of point (patch)
> release of an already released version (like Pig 0.9.X for example) or
> will it be
> part of a brand new major release?
> Thanks,
> Roman.

Todd Lipcon
Software Engineer, Cloudera

View raw message