hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rottinghuis, Joep" <jrottingh...@ebay.com>
Subject RE: Hadoop testing project [Was: [VOTE] Abandon mrunit MapReduce contrib]
Date Wed, 16 Feb 2011 18:19:21 GMT
Having a coherent approach for system level testing increases confidence in the various Hadoop
releases and and will reduce the effort to take any (set of ) changes from development into
The more automated and formalized system testing, the better!


From: cos@boudnik.org [cos@boudnik.org] On Behalf Of Konstantin Boudnik [cos@apache.org]
Sent: Tuesday, February 15, 2011 1:58 PM
To: general@hadoop.apache.org
Subject: Hadoop testing project [Was: [VOTE] Abandon mrunit MapReduce contrib]

While MrUnit discussion draws to its natural conclusion I would like
to bring up another point which might be well aligned with that
discussion. Patrick Hunt has brought up this idea earlier today and I
believe it has to be elaborated further.

A number of testing projects both for Hadoop and Hadoop-related
component were brought to life over last year or two. Among those are
MRUnit, PigUnit, YCSB, Herriot, and perhaps a few more. They all
focusing on more or less the same problem e.g. validation of Hadoop or
on-top-of-Hadoop components, or application level testing for Hadoop.
However, the fact that they all are spread across a wide variety of
projects seems to confuse/mislead Hadoop users.

How about incubating a bigger Hadoop (Pig, Oozie, HBase) testing
project which will take care about development and support of common
(where's possible) tools, frameworks and the like? Please feel free to
share your thoughts :)
  Take care,
Konstantin (Cos) Boudnik

On Tue, Feb 15, 2011 at 10:44, Eric Sammer <esammer@cloudera.com> wrote:
> I've started the wiki page proposal for Incubator for mrunit. I'll ping
> people off list for mentoring. Much appreciated for all the help!
> On Tue, Feb 15, 2011 at 1:36 PM, Nigel Daley <ndaley@mac.com> wrote:
>> I'm happy to help mentor as well.
>> Cheers,
>> Nige
>> On Feb 11, 2011, at 11:52 AM, Patrick Hunt wrote:
>> > On Fri, Feb 11, 2011 at 9:44 AM, Mattmann, Chris A (388J)
>> > <chris.a.mattmann@jpl.nasa.gov> wrote:
>> >> Guys, BTW, if you need help or a mentor in Apache Incubator-ville for
>> MRUnit, I would be happy to help.
>> >
>> > I was going to suggest the same thing (mrunit to incubator). I would
>> > also be happy to be a mentor.
>> >
>> > Patrick
View raw message