Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@hadoop.apache.org
Received-SPF: pass (nike.apache.org: local policy)
From: "Mattmann, Chris A (388J)" <chris.a.mattmann@jpl.nasa.gov>
To: "general@hadoop.apache.org" <general@hadoop.apache.org>
Date: Thu, 17 Feb 2011 13:52:09 -0800
Subject: Re: [VOTE] Abandon mrunit MapReduce contrib
Thread-Topic: [VOTE] Abandon mrunit MapReduce contrib
Thread-Index: AcvO7O5pLUWIIUuZTh+5q5F8HHyjHw==
Message-ID: <5C5BE47B-6159-4678-8455-219CF1F41863@jpl.nasa.gov>
References: <77405974-6771-4604-926B-976240743F3C@mac.com>
 <AANLkTim80KJ3f14iM6Ltzy7UG613myhN-AiwQ3pCmVdi@mail.gmail.com>
 <AANLkTiknkrWK=GzGMVj4_Z6p5Jn8TQu1P5TkaFSgORJk@mail.gmail.com>
 <AANLkTin0TguLYHi9X0uL3ZF7tCz5xTHBYa7056oKF2Ae@mail.gmail.com>
 <93644D3B-4830-4813-92BE-809738969CF9@apache.org>
 <AANLkTi=dbGSLhtFA+Rf9LgaX05v45HDLoQDE_2C5ULAf@mail.gmail.com>
 <65311075-A30E-4971-A2BA-C75409C6486E@jpl.nasa.gov>
 <AANLkTi=XbpVUmg_TpH7eqEn8w7Gcu9KiwtJmKMLa5w5n@mail.gmail.com>
 <FAE19BAA-47A7-4747-BDD8-5AA42C259EB6@jpl.nasa.gov>
 <AANLkTin2JvOGdZT5g5tmTGeCpD3Qz2soZWcTQtHMsSza@mail.gmail.com>
 <AANLkTi=iGCBrp6+dsK66-+fWF7UoLPSqMOhoNUnjbMHY@mail.gmail.com>
 <AANLkTimXXt3e4fL==fxhU9MJ5v=hPeEa746-3CV4x4Pc@mail.gmail.com>
 <C1C69515-B440-4C3F-9918-9E9767E4804D@jpl.nasa.gov>
 <AANLkTimBS+KLnknfh8hGzF3s3xdqN5fVjEexy3cpXzE7@mail.gmail.com>
In-Reply-To: <AANLkTimBS+KLnknfh8hGzF3s3xdqN5fVjEexy3cpXzE7@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Thanks Patrick.

Sounds good. Besides mentors, we need a champion, who must be an ASF member=
. So, either me, you or Nigel can do it. I'm already championing Gora, and =
would be happy to champion MRUnit, but am open to either one of you guys do=
ing it too (or even another ASF member). Just let me know. I'll head over t=
o the wiki and add my info. Thanks for getting this started Eric+Patrick!

Cheers,
Chris

On Feb 17, 2011, at 1:00 PM, Patrick Hunt wrote:

> Chris a page is up (still being created by Eric afaict):
> http://wiki.apache.org/incubator/MRUnitProposal
>=20
> I took the liberty of listing us as mentors.
>=20
> Patrick
>=20
> On Thu, Feb 17, 2011 at 11:31 AM, Mattmann, Chris A (388J)
> <chris.a.mattmann@jpl.nasa.gov> wrote:
>> Hey Guys,
>>=20
>> FYI on this: Eric has mentioned he is going to start the Incubator propo=
sal for MRUnit. Let's start small and then grow big (as needed). It seems l=
ike we've achieved enough consensus for the required mentors and critical m=
ass to make an MRUnit Incubator proposal and then to have the Incubator com=
munity weigh in. If that expands to include other testing projects/etc., we=
 can address that over the Incubation process, and as needed.
>>=20
>> Eric: as soon as that wiki page is up, I'd be happy to add my name to it=
 as a mentor and /kick the can on this.
>>=20
>> Cheers,
>> Chris
>>=20
>> On Feb 17, 2011, at 11:11 AM, Aaron Kimball wrote:
>>=20
>>> The MRUnit community is a specific subset of the Hadoop community: Engi=
neers
>>> writing Java code running on Hadoop. The Hadoop community also includes
>>> IT/ops staff who maintain Hadoop clusters, data scientists who use tool=
s
>>> such as Pig & Hive, as well as those written by the aforementioned
>>> engineers, etc.
>>>=20
>>> The Hadoop project has long recognized that tools aimed at a specific s=
ubset
>>> of the Hadoop community, with separate release cycles, can more success=
fully
>>> reach their aims by splitting into incubator projects. Hive, Pig, and H=
Base,
>>> for example, have all gone this path.
>>>=20
>>> A "current" version of MRUnit would need to compile against multiple
>>> versions of Hadoop itself. This is not possible if it is in the same so=
urce
>>> tree as Hadoop.
>>>=20
>>> - Aaron
>>>=20
>>> On Thu, Feb 17, 2011 at 5:31 AM, Bernd Fondermann <
>>> bernd.fondermann@googlemail.com> wrote:
>>>=20
>>>> On Fri, Feb 11, 2011 at 23:10, Aaron Kimball <akimball83@gmail.com> wr=
ote:
>>>>> The main reason I am interested in removing MRUnit from Hadoop is tha=
t I
>>>>> believe that MRUnit deserves its own release cycle. I think this is i=
n
>>>> the
>>>>> best interest of its users.
>>>>=20
>>>> Not in mine, at least. (I'm writing MR unit tests.)
>>>> Many projects release more than one product. I'd rather get MRUnit
>>>> from the same source where I get my MR from.
>>>> Separate release cylcles would be ok for me, though.
>>>>=20
>>>>> Perhaps more importantly, access to new features in MRUnit should not
>>>>> require upgrading one's entire Hadoop deployment; this is a client
>>>> library
>>>>> that depends only on Hadoop's public APIs.
>>>>=20
>>>> +1.
>>>>=20
>>>>> My primary concern is to move MRUnit to a place where the community c=
an
>>>>> derive the most benefit from it. The Apache Incubator could fulfill t=
his
>>>>> role; given the presence of individuals willing to mentor this projec=
t, I
>>>>> believe this would be a successful way to release MRUnit more quickly=
 and
>>>>> continue to work to grow the MRUnit community.
>>>>=20
>>>> What are your expectations what MRUnit would become, software-wise?
>>>> Wouldn't the MRUnit community be largely the same as the Hadoop-MR
>>>> community?
>>>>=20
>>>> Bernd
>>>>=20
>>=20
>>=20
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>=20
>>=20


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++