Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of dechouxb@gmail.com designates
 209.85.216.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAM5c4o9Twy1NfVcmd6DnENiYOJc-_9QbV-LnH_+Jr-_HpjwA_A@mail.gmail.com>
References: 
 <CAHNTFm+RpV40tE2qHyJLEWQC1_fja8-7gGbbzedva8T44NiQdQ@mail.gmail.com>
	<CAM5c4o9Twy1NfVcmd6DnENiYOJc-_9QbV-LnH_+Jr-_HpjwA_A@mail.gmail.com>
Date: Tue, 25 Sep 2012 09:18:37 +0200
Message-ID: 
 <CAO6W-2cQ=qX4E_4TOnU3Q_z=yzHSmhbUKtRboGVrZo12vkZ_sQ@mail.gmail.com>
Subject: Re: Simple way to unit test HBase Map reduce jobs?
From: Bertrand Dechoux <dechouxb@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=20cf3074d57ccc0ed304ca818343

--20cf3074d57ccc0ed304ca818343
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

"Apache MRUnit =99 is a Java library that helps developers unit test Apache
Hadoop map reduce jobs."

That is every kind of mapper and reducer can be tested with it. That is to
say, there is no specific support of HBase.
If you can manage by yourself to provide the key/value that you should
received from HBase, MRUnit is the right tool for testing the logic that
should work on these data.
With MRUnit, you will can write fine grained unit tests.

There is currently no stable support of miniCluster. If there is a
mishandling of data (like using a shared static variable), it may not show
with MRunit.

I am curious about the 'miniserver'. That's an equivalent of miniCluster
but for hbase processes/daemons? Or was that your question? It could indeed
be very useful for local integration test.

Regards

Bertrand

On Tue, Sep 25, 2012 at 8:55 AM, Eugeny Morozov
<emorozov@griddynamics.com>wrote:

> Hi, Elazar,
>
> I've found that MRUnit is pretty convenient way to test MR jobs.
> On the other hand there is HBaseTestingUtility, which is helpful to run
> miniCluster.
>
> Hope this helps.
>
> On Mon, Sep 24, 2012 at 8:43 PM, Elazar Leibovich <elazarl@gmail.com>
> wrote:
>
> > Is there a way similar to miniserver to test map reduce jobs on somethi=
ng
> > similar to miniCluster?
> >
>
>
>
> --
> Evgeny Morozov
> Developer Grid Dynamics
> Skype: morozov.evgeny
> www.griddynamics.com
> emorozov@griddynamics.com
>


--=20
Bertrand Dechoux

--20cf3074d57ccc0ed304ca818343--