Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of erikholstad@gmail.com
 designates 209.85.132.249 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=a2F532QLgzYNi7xUSf+FhDcMiGubKKqFAOam2Cx2xfZhbArXnuxfFGAtEItG/u6kb1
         t974Ug+bVMTGWziULkwvIlwbURiVeRXxEYJAV94tlh3rcl1yq4R3jQj6JSaDuTEUcSnV
         1ojhuTJ06uyCUbKEZ/tvB3SKPcB11ofNyIKZQ=
MIME-Version: 1.0
In-Reply-To: <32120a6a0906230830t2f23b58h6777d1d0a65e53e7@mail.gmail.com>
References: <24166190.post@talk.nabble.com>
	 <32120a6a0906230830t2f23b58h6777d1d0a65e53e7@mail.gmail.com>
Date: Wed, 24 Jun 2009 09:06:00 -0700
Message-ID: <74f4d40b0906240906yaab4f17pd5a7564e02e8e6cb@mail.gmail.com>
Subject: Re: Map Reduce performance
From: Erik Holstad <erikholstad@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016e6434aae8612ee046d1a4855

--0016e6434aae8612ee046d1a4855
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Hi Ramesh!
Have to agree with Tim about the size of your cluster, I honestly a little
bit surprised that you are actually seeing
that using MR on a single node is faster, since you only get the negative
sides, setup and so on from it, but not
the good stuff.
I looked at the code and it looks good, not really doing to much in the Job,
but I doesn't look like you are doing
anything wrong. I do have some things you can think about thought when you
get a bigger cluster up and running.
1. You might want to stay away from creating Text object, we are internally
trying to move away from all usage of Text in HBase and just use
ImmutableBytesWritable or something like that.
2. Getting a HTable is expensive, so you might want to create a pool of
those connections that you can share so you don't have to get a new one for
every task, not 100% sure about the configure call, but I think it gives you
one per call, might be worth looking into.

Erik

--0016e6434aae8612ee046d1a4855--