Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of smarty.juice@gmail.com
 designates 209.85.214.182 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALGZSrCmyRPsQvuKjmOK3wFgFzPyPd7aBvc+okLR7ZUn4_jx_w@mail.gmail.com>
References: 
 <CALGZSrCyF0S0ceSP4uveYGBJr7x0AW3WcyA55ZGnVi5n=YSK5A@mail.gmail.com>
	<CALGZSrCmyRPsQvuKjmOK3wFgFzPyPd7aBvc+okLR7ZUn4_jx_w@mail.gmail.com>
Date: Mon, 6 Jan 2014 14:06:11 -0500
Message-ID: 
 <CAMOW4CNTHM+6DTq0Rz5DZGhpmngVf9wyWGDUx+qWGsmE5rXD=g@mail.gmail.com>
Subject: Re: Fine tunning
From: Hardik Pandya <smarty.juice@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c1d6a8fa665404ef51f36e

--001a11c1d6a8fa665404ef51f36e
Content-Type: text/plain; charset=ISO-8859-1

Can you please share how you are doing the lookup?


On Mon, Jan 6, 2014 at 4:23 AM, Ranjini Rathinam <ranjinibecse@gmail.com>wrote:

> Hi,
>
> I have a input File of 16 fields in it.
>
> Using Mapreduce code need to load the hbase tables.
>
> The first eight has to go into one table in hbase and last eight has to
> got to another hbase table.
>
> The data is being loaded into hbase table in 0.11 sec , but if any lookup
> is being added in the mapreduce code,
> For eg, the input file has one  attribute named currency , it will have a
> master table currency. need to match both values to print it.
>
> The table which has lookup takes long time to get load. For 13250 records
> it take 59 mins.
>
> How to make fine tune to reduce the time for its loading.
>
> Please help.
>
> Thanks in advance.
>
> Ranjini.R
>
>
>

--001a11c1d6a8fa665404ef51f36e
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Can you please share how you are doing the lookup?<div><br=
></div><div><br></div></div><div class=3D"gmail_extra"><br><br><div class=
=3D"gmail_quote">On Mon, Jan 6, 2014 at 4:23 AM, Ranjini Rathinam <span dir=
=3D"ltr">&lt;<a href=3D"mailto:ranjinibecse@gmail.com" target=3D"_blank">ra=
njinibecse@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div class=3D"gmail_quote">
<div>Hi,</div>
<div>=A0</div>
<div>I have a input File of 16 fields in it.</div>
<div>=A0</div>
<div>Using Mapreduce code need to load the hbase tables.</div>
<div>=A0</div>
<div>The first eight has to go into one table in hbase and last eight has t=
o got to another hbase table.</div>
<div>=A0</div>
<div>The data is being loaded into hbase table in 0.11 sec , but if any loo=
kup is being added in the mapreduce code,</div>
<div>For eg, the input file has=A0one =A0attribute=A0named currency , it wi=
ll have a master table currency. need to match both values to print it.</di=
v>
<div>=A0</div>
<div>The table which has lookup takes long time to get load. For 13250 reco=
rds it take 59 mins.</div>
<div>=A0</div>
<div>How to make fine tune to reduce the time for its loading.</div>
<div>=A0</div>
<div>Please help.</div>
<div>=A0</div>
<div>Thanks in advance.</div>
<div>=A0</div>
<div>Ranjini.R</div>
<div>=A0</div></div><br>
</blockquote></div><br></div>

--001a11c1d6a8fa665404ef51f36e--