Return-Path: 
 <user-return-13016-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 9D48810470
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Mon,  6 Jan 2014 09:24:58 +0000 (UTC)
Received: (qmail 65784 invoked by uid 500); 6 Jan 2014 09:24:28 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 65649 invoked by uid 500); 6 Jan 2014 09:24:16 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 65621 invoked by uid 99); 6 Jan 2014 09:24:12 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jan 2014 09:24:12 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ranjinibecse@gmail.com
 designates 209.85.217.179 as permitted sender)
Received: from [209.85.217.179] (HELO mail-lb0-f179.google.com)
 (209.85.217.179)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jan 2014 09:24:07 +0000
Received: by mail-lb0-f179.google.com with SMTP id w7so9773208lbi.10
        for <user@hadoop.apache.org>; Mon, 06 Jan 2014 01:23:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=agEZbx2bRiz7+tIQl2ALSBnnTLujjDvHnCkFzTuqGCA=;
        b=eAGpPwlL/ldsuo59rqJmDDSbPElcvLI8nFwy0GnoSrL0eDENwKkb7eYEBPhDu3WgHD
         REhcokpZM6/vHHAbbb8GyMCs1W1MikLslw/tRzS7Fdu25s7DViOWO8v4LK2M44ZM07lO
         t+MUhNf6mR8w9QBDhKAcUhMXRhJkx2YlGA7YthXGXUjc2W8AY9oMcvLfmXtu/agyXmbO
         +IUOhugRFHDSPnDbDUThLgSmB0xdnKkOOMRMcezFzEpZG6aVlIPnbfKVgXRJzBqsuaLm
         L4HbrPGsF35i782wsSLfGRPjNFVKag/ktRfA7IvuFxbxeuy0C2+y1fEeMWxazxd9vyrH
         CNDw==
MIME-Version: 1.0
X-Received: by 10.152.19.65 with SMTP id c1mr256541lae.49.1389000226098; Mon,
 06 Jan 2014 01:23:46 -0800 (PST)
Received: by 10.152.131.165 with HTTP; Mon, 6 Jan 2014 01:23:46 -0800 (PST)
In-Reply-To: 
 <CALGZSrCyF0S0ceSP4uveYGBJr7x0AW3WcyA55ZGnVi5n=YSK5A@mail.gmail.com>
References: 
 <CALGZSrCyF0S0ceSP4uveYGBJr7x0AW3WcyA55ZGnVi5n=YSK5A@mail.gmail.com>
Date: Mon, 6 Jan 2014 14:53:46 +0530
Message-ID: 
 <CALGZSrCmyRPsQvuKjmOK3wFgFzPyPd7aBvc+okLR7ZUn4_jx_w@mail.gmail.com>
Subject: Fine tunning
From: Ranjini Rathinam <ranjinibecse@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e0149430811d1e904ef49d165
X-Virus-Checked: Checked by ClamAV on apache.org

--089e0149430811d1e904ef49d165
Content-Type: text/plain; charset=ISO-8859-1

 Hi,

I have a input File of 16 fields in it.

Using Mapreduce code need to load the hbase tables.

The first eight has to go into one table in hbase and last eight has to got
to another hbase table.

The data is being loaded into hbase table in 0.11 sec , but if any lookup
is being added in the mapreduce code,
For eg, the input file has one  attribute named currency , it will have a
master table currency. need to match both values to print it.

The table which has lookup takes long time to get load. For 13250 records
it take 59 mins.

How to make fine tune to reduce the time for its loading.

Please help.

Thanks in advance.

Ranjini.R

--089e0149430811d1e904ef49d165
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div class=3D"gmail_quote">
<div>Hi,</div>
<div>=A0</div>
<div>I have a input File of 16 fields in it.</div>
<div>=A0</div>
<div>Using Mapreduce code need to load the hbase tables.</div>
<div>=A0</div>
<div>The first eight has to go into one table in hbase and last eight has t=
o got to another hbase table.</div>
<div>=A0</div>
<div>The data is being loaded into hbase table in 0.11 sec , but if any loo=
kup is being added in the mapreduce code,</div>
<div>For eg, the input file has=A0one =A0attribute=A0named currency , it wi=
ll have a master table currency. need to match both values to print it.</di=
v>
<div>=A0</div>
<div>The table which has lookup takes long time to get load. For 13250 reco=
rds it take 59 mins.</div>
<div>=A0</div>
<div>How to make fine tune to reduce the time for its loading.</div>
<div>=A0</div>
<div>Please help.</div>
<div>=A0</div>
<div>Thanks in advance.</div>
<div>=A0</div>
<div>Ranjini.R</div>
<div>=A0</div></div><br>

--089e0149430811d1e904ef49d165--