Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of ravikiranmagham@gmail.com
 designates 209.85.128.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACb0Fn5ghAD3JhMMrBTY3sGRBh160W-g_j7=76mFd4Tvv2hYXQ@mail.gmail.com>
References: 
 <CACb0Fn5ghAD3JhMMrBTY3sGRBh160W-g_j7=76mFd4Tvv2hYXQ@mail.gmail.com>
Date: Wed, 28 Aug 2013 08:41:22 +0530
Message-ID: 
 <CAK4spt0nOazyt1x8KZJCfZMJ18zrhKv823Zr7558LvvqMFkTRw@mail.gmail.com>
Subject: Re: Writing multiple tables from reducer
From: Ravi Kiran <ravikiranmagham@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c2a8c01ae72004e4f958f7

--001a11c2a8c01ae72004e4f958f7
Content-Type: text/plain; charset=ISO-8859-1

I have written a blog on this a while ago where I was writing to multiple
tables from my mapper class. You can look into it at
http://bigdatabuzz.wordpress.com/2012/04/24/how-to-write-to-multiple-hbase-tables-in-a-mapreduce-job/

Key things are,
a) job.setOutputFormatClass (MultiTableOutputFormat.class);
b) In your reducer , you would stick with the if else to write to the
corresponding HBase tables.

Thanks
Ravi Magham


On Wed, Aug 28, 2013 at 3:50 AM, jamal sasha <jamalshasha@gmail.com> wrote:

> Hi,
>   I am new to hbase and am trying to achieve the following.
>
> I am reading data from hdfs in mapper and parsing it..
>
> So, in reducer I want my output to write to hbase instead of hdfs
> But here is the thing.
>
> public static class MyTableReducer extends TableReducer<Text, Text,
> ImmutableBytesWritable>  {
>
>  public void reduce(Text key, Iterable<Text> values, Context context)
> throws IOException, InterruptedException {
>  int type = getType(values.toString());
> if (type == 1) // put data to table 1
>  if (type==2) // put data to table 2
>
>
>    }
>  }
>
> How do I do this?
> Thanks
>

--001a11c2a8c01ae72004e4f958f7
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I have written a blog on this a while ago where I was writ=
ing to multiple tables from my mapper class. You can look into it at=A0<a h=
ref=3D"http://bigdatabuzz.wordpress.com/2012/04/24/how-to-write-to-multiple=
-hbase-tables-in-a-mapreduce-job/">http://bigdatabuzz.wordpress.com/2012/04=
/24/how-to-write-to-multiple-hbase-tables-in-a-mapreduce-job/</a><div>
<br></div><div>Key things are,</div><div>a)=A0job.setOutputFormatClass (Mul=
tiTableOutputFormat.class);</div><div>b) In your reducer , you would stick =
with the if else to write to the corresponding HBase tables.</div><div><br>
</div><div>Thanks</div><div>Ravi Magham</div><div><div><br></div><div><br><=
/div></div></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quo=
te">On Wed, Aug 28, 2013 at 3:50 AM, jamal sasha <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:jamalshasha@gmail.com" target=3D"_blank">jamalshasha@gmail.co=
m</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,=A0<div>=A0 I am new to =
hbase and am trying to achieve the following.</div><div><br></div><div>I am=
 reading data from hdfs in mapper and parsing it..</div>
<div><br></div><div>So, in reducer I want my output to write to hbase inste=
ad of hdfs</div>
<div>But here is the thing.</div><div><div><br></div><div>public static cla=
ss MyTableReducer extends TableReducer&lt;Text, Text, ImmutableBytesWritabl=
e&gt; =A0{</div><div><br></div><div><span style=3D"white-space:pre-wrap">		=
</span> <span style=3D"white-space:pre-wrap">	</span>public void reduce(Tex=
t key, Iterable&lt;Text&gt; values, Context context) throws IOException, In=
terruptedException {</div>

<div><span style=3D"white-space:pre-wrap">                            int t=
ype =3D getType(values.toString());</span></div><div><span style=3D"white-s=
pace:pre-wrap">                            if (type =3D=3D 1) // put data t=
o table 1</span></div>

<div><span style=3D"white-space:pre-wrap">                            if (t=
ype=3D=3D2) // put data to table 2</span><span style=3D"white-space:pre-wra=
p">		</span> =A0 =A0<span style=3D"white-space:pre-wrap">		</span></div><di=
v>
<span style=3D"white-space:pre-wrap"><br></span></div><div><span style=3D"w=
hite-space:pre-wrap"><br></span></div><div><span style=3D"white-space:pre-w=
rap">		</span> =A0 <span style=3D"white-space:pre-wrap">	</span>}<br>
</div><div><span style=3D"white-space:pre-wrap">		</span>}</div></div><div>=
<br></div><div>How do I do this?</div><div>Thanks</div></div>
</blockquote></div><br></div>

--001a11c2a8c01ae72004e4f958f7--