hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ferdy Galema <ferdy.gal...@kalooga.com>
Subject Re: HBase MapReduce - Using mutiple tables as source
Date Mon, 06 Aug 2012 14:38:13 GMT
Hi,

Perhaps you want to take a look at MultipleInputs. I'm not sure if it works
for TableInputFormat, but at least you can use it for inspiration.

Ferdy.

On Mon, Aug 6, 2012 at 3:02 PM, Amlan Roy <amlan.roy@cleartrip.com> wrote:

> Hi,
>
> If TableMapper and TableMapReduceUtil.initTableMapperJob() does not support
> multiple tables as input, can I use Hadoop Mapper/Reducer classes and
> specify the the input/output format myself?
>
> What I want to do is, I want to read two tables in the map phase and want
> to
> reduce them together. What is the best solution available in 0.92.0 (I
> understand the best solution is coming in version 0.96.0).
>
> Regards,
> Amlan
>
> -----Original Message-----
> From: Ioakim Perros [mailto:imperros@gmail.com]
> Sent: Monday, August 06, 2012 5:11 PM
> To: user@hbase.apache.org
> Subject: Re: HBase MapReduce - Using mutiple tables as source
>
> Hi,
>
> Isn't that the case that you can always initiate a scanner inside a map
> job (referring to another table from which had been set into the
> configuration of TableMapReduceUtil.initTableMapperJob(...) ) ?
>
> Hope this serves as temporary solution.
>
> On 08/06/2012 02:35 PM, Mohammad Tariq wrote:
> > Hello Amlan,
> >
> >      Issue is still unresolved...Will get fixed in 0.96.0.
> >
> > Regards,
> >      Mohammad Tariq
> >
> >
> > On Mon, Aug 6, 2012 at 5:01 PM, Amlan Roy <amlan.roy@cleartrip.com>
> wrote:
> >> Hi,
> >>
> >>
> >>
> >> While writing a MapReduce job for HBase, can I use multiple tables as
> input?
> >> I think TableMapReduceUtil.initTableMapperJob() takes a single table as
> >> parameter. For my requirement, I want to specify multiple tables and
> scan
> >> instances. I read about MultiTableInputCollection in the document
> >> https://issues.apache.org/jira/browse/HBASE-3996. But I don't find it
> in
> >> HBase-0.92.0.
> >>
> >>
> >>
> >> Regards,
> >>
> >> Amlan
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message