hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: HFileOutputFormat2 with Table, which method?
Date Wed, 29 Apr 2015 00:56:42 GMT
Thanks Ted. I will use that.

JM

2015-04-28 20:28 GMT-04:00 Ted Yu <yuzhihong@gmail.com>:

> Looking at the usage of the second configureIncrementalLoad() in Import and
> ImportTsv, e.g., regionLocator is obtained from connection:
>
>           RegionLocator regionLocator = conn.getRegionLocator(tableName)){
>
> ...
>
>         HFileOutputFormat2.configureIncrementalLoad(job,
> table.getTableDescriptor(), regionLocator);
>
>
> Cheers
>
> On Tue, Apr 28, 2015 at 3:57 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi all,
> >
> > To initialize MR jobs with HFileOutputFormat2 we need to call
> > configureIncrementalLoad
> >
> > There is one with (Job, HTable) which is deprecated.
> > There is one with (Job, Table, RegionLocator) which is not.
> >
> > However, I have found only HTable to implements RegionLocator. So 2nd
> > method can not be call too.
> >
> > There is only configureIncrementalLoadMap(Job job, Table table) that we
> can
> > call, but it's not doing all what configureIncrementalLoad is doing.
> >
> > So should we flag the 2 other configureIncrementalLoad methods deprecated
> > and create a new one? Or should we make Table to implement RegionLocator?
> >
> > Or should HFileOutputFormat2 not be used anymore with HBase 1.0.1?
> >
> > Thanks,
> >
> > JM
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message