hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Subir S <subir.sasiku...@gmail.com>
Subject Re: Bulk load - #Reducers different from #Regions
Date Tue, 07 Aug 2012 16:53:03 GMT
Bulk load using
ImportTsv with pre-splitted regions for target table?

Do u mean to set number of reducers that ImportTsv must use?

On 8/7/12, Ioakim Perros <imperros@gmail.com> wrote:
> HI,
> I am bulk importing (updating) data iteratively and I would like to be
> able to set the number of reducers at a M/R task, to be different from
> the number of regions of the table to which I am updating data.
> I tried it through job.setNumReduceTasks(#reducers), but the job ignored
> it.
> Is there a way to avoid an intermediary job and to set the number of
> reducers explicitly ?
> I would be grateful if anyone could shed a light to this.
> Thanks and regards,
> Ioakim

View raw message