hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Zhang <zjf...@gmail.com>
Subject Re: Number of Mappers
Date Wed, 15 Sep 2010 01:22:22 GMT
Hi Rahul,

You can not determined set the mapper number as reducer number. The
mapper number is determined by the your InputFormat. If you are using
PigStorage, then the InputFormat is PigTextInputFormat which is a
subclass of TextInputFormat. You can refer TextInputFormat.getSplits()
to see how it split the input.

On Wed, Sep 15, 2010 at 1:24 AM, Rahul Malviya <rmalviya@apple.com> wrote:
> Hi
> I am using Pig jobs to run on Hadoop but always it runs 4 mappers simultaneously.
> How can I increase the number of simultaneous mappers to run ?
> What config do I have to change ?
> Thanks,
> Rahul

Best Regards

Jeff Zhang

View raw message