hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sindhu hosamane <sindh...@gmail.com>
Subject Re: Ideal number of mappers and reducers to increase performance
Date Fri, 01 Aug 2014 10:36:26 GMT
Thanks a ton  for ur help Harsh . I am a newbie in hadoop.
If i have set
mapred.tasktracker.map.tasks.maximum  = 4
mapred.tasktracker.reduce.tasks.maximum = 4
Should i also bother or set below values
mapred.map.Tasks and mapred.reduce.Tasks .
If yes then what is the ideal value?





On Fri, Aug 1, 2014 at 12:00 AM, Harsh J <harsh@cloudera.com> wrote:

> You can perhaps start with a generic 4+4 configuration (which matches
> your cores), and tune your way upwards or downwards from there based
> on your results.
>
> On Thu, Jul 31, 2014 at 8:35 PM, Sindhu Hosamane <sindhuht@gmail.com>
> wrote:
> > Hello friends ,
> >
> > If i am running my experiment on a server with 2 processors (4 cores
> each ) .
> > To say it has 2 processors and 8 cores .
> > What would be the ideal values for mapred.tasktracker.map.tasks.maximum
>  and mapred.tasktracker.reduce.tasks.maximum to get maximum performance.
> > I am running cascalog queries on data of size 280 MB.
> > I have multiple datanodes running on same machine.
> >
> > Your help is very much appreciated.
> >
> >
> > Regards,
> > sindhu
> >
>
>
>
> --
> Harsh J
>

Mime
View raw message