hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Ideal number of mappers and reducers to increase performance
Date Thu, 31 Jul 2014 22:00:00 GMT
You can perhaps start with a generic 4+4 configuration (which matches
your cores), and tune your way upwards or downwards from there based
on your results.

On Thu, Jul 31, 2014 at 8:35 PM, Sindhu Hosamane <sindhuht@gmail.com> wrote:
> Hello friends ,
>
> If i am running my experiment on a server with 2 processors (4 cores each ) .
> To say it has 2 processors and 8 cores .
> What would be the ideal values for mapred.tasktracker.map.tasks.maximum  and mapred.tasktracker.reduce.tasks.maximum
to get maximum performance.
> I am running cascalog queries on data of size 280 MB.
> I have multiple datanodes running on same machine.
>
> Your help is very much appreciated.
>
>
> Regards,
> sindhu
>



-- 
Harsh J

Mime
View raw message