Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.219.46 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <B74B81D0-30A8-4CD0-8CBB-9336488AF7AA@gmail.com>
References: <B74B81D0-30A8-4CD0-8CBB-9336488AF7AA@gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 1 Aug 2014 03:30:00 +0530
Message-ID: 
 <CAOcnVr2HPfhJSiGAX1iEDkpaTh-L0UaQmeKbXQf8x36Y+FH4YA@mail.gmail.com>
Subject: Re: Ideal number of mappers and reducers to increase performance
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=UTF-8

You can perhaps start with a generic 4+4 configuration (which matches
your cores), and tune your way upwards or downwards from there based
on your results.

On Thu, Jul 31, 2014 at 8:35 PM, Sindhu Hosamane <sindhuht@gmail.com> wrote:
> Hello friends ,
>
> If i am running my experiment on a server with 2 processors (4 cores each ) .
> To say it has 2 processors and 8 cores .
> What would be the ideal values for mapred.tasktracker.map.tasks.maximum  and mapred.tasktracker.reduce.tasks.maximum to get maximum performance.
> I am running cascalog queries on data of size 280 MB.
> I have multiple datanodes running on same machine.
>
> Your help is very much appreciated.
>
>
> Regards,
> sindhu
>


-- 
Harsh J