Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of userformailinglists@gmail.com
 designates 209.85.214.48 as permitted sender)
Message-ID: <502E4500.3030409@gmail.com>
Date: Fri, 17 Aug 2012 15:20:00 +0200
From: mg <userformailinglists@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:14.0) Gecko/20120714 Thunderbird/14.0
MIME-Version: 1.0
To: user@hadoop.apache.org
Subject: Re: Relevance of mapreduce.* configuration properties for MR V2
References: <502D1FC9.9030704@gmail.com>
 <CAF1+Vs-yasFOdR2Qd1JBp2WjQm79Tzdo6W-SsFvOL4=JV8zDYg@mail.gmail.com>
 <502D2FC4.6020902@gmail.com>
 <CEE13AE7-4BB8-49F1-B333-2FB47B0443F3@hortonworks.com>
In-Reply-To: <CEE13AE7-4BB8-49F1-B333-2FB47B0443F3@hortonworks.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Thanks again, that helps a lot.

Additionally to the properties listed on that page, I found that 
mapreduce.job.reduces limits the number of reduce tasks per job (as with 
MR V1)

Cheers
Martin

On 16.08.2012 20:42, Arun C Murthy wrote:
> http://hadoop.apache.org/common/docs/r2.0.0-alpha/hadoop-yarn/hadoop-yarn-site/ClusterSetup.html
>
> On Aug 16, 2012, at 10:37 AM, mg wrote:
>
>> Hi,
>>
>> thanks.
>>
>> But there are many more mapreduce.* properties. ...
>>
>> Does anyone have more information on those with respect to whether
>> they are relevant to YARN, and if so, what they exactly mean in the
>> YARN context?
>>
>> I am trying to optimize settings in order to use as much RAM and CPU
>> as possible. The cluster has 8 node managers each with 96GB RAM and 16
>> CPUs (cpuinfo: Intel(R) Xeon(R) CPU E @ 2.40GHz)
>>
>> Cheers,
>> Martin
>>
>> On 16.08.2012 18:40, anil gupta wrote:
>>> Hi,
>>>
>>> AFAIK, these properties are being ignored by YARN:
>>> - mapreduce.tasktracker.map.tasks.maximum,
>>> - mapreduce.tasktracker.reduce.tasks.maximum
>>>
>>> Thanks,
>>> Anil Gupta
>>>
>>>
>>> On Thu, Aug 16, 2012 at 9:28 AM, mg <userformailinglists@gmail.com
>>> <mailto:userformailinglists@gmail.com>> wrote:
>>>
>>>    Hi,
>>>
>>>    I am currently trying to tune a CDH 4.0.1 (i~ hadoop 2.0.0-alpha)
>>>    cluster running HDFS, YARN, and HBase managed by Cloudera Manager
>>>    4.0.3 (Free Edition).
>>>
>>>
>>>    In CM, there are a number of options for setting mapreduce.*
>>>    configuration properties on the YARN client page.
>>>
>>>    Some of the properties and their explanations in the GUI still refer
>>>    to JobTracker and TaskTracker, e.g.,
>>>
>>>    - mapreduce.jobtracker.handler.__count,
>>>    - mapreduce.tasktracker.map.__tasks.maximum,
>>>    - mapreduce.tasktracker.reduce.__tasks.maximum
>>>
>>>    I wonder whether these and a number of other mapreduce.* (e.g.,
>>>    mapreduce.job.reduces) properties are observed by the MR2
>>>    ApplicationMaster (and how), or not.
>>>
>>>
>>>    Can anyone clarify or point to respective documentation?
>>>
>>>    Thanks,
>>>    Martin
>>>
>>>
>>>
>>>
>>> --
>>> Thanks & Regards,
>>> Anil Gupta
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>