Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of acm@hortonworks.com
 designates 209.85.220.50 as permitted sender)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\))
Subject: Re: How is the memory usage of containers controlled?
From: Arun C Murthy <acm@hortonworks.com>
In-Reply-To: <51C4B7C9.3030509@gmail.com>
Date: Fri, 21 Jun 2013 13:50:49 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <9D440623-759D-4564-9A17-59C12C424E7F@hortonworks.com>
References: <51C0B53A.5090500@gmail.com>
 <2A852BE6-D4F0-409D-B6C2-BAE2310986E9@hortonworks.com>
 <51C4B7C9.3030509@gmail.com>
To: user@hadoop.apache.org

Start with LinuxResourceCalculatorPlugin.

Arun

On Jun 21, 2013, at 1:30 PM, Yuzhang Han <yuzhanghan1982@gmail.com> =
wrote:

> Thank you Arun.
>=20
> I am trying to study how YARN works. Can someone tell me which =
class(es) monitors containers w.r.t. memory usage?
>=20
>=20
> On 6/18/2013 4:07 PM, Arun C Murthy wrote:
>> NodeManagers monitor containers w.r.t memory usage, and put =
containers in cgroups with cpu limits to restrict CPU usage.
>>=20
>> On Jun 18, 2013, at 12:30 PM, Yuzhang Han <yuzhanghan1982@gmail.com> =
wrote:
>>=20
>>> Hi,
>>> I am curious about how YARN containers control their memory usage. =
Say, I have a MR job, and I configure that every map task should be =
assigned a 1 GB container, and every reduce task a 1.5 GB one. So, when =
YARN runs the containers, how is it ensured that all map containers use =
less than 1 GB memory and all reduce containers less than 1.5 GB? Is =
container memory control realized via -Xmx arguments in the scripts =
generated by YARN to invoke the MR program in the containers?
>>>=20
>>> Thank you.
>>=20
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>=20
>>=20
>=20

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/