Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of xieliang@xiaomi.com
 designates 58.68.235.87 as permitted sender)
From: =?gb2312?B?0LvBvA==?= <xieliang@xiaomi.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Subject: 
 =?gb2312?B?tPC4tDogT09NL2NyYXNoZXMgZHVlIHRvIHByb2Nlc3MgbnVtYmVyIGxpbWl0?=
Thread-Topic: OOM/crashes due to process number limit
Thread-Index: AQHNrTwoaOd2PusfhUGObqscMOnCLZfABLqZ
Date: Fri, 19 Oct 2012 04:10:48 +0000
Message-ID: <DA8340397F7BAE41B8102757834CEB120F530F98@EX-MBOX2.xiaomi.net>
References: 
 <CA+5SmTUnVBTM9+L4A6R8whajMBy8=mkbQ7VBf=v2sDFKziYrNA@mail.gmail.com>
In-Reply-To: 
 <CA+5SmTUnVBTM9+L4A6R8whajMBy8=mkbQ7VBf=v2sDFKziYrNA@mail.gmail.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
Content-Type: multipart/alternative;
	boundary="_000_DA8340397F7BAE41B8102757834CEB120F530F98EXMBOX2xiaomine_"
MIME-Version: 1.0

--_000_DA8340397F7BAE41B8102757834CEB120F530F98EXMBOX2xiaomine_
Content-Type: text/plain; charset="gb2312"
Content-Transfer-Encoding: base64

d2hhdCdzIHRoZSBleGFjdGx5IE9PTSBlcnJvciBtZXNzYWdlLCBpcyBpdCBzdGggbGlrZSAiT3V0
T2ZNZW1vcnlFcnJvcjogdW5hYmxlIHRvIGNyZWF0ZSBuZXcgbmF0aXZlIHRocmVhZCIgPw0KX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCreivP7IyzogQWlkZW4gQmVsbCBbYWlkZW40
NDlAZ21haWwuY29tXQ0Kt6LLzcqxvOQ6IDIwMTLE6jEw1MIxOMjVIDIyOjI0DQrK1bz+yMs6IHVz
ZXJAaGFkb29wLmFwYWNoZS5vcmcNCtb3zOI6IE9PTS9jcmFzaGVzIGR1ZSB0byBwcm9jZXNzIG51
bWJlciBsaW1pdA0KDQpIaSBBbGwsDQoNCkltIHJ1bm5pbmcgcXVpdGUgYSBiYXNpYyBtYXAvcmVk
dWNlIGpvYiB3aXRoIDEwIG9yIHNvIG1hcCB0YXNrcy4gRHVyaW5nIHRoZSB0YXNrJ3MgZXhlY3V0
aW9uLCB0aGUNCmVudGlyZSBzdGFjayAoYW5kIG15IE9TIGZvciB0aGF0IG1hdHRlcikgc3RhcnQg
ZmFpbGluZyBkdWUgdG8gYmVpbmcgdW5hYmxlIHRvIGZvcmsoKSBuZXcgcHJvY2Vzc2VzLg0KSXQg
c2VlbXMgSGFkb29wICgxLjAuMykgaXMgY3JlYXRpbmcgNzAwKyB0aHJlYWRzIGFuZCBleGhhdXN0
aW5nIHRoaXMgcmVzb3VyY2UuIFJBTSB1dGlsaXNhdGlvbiBpcyBmaW5lIGhvd2V2ZXIuDQpUaGlz
IHN0aWxsIG9jY3VycyB3aXRoIHVsaW1pdCBzZXQgdG8gdW5saW1pdGVkLg0KDQpBbnkgaWRlYXMg
b3IgYWR2aWNlIHdvdWxkIGJlIGdyZWF0LCBpdCBzZWVtcyB2ZXJ5IHNrZXRjaHkgZm9yIGEgdGFz
ayB0aGF0IGRvZXNuJ3QgcmVxdWlyZSBtdWNoIGdydW50Lg0KDQpDaGVlcnMhDQoNCg==

--_000_DA8340397F7BAE41B8102757834CEB120F530F98EXMBOX2xiaomine_
Content-Type: text/html; charset="gb2312"
Content-Transfer-Encoding: quoted-printable

<html dir=3D"ltr">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dgb2312">
<style id=3D"owaParaStyle" type=3D"text/css">P {margin-top:0;margin-bottom:=
0;}</style>
</head>
<body ocsi=3D"0" fpstyle=3D"1">
<div style=3D"direction: ltr;font-family: Tahoma;color: #000000;font-size: =
10pt;">what's the exactly OOM error message, is it sth like &quot;OutOfMemo=
ryError: unable to create new native thread&quot; ?<br>
<div style=3D"font-family: Times New Roman; color: rgb(0, 0, 0); font-size:=
 16px;">
<hr tabindex=3D"-1">
<div style=3D"direction: ltr;" id=3D"divRpF248567"><font color=3D"#000000" =
face=3D"Tahoma" size=3D"2"><b>=B7=A2=BC=FE=C8=CB:</b> Aiden Bell [aiden449@=
gmail.com]<br>
<b>=B7=A2=CB=CD=CA=B1=BC=E4:</b> 2012=C4=EA10=D4=C218=C8=D5 22:24<br>
<b>=CA=D5=BC=FE=C8=CB:</b> user@hadoop.apache.org<br>
<b>=D6=F7=CC=E2:</b> OOM/crashes due to process number limit<br>
</font><br>
</div>
<div></div>
<div>Hi All,<br>
<br>
Im running quite a basic map/reduce job with 10 or so map tasks. During the=
 task's execution, the<br>
entire stack (and my OS for that matter) start failing due to being unable =
to fork() new processes.<br>
It seems Hadoop (1.0.3) is creating 700&#43; threads and exhausting this re=
source. RAM utilisation is fine however.<br>
This still occurs with ulimit set to unlimited.<br>
<br>
Any ideas or advice would be great, it seems very sketchy for a task that d=
oesn't require much grunt.<br>
<br>
Cheers!<br clear=3D"all">
<br>
</div>
</div>
</div>
</body>
</html>

--_000_DA8340397F7BAE41B8102757834CEB120F530F98EXMBOX2xiaomine_--