hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tao Xiao <xiaotao.cs....@gmail.com>
Subject Re: System ulimit for hadoop jobtracker node
Date Wed, 18 Dec 2013 02:28:53 GMT
set the following contents in /etc/security/limits.d/90-nproc.conf

hadoop-user          soft     nproc     32000
hadoop-user          hard    nproc     32000
hadoop-user          soft     nofile     65535
hadoop-user          hard    nofile     65535


2013/12/18 Viswanathan J <jayamviswanathan@gmail.com>

> Hi,
>
> I have the ulimit of 999999, should be a problem? If yes what prob will
> arise?
> On Dec 18, 2013 12:05 AM, "rtejac" <rtejac@gmail.com> wrote:
>
>> Depends on various factors like number of users, number of tasks like
>> size of MR jobs etc..  32K-64K is a safe bet. 128K is a bad number, but
>> shouldn't harm.
>>
>> On Dec 17, 2013, at 9:10 AM, Viswanathan J <jayamviswanathan@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> What value(ulimit) will be fair enough for jobtracker node. If it's too
>> high will that cause thread block or any issue in jobtracker.
>>
>> Please help.
>>
>>
>>

Mime
View raw message