hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ken Krugler <kkrugler_li...@transpac.com>
Subject Setting thread stack size for child JVM
Date Fri, 08 May 2009 18:16:01 GMT
Hi there,

For a very specific type of reduce task, we currently need to use a 
large number of threads.

To avoid running out of memory, I'd like to constrain the Linux stack 
size via a "ulimit -s xxx" shell script command before starting up 
the JVM. I could do this for the entire system at boot time, but it 
would be better to have it for just the Hadoop JVM(s).

Any suggestions for how best to handle this?

Thanks,

-- Ken
-- 
Ken Krugler
+1 530-210-6378

Mime
View raw message