hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xavier Stevens <Xavier.Stev...@fox.com>
Subject RE: Cannot run program "bash": java.io.IOException: error=12, Cannot allocate memory
Date Tue, 18 Nov 2008 22:32:05 GMT
I'm still seeing this problem on a cluster using Hadoop 0.18.2.  I tried
dropping the max number of map tasks per node from 8 to 7.  I still get
the error although it's less frequent.  But I don't get the error at all
when using Hadoop 0.17.2.

Anyone have any suggestions?


-Xavier

-----Original Message-----
From: edward@udanax.org On Behalf Of Edward J. Yoon
Sent: Thursday, October 09, 2008 2:07 AM
To: core-user@hadoop.apache.org
Subject: Re: Cannot run program "bash": java.io.IOException: error=12,
Cannot allocate memory

Thanks Alexander!!

On Thu, Oct 9, 2008 at 4:49 PM, Alexander Aristov
<alexander.aristov@gmail.com> wrote:
> I received such errors when I overloaded data nodes. You may increase 
> swap space or run less tasks.
>
> Alexander
>
> 2008/10/9 Edward J. Yoon <edwardyoon@apache.org>
>
>> Hi,
>>
>> I received below message. Can anyone explain this?
>>
>> 08/10/09 11:53:33 INFO mapred.JobClient: Task Id :
>> task_200810081842_0004_m_000000_0, Status : FAILED
>> java.io.IOException: Cannot run program "bash": java.io.IOException:
>> error=12, Cannot allocate memory
>>        at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
>>        at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
>>        at org.apache.hadoop.util.Shell.run(Shell.java:134)
>>        at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
>>        at
>>
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathF
orWrite(LocalDirAllocator.java:296)
>>        at
>>
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllo
cator.java:124)
>>        at
>>
org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFil
e.java:107)
>>        at
>>
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.ja
va:734)
>>        at
>>
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:694)
>>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:220)
>>        at
>> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124
>> ) Caused by: java.io.IOException: java.io.IOException: error=12, 
>> Cannot allocate memory
>>        at java.lang.UNIXProcess.<init>(UNIXProcess.java:148)
>>        at java.lang.ProcessImpl.start(ProcessImpl.java:65)
>>        at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
>>        ... 10 more
>>
>> --
>> Best regards, Edward J. Yoon
>> edwardyoon@apache.org
>> http://blog.udanax.org
>>
>
>
>
> --
> Best Regards
> Alexander Aristov
>



--
Best regards, Edward J. Yoon
edwardyoon@apache.org
http://blog.udanax.org



Mime
View raw message