hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dieter De Witte <drdwi...@gmail.com>
Subject Re: Error: Java Heap space
Date Tue, 31 Dec 2013 11:47:13 GMT
Is it happening in map or reduce phase, and are you allocating anything in
your mappers/reducers? For example if you are having a collection in one of
them, this might be causing the heap error. Also what are the specs of your
nodes? How many concurrent map en reduce tasks per tasktracker,... We
cannot help if you give us so little information..


2013/12/31 Ranjini Rathinam <ranjinibecse@gmail.com>

> i have used the dash(-) but still the error is coming. Not ablre to fix.
> Please help to fix it.
>
> Regards,
> Ranjini
>
> On Mon, Dec 30, 2013 at 5:24 PM, Dieter De Witte <drdwitte@gmail.com>wrote:
>
>> not sure but i think you need to write =-Xmx...., you forgot the dash..
>>
>>
>> 2013/12/30 Ranjini Rathinam <ranjinibecse@gmail.com>
>>
>>> Hi,
>>>
>>> While excuting the word count mapreduce program , input  file is 95.2 MB.
>>> the error occures like this "  Error: Java Heap space"
>>>
>>> I have added -D mapred.child.java.opts=Xmx4096M in runtime also,
>>>
>>> but the error has not solve .
>>>
>>> In code also i have written conf.mapred.map.java.task=Xmx512M
>>>
>>> for both mapper and reducer but still the error has not been fixed.
>>>
>>> Please help to fix the error ASAP.
>>>
>>> Thanks in advance.
>>>
>>> Ranjini.R
>>>
>>
>>
>

Mime
View raw message