Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of drdwitte@gmail.com designates
 209.85.217.181 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALGZSrCOxrv6GZ=xk0Ok_Nk8ZvdX4wp2idg538wZHYnqq-1i+w@mail.gmail.com>
References: 
 <CALGZSrBPiC-ByAo=Z3ktkf-kP5gzOn3E6TDo=JWtY=rw9q66YA@mail.gmail.com>
	<CALSJUsSO1BVy-B4ou8JBzbhhx3w=Z5J5O2wuQJ8uN+pEb80aLA@mail.gmail.com>
	<CALGZSrCOxrv6GZ=xk0Ok_Nk8ZvdX4wp2idg538wZHYnqq-1i+w@mail.gmail.com>
Date: Tue, 31 Dec 2013 12:47:13 +0100
Message-ID: 
 <CALSJUsQ5ch1s96e5eYxWWaJ9rai+G9UWVUWLdG8SL5WwX3nMPA@mail.gmail.com>
Subject: Re: Error: Java Heap space
From: Dieter De Witte <drdwitte@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c32da414d5f904eed31f57

--001a11c32da414d5f904eed31f57
Content-Type: text/plain; charset=ISO-8859-1

Is it happening in map or reduce phase, and are you allocating anything in
your mappers/reducers? For example if you are having a collection in one of
them, this might be causing the heap error. Also what are the specs of your
nodes? How many concurrent map en reduce tasks per tasktracker,... We
cannot help if you give us so little information..


2013/12/31 Ranjini Rathinam <ranjinibecse@gmail.com>

> i have used the dash(-) but still the error is coming. Not ablre to fix.
> Please help to fix it.
>
> Regards,
> Ranjini
>
> On Mon, Dec 30, 2013 at 5:24 PM, Dieter De Witte <drdwitte@gmail.com>wrote:
>
>> not sure but i think you need to write =-Xmx...., you forgot the dash..
>>
>>
>> 2013/12/30 Ranjini Rathinam <ranjinibecse@gmail.com>
>>
>>> Hi,
>>>
>>> While excuting the word count mapreduce program , input  file is 95.2 MB.
>>> the error occures like this "  Error: Java Heap space"
>>>
>>> I have added -D mapred.child.java.opts=Xmx4096M in runtime also,
>>>
>>> but the error has not solve .
>>>
>>> In code also i have written conf.mapred.map.java.task=Xmx512M
>>>
>>> for both mapper and reducer but still the error has not been fixed.
>>>
>>> Please help to fix the error ASAP.
>>>
>>> Thanks in advance.
>>>
>>> Ranjini.R
>>>
>>
>>
>

--001a11c32da414d5f904eed31f57
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Is it happening in map or reduce phase, and are you alloca=
ting anything in your mappers/reducers? For example if you are having a col=
lection in one of them, this might be causing the heap error. Also what are=
 the specs of your nodes? How many concurrent map en reduce tasks per taskt=
racker,... We cannot help if you give us so little information..<br>
</div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">2013/12=
/31 Ranjini Rathinam <span dir=3D"ltr">&lt;<a href=3D"mailto:ranjinibecse@g=
mail.com" target=3D"_blank">ranjinibecse@gmail.com</a>&gt;</span><br><block=
quote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc=
 solid;padding-left:1ex">
<div>i have used the dash(-) but still the error is coming. Not ablre to fi=
x. Please help to fix it.</div>
<div>=A0</div>
<div>Regards,</div>
<div>Ranjini<br><br></div><div class=3D"HOEnZb"><div class=3D"h5">
<div class=3D"gmail_quote">On Mon, Dec 30, 2013 at 5:24 PM, Dieter De Witte=
 <span dir=3D"ltr">&lt;<a href=3D"mailto:drdwitte@gmail.com" target=3D"_bla=
nk">drdwitte@gmail.com</a>&gt;</span> wrote:<br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<div dir=3D"ltr">not sure but i think you need to write =3D-Xmx...., you fo=
rgot the dash..<br></div>
<div>
<div>
<div class=3D"gmail_extra"><br><br>
<div class=3D"gmail_quote">2013/12/30 Ranjini Rathinam <span dir=3D"ltr">&l=
t;<a href=3D"mailto:ranjinibecse@gmail.com" target=3D"_blank">ranjinibecse@=
gmail.com</a>&gt;</span><br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<div>Hi,</div>
<div>=A0</div>
<div>While excuting the word count=A0mapreduce program , input=A0 file is 9=
5.2 MB.</div>
<div>the error occures like this=A0&quot;=A0 Error: Java Heap space&quot;</=
div>
<div>=A0</div>
<div>I have added -D mapred.child.java.opts=3DXmx4096M in runtime also,</di=
v>
<div>=A0</div>
<div>but the error has not solve .</div>
<div>=A0</div>
<div>In code also i have written conf.mapred.map.java.task=3DXmx512M </div>
<div>=A0</div>
<div>for both mapper and reducer but still the error has not been fixed.</d=
iv>
<div>=A0</div>
<div>Please help to fix the error ASAP.</div>
<div>=A0</div>
<div>Thanks in advance.</div>
<div>=A0</div>
<div>Ranjini.R</div></blockquote></div><br></div></div></div></blockquote><=
/div><br>
</div></div></blockquote></div><br></div>

--001a11c32da414d5f904eed31f57--