I usually do try and error. Start with some very large value and do a
binary search :)
--sebastian
On 03/09/2014 01:30 PM, Mahmood Naderan wrote:
> Excuse me, I added the -Xmx option and restarted the hadoop services using
> sbin/stop-all.sh && sbin/start-all.sh
>
> however still I get heap size error. How can I find the correct and needed heap size?
>
>
> Regards,
> Mahmood
>
>
>
> On Sunday, March 9, 2014 1:37 PM, Mahmood Naderan <nt_mahmood@yahoo.com> wrote:
>
> OK I found that I have to add this property to mapred-site.xml
>
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
> </property>
>
>
>
> Regards,
> Mahmood
>
>
>
>
> On Sunday, March 9, 2014 11:39 AM, Mahmood Naderan <nt_mahmood@yahoo.com> wrote:
>
> Hello,
> I ran this command
>
> ./bin/mahout wikipediaXMLSplitter -d examples/temp/enwiki-latest-pages-articles.xml
-o wikipedia/chunks -c 64
>
> but got this error
> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>
> There are many web pages regarding this and the solution is to add "-Xmx 2048M" for example.
My question is, that option should be passed to java command and not Mahout. As result, running
"./bin/mahout -Xmx 2048M" shows that there is no such option. What should I do?
>
>
> Regards,
> Mahmood
>
|