mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1766) Increase default PermGen size for spark-shell
Date Mon, 11 Apr 2016 08:42:27 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15234706#comment-15234706
] 

Hudson commented on MAHOUT-1766:
--------------------------------

FAILURE: Integrated in Mahout-Quality #3324 (See [https://builds.apache.org/job/Mahout-Quality/3324/])
MAHOUT-1766: Increase default PermGen size for spark-shell (akm: rev 1aae3321b554adaf18f6c56abe1d7e4835c13cab)
* README.txt


> Increase default PermGen size for spark-shell
> ---------------------------------------------
>
>                 Key: MAHOUT-1766
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1766
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Mahout spark shell
>    Affects Versions: 0.11.0
>            Reporter: Sergey Tryuber
>            Assignee: Andrew Musselman
>             Fix For: 0.12.0
>
>
> Mahout spark-shell is run with default perm gen size (64MB). Taking into account that
it depends on lots of external jars and the whole count of used Java classes is very large,
we constantly observe spontaneous corresponding OOM exceptions.
> A hot fix from our side is to modify envelope bash script (added -XX:PermSize=512m):
> {code}
> "$JAVA" $JAVA_HEAP_MAX -XX:PermSize=512m $MAHOUT_OPTS -classpath "$CLASSPATH" "org.apache.mahout.sparkbindings.shell.Main"
$@
> {code}
> Of course, more elegant solution is needed. After the applied fix, the errors had gone.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message