hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10365) First job fails with StackOverflowError [Spark Branch]
Date Tue, 29 Mar 2016 05:06:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215435#comment-15215435
] 

Szehon Ho commented on HIVE-10365:
----------------------------------

I happened to see this in a spark-executor during a query as well.  Just leaving a note in
case someone else hits this.

The solution is to set spark.executor.extraJavaOptions to a sufficiently high -Xss value.

> First job fails with StackOverflowError [Spark Branch]
> ------------------------------------------------------
>
>                 Key: HIVE-10365
>                 URL: https://issues.apache.org/jira/browse/HIVE-10365
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: spark-branch
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>
> When running some queries on Yarn with standalone Hadoop, the first query fails with
StackOverflowError:
> {noformat}
> java.lang.StackOverflowError
> 	at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
> 	at java.util.concurrent.ConcurrentHashMap.putIfAbsent(ConcurrentHashMap.java:1145)
> 	at java.lang.ClassLoader.getClassLoadingLock(ClassLoader.java:464)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:405)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message