Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.incubator.apache.org
Date: Fri, 26 Aug 2016 20:22:20 +0000 (UTC)
From: "Luke Cwik (JIRA)" <jira@apache.org>
To: commits@beam.incubator.apache.org
Message-ID: <JIRA.13000469.1472235759000.423646.1472242940961@Atlassian.JIRA>
In-Reply-To: <JIRA.13000469.1472235759000@Atlassian.JIRA>
References: <JIRA.13000469.1472235759000@Atlassian.JIRA> <JIRA.13000469.1472235759845@arcas>
Subject: [jira] [Commented] (BEAM-592) StackOverflowError Failed
 example/java/WordCount When Using SparkRunner
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 26 Aug 2016 20:22:26 -0000


    [ https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439743#comment-15439743 ] 

Luke Cwik commented on BEAM-592:
--------------------------------

Unless runners shade all their dependencies it will be near impossible to maintain having multiple runners included at the same time.

Splitting up the profiles to be per runner for the examples package seems like the right thing to do.

> StackOverflowError Failed example/java/WordCount When Using SparkRunner
> -----------------------------------------------------------------------
>
>                 Key: BEAM-592
>                 URL: https://issues.apache.org/jira/browse/BEAM-592
>             Project: Beam
>          Issue Type: Bug
>            Reporter: Mark Liu
>
> WordCount(example/java/WordCount) failed running with sparkRunner in following command:
> {code}
> mvn clean compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/tmp/kinglear.txt --runner=SparkRunner --sparkMaster=local --tempLocation=/tmp/out"
> {code}
> Following is part of stacktrace:
> {code}
> Caused by: java.lang.StackOverflowError
> 	at java.util.concurrent.CopyOnWriteArrayList.toArray(CopyOnWriteArrayList.java:374)
> 	at java.util.logging.Logger.accessCheckedHandlers(Logger.java:1782)
> 	at java.util.logging.LogManager$RootLogger.accessCheckedHandlers(LogManager.java:1668)
> 	at java.util.logging.Logger.getHandlers(Logger.java:1776)
> 	at java.util.logging.Logger.log(Logger.java:735)
> 	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
> 	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
> 	at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
> 	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
> 	at java.util.logging.Logger.log(Logger.java:738)
> 	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:580)
> 	at org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:650)
> 	at org.slf4j.bridge.SLF4JBridgeHandler.callLocationAwareLogger(SLF4JBridgeHandler.java:224)
> 	at org.slf4j.bridge.SLF4JBridgeHandler.publish(SLF4JBridgeHandler.java:301)
> ...
> {code}
> According to [http://slf4j.org/legacy.html#jul-to-slf4j] and in particular section: "jul-to-slf4j.jar and slf4j-jdk14.jar cannot be present simultaneously".
> Change slf4j-jdk14 dependency scope to test solve the above problem, but WordCountIT still failed in same reason. 


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)