beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kenneth Knowles (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1213) WordCount example failure on Apex Runner
Date Wed, 26 Apr 2017 22:13:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985653#comment-15985653
] 

Kenneth Knowles commented on BEAM-1213:
---------------------------------------

Seems ripe for a re-triage before stable release.

> WordCount example failure on Apex Runner
> ----------------------------------------
>
>                 Key: BEAM-1213
>                 URL: https://issues.apache.org/jira/browse/BEAM-1213
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-apex
>            Reporter: Sandeep Deshmukh
>             Fix For: First stable release
>
>
> Tried running WordCount example using apex runner (on YARN) with https://github.com/apache/incubator-beam/pull/1693
, fix for httpclient version issue fixed.
> Create /tmp/input-beam/ dir on all nodes and pushed a test data in that directory. Ran
the following command in examples/java/
> ~/bin/apache-maven-3.3.9/bin/mvn  compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount
-Dexec.args="--inputFile=/tmp/input-beam/java.java --output=/tmp/output-beam/ --runner=ApexRunner
--embeddedExecution=false" -Papex-runner
> INFO: using /disk2/devhdfs/nn_20161013/usercache/sandeep/appcache/application_1482319446115_4336/container_1482319446115_4336_01_000014/tmp/chkp5198889890309038810
as the basepath for checkpointing.
> Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
> SEVERE: Fatal exception in container!
> java.lang.IllegalArgumentException: Invalid slice: offset=1426, length=0 array.length=67108864
>         at com.datatorrent.netlet.util.Slice.<init>(Slice.java:43)
>         at com.datatorrent.bufferserver.util.SerializedData.<init>(SerializedData.java:40)
>         at com.datatorrent.bufferserver.internal.DataList$Block.purge(DataList.java:712)
>         at com.datatorrent.bufferserver.internal.DataList.purge(DataList.java:192)
>         at com.datatorrent.bufferserver.server.Server.purge(Server.java:204)
>         at com.datatorrent.stram.engine.StreamingContainer.processHeartbeatResponse(StreamingContainer.java:776)
>         at com.datatorrent.stram.engine.StreamingContainer.heartbeatLoop(StreamingContainer.java:705)
>         at com.datatorrent.stram.engine.StreamingContainer.main(StreamingContainer.java:310)
> Dec 23, 2016 7:17:44 AM com.datatorrent.bufferserver.server.Server unregistered
> INFO: Server stopped listening at /0:0:0:0:0:0:0:0:40904
> Dec 23, 2016 7:17:44 AM com.datatorrent.stram.engine.StreamingContainer main
> INFO: Exit status for container: 1



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message