beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Tournay (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-3924) FlinkRunner fails to execute some of beam examples
Date Mon, 26 Mar 2018 10:11:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Julien Tournay updated BEAM-3924:
---------------------------------
    Attachment: traffic_max_lane.txt

> FlinkRunner fails to execute some of beam examples
> --------------------------------------------------
>
>                 Key: BEAM-3924
>                 URL: https://issues.apache.org/jira/browse/BEAM-3924
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>    Affects Versions: 2.4.0
>            Reporter: Julien Tournay
>            Assignee: Aljoscha Krettek
>            Priority: Major
>         Attachments: traffic_max_lane.txt, traffic_route.txt
>
>
> I'm using:
>  * java version "1.8.0_162"
> Java(TM) SE Runtime Environment (build 1.8.0_162-b12)
> Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)
>  * Fink Version: 1.4.2, Commit ID: 04e4c85
>  * Beam 2.4.0
> The examples are executed using a local Flink cluster as in [Flink's Quickstart|https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html].
> Most of the examples (WordCount, WindowedWordCount, etc.) are running fine.
> h4. The following example runs but thrown an exception:
> {code:java}
> mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficRoutes \
>     -Pflink-runner \
>     -Dexec.args="--runner=FlinkRunner \
>       --flinkMaster=localhost:6123 \
>       --filesToStage=/private/tmp/word-count-beam/target/word-count-beam-bundled-0.1.jar
\
>       --tempLocation=gs://julient/temp \
>       --bigQueryDataset=julient \
>       --bigQueryTable=traffic_routes"
> {code}
> {code:java}
> [WARNING]
> java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
>     at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
>     at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
>     at java.lang.Thread.run (Thread.java:748)
> {code}
> Although an exception is thrown, the output BigQuery table is populated. 
> h4. The following example runs but throws an exception and do not produce any output
data:
> {code}
> mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficMaxLaneFlow \
>     -Pflink-runner \
>     -Dexec.args="--runner=FlinkRunner \
>       --inputFile=gs://apache-beam-samples/traffic_sensor/Freeways-5Minaa2010-01-01_to_2010-02-15_test2.csv
\
>       --flinkMaster=localhost:6123 \
>       --filesToStage=target/word-count-beam-bundled-0.1.jar \
>       --tempLocation=gs://julient/temp \
>       --bigQueryDataset=julient \
>       --bigQueryTable=traffic_max_lane_flow"
> {code}
> The exception is the same as the previous example:
> {code:java}
> [WARNING]
> java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
> at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
> at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
> at java.lang.Thread.run (Thread.java:748){code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message