beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <>
Subject [jira] [Closed] (BEAM-186) The streaming WindowedWordCount example is broken on Dataflow
Date Thu, 20 Oct 2016 21:47:02 GMT


Daniel Halperin closed BEAM-186.

> The streaming WindowedWordCount example is broken on Dataflow
> -------------------------------------------------------------
>                 Key: BEAM-186
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: examples-java
>            Reporter: Henning Korsholm Rohde
>            Assignee: Henning Korsholm Rohde
>            Priority: Minor
>             Fix For: 0.1.0-incubating
> The streaming version of WindowedWordCount example is broken on Dataflow. Currently,
the injector cannot start up and emits the error "java.lang.RuntimeException: DataflowWorkerHarness
should not be used for non-streaming pipelines". This in turn means that no messages are generated
for the streaming pipeline to process.
> The problem is that DataflowExampleUtils uses a batch workflow to inject Google PubSub
messages. This workflow reuses the real options and modifies them to be batch, setting isStreaming
to false etc. However, with versioned containers, the option for workerHarnessContainerImage
must now also be changed to use the batch image.

This message was sent by Atlassian JIRA

View raw message