beam-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Flink Wordcount example on single node "No runner was specified"
Date Mon, 25 Jul 2016 11:14:53 GMT
Hi Dumi,

Somewhere on the way we broke the exec configuration. I've fixed this
in this PR and updated the README:
https://github.com/apache/incubator-beam/pull/724

Should be merged soon.

Best,
Max

On Fri, Jul 22, 2016 at 2:49 PM, Lukasz Cwik <lcwik@google.com> wrote:
> I think runner should be org.apache.beam.runners.flink.FlinkRunner and not
> org.apache.beam.runners.flink.FlinkRunner.class but that is probably
> unrelated to the failure that you are seeing.
>
> On Fri, Jul 22, 2016 at 7:42 AM, Dumi Loghin <dumiloghin@gmail.com> wrote:
>>
>> Hi,
>>
>> I'm still getting an exception related to arguments. I mention that I'm
>> working with commit adb472083460bc175a0685133eadb6a336f1a4a2 (22 Jul).
>>
>> ~/incubator-beam/runners/flink/examples$ mvn exec:java
>> -Dexec.mainClass=org.apache.beam.runners.flink.examples.WordCount
>> -Dexec.args="--runner=org.apache.beam.runners.flink.FlinkRunner.class
>> --inputFile=/home/hadoop/kinglear.txt --output=wc-out.txt"
>> ...
>> [ERROR] Failed to execute goal
>> org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) on project
>> beam-runners-flink_2.10-examples: Unable to parse configuration of mojo
>> org.codehaus.mojo:exec-maven-plugin:1.4.0:java for parameter arguments:
>> Cannot store value into array: ArrayStoreException -> [Help 1]
>> ...
>>
>> However, I was able to run it in early June. If I revert to, for example,
>> commit c2146b9f9d6a1f39a5699725ccb51829d751b88a (6 Jun) I'm not getting the
>> above exceptions. Maybe something changed in the options (arguments)
>> handling code?
>>
>> Best regards,
>> Dumi
>>
>> On Wed, Jul 20, 2016 at 7:35 PM, Aljoscha Krettek <aljoscha@apache.org>
>> wrote:
>>>
>>> I think it should work like this:
>>>
>>> mvn exec:java \
>>> -Dexec.mainClass=org.apache.beam.runners.flink.examples.WordCount \
>>> -Dexec.args="--runner=org.apache.beam.runners.flink.FlinkRunner.class
>>> --inputFile='"$input"' --output='"$outfile_prefix"'"'
>>>
>>> On Wed, 20 Jul 2016 at 10:47 Dumi Loghin <dumiloghin@gmail.com> wrote:
>>>>
>>>> Hi,
>>>>
>>>> I'm trying to run Wordcount example on Flink single node but I'm getting
>>>> this error:
>>>>
>>>> ~/incubator-beam/runners/flink/examples$ mvn exec:exec
>>>> -Dinput=/home/hadoop/kinglear.txt -Doutput=wc-out.txt -Drunner=FlinkRunner
>>>> ...
>>>> Exception in thread "main" java.lang.IllegalArgumentException: No Runner
>>>> was specified and the DirectRunner was not found on the classpath.
>>>> Specify a runner by either:
>>>>     Explicitly specifying a runner by providing the 'runner' property
>>>>     Adding the DirectRunner to the classpath
>>>>     Calling 'PipelineOptions.setRunner(PipelineRunner)' directly
>>>> at
>>>> org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:282)
>>>> at
>>>> org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:273)
>>>> at
>>>> org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:482)
>>>> at
>>>> org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)
>>>> at
>>>> org.apache.beam.sdk.options.PipelineOptionsValidator.validate(PipelineOptionsValidator.java:72)
>>>> at
>>>> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:306)
>>>> at
>>>> org.apache.beam.runners.flink.examples.WordCount.main(WordCount.java:106)
>>>> ...
>>>>
>>>>
>>>> I've tried with -Drunner=FlinkRunner and without it and I get the same
>>>> error. Moreover, the runner is also set in the source:
>>>>
>>>> options.setRunner(FlinkRunner.class);
>>>>
>>>> Any suggestions?
>>>>
>>>> Best regards,
>>>> Dumi
>>
>>
>

Mime
View raw message