beam-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lukasz Cwik <lc...@google.com>
Subject Re: Flink Wordcount example on single node "No runner was specified"
Date Fri, 22 Jul 2016 12:49:40 GMT
I think runner should be org.apache.beam.runners.flink.FlinkRunner and not
org.apache.beam.runners.flink.FlinkRunner.class but that is probably
unrelated to the failure that you are seeing.

On Fri, Jul 22, 2016 at 7:42 AM, Dumi Loghin <dumiloghin@gmail.com> wrote:

> Hi,
>
> I'm still getting an exception related to arguments. I mention that I'm
> working with commit adb472083460bc175a0685133eadb6a336f1a4a2 (22 Jul).
>
> ~/incubator-beam/runners/flink/examples$ mvn exec:java
> -Dexec.mainClass=org.apache.beam.runners.flink.examples.WordCount
> -Dexec.args="--runner=org.apache.beam.runners.flink.FlinkRunner.class
> --inputFile=/home/hadoop/kinglear.txt --output=wc-out.txt"
> ...
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) on project
> beam-runners-flink_2.10-examples: Unable to parse configuration of mojo
> org.codehaus.mojo:exec-maven-plugin:1.4.0:java for parameter arguments:
> Cannot store value into array: ArrayStoreException -> [Help 1]
> ...
>
> However, I was able to run it in early June. If I revert to, for example,
> commit c2146b9f9d6a1f39a5699725ccb51829d751b88a (6 Jun) I'm not getting the
> above exceptions. Maybe something changed in the options (arguments)
> handling code?
>
> Best regards,
> Dumi
>
> On Wed, Jul 20, 2016 at 7:35 PM, Aljoscha Krettek <aljoscha@apache.org>
> wrote:
>
>> I think it should work like this:
>>
>> mvn exec:java \
>> -Dexec.mainClass=org.apache.beam.runners.flink.examples.WordCount \
>> -Dexec.args="--runner=org.apache.beam.runners.flink.FlinkRunner.class
>> --inputFile='"$input"' --output='"$outfile_prefix"'"'
>>
>> On Wed, 20 Jul 2016 at 10:47 Dumi Loghin <dumiloghin@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to run Wordcount example on Flink single node but I'm getting
>>> this error:
>>>
>>> ~/incubator-beam/runners/flink/examples$ mvn exec:exec
>>> -Dinput=/home/hadoop/kinglear.txt -Doutput=wc-out.txt -Drunner=FlinkRunner
>>> ...
>>> Exception in thread "main" java.lang.IllegalArgumentException: No Runner
>>> was specified and the DirectRunner was not found on the classpath.
>>> Specify a runner by either:
>>>     Explicitly specifying a runner by providing the 'runner' property
>>>     Adding the DirectRunner to the classpath
>>>     Calling 'PipelineOptions.setRunner(PipelineRunner)' directly
>>> at
>>> org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:282)
>>> at
>>> org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:273)
>>> at
>>> org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:482)
>>> at
>>> org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)
>>> at
>>> org.apache.beam.sdk.options.PipelineOptionsValidator.validate(PipelineOptionsValidator.java:72)
>>> at
>>> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:306)
>>> at
>>> org.apache.beam.runners.flink.examples.WordCount.main(WordCount.java:106)
>>> ...
>>>
>>>
>>> I've tried with -Drunner=FlinkRunner and without it and I get the same
>>> error. Moreover, the runner is also set in the source:
>>>
>>> options.setRunner(FlinkRunner.class);
>>>
>>> Any suggestions?
>>>
>>> Best regards,
>>> Dumi
>>>
>>
>

Mime
View raw message