flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Some new problems about flink-storm-compatibility
Date Thu, 20 Aug 2015 11:37:26 GMT
Hi,
could you please try running StormWordCountRemoteBySubmitter instead of
StormWordCountLocal. I think the Local one only works when running inside
an IDE (or executing by hand on the command line). The RemoteBySubmitter
variant should be the correct one for executing on a cluster using
"bin/flink".

Please get back to us if it still doesn't work or if you have further
questions.

Greetings,
Aljoscha

On Thu, 20 Aug 2015 at 13:19 huangwei (G) <huangwei111@huawei.com> wrote:

> Hi,
>
> I got some new problems about the storm compatibility currently.
> These occurred when I ran the “storm-wordcount” in the storm compatibility
> on a flink-0.10SNAPSHOT which I built it over a latest flink project.
>
>
> First, I start a local flink:
>
> $ cd bin
>
> $ ./start-local.sh
>
>
>
> Then I ran the example:
>
> $ bin/flink run --jarfile
> ./examples/flink-storm-compatibility-examples-0.10-SNAPSHOT.jar -c
> org.apache.flink.stormcompatibility.wordcount.StormWordCountLocal
>
>
>
> It took a trouble like following:
>
> Executing StormWordCount* example with built-in default data
>
>   Provide parameters to read input data from a file
>
>   Usage: StormWordCount* <text path> <result path>
>
> java.lang.ExceptionInInitializerError
>
> at
> backtype.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:106)
>
> at
> org.apache.flink.stormcompatibility.api.FlinkTopologyBuilder.createTopology(FlinkTopologyBuilder.java:78)
>
> at
> org.apache.flink.stormcompatibility.wordcount.StormWordCountLocal.main(StormWordCountLocal.java:66)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:497)
>
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437)
>
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353)
>
> at org.apache.flink.client.program.Client.run(Client.java:327)
>
> at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:608)
>
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:296)
>
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:927)
>
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:977)
>
> Caused by: java.lang.RuntimeException: Could not find config file on
> classpath defaults.yaml
>
> at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:129)
>
> at backtype.storm.utils.Utils.readDefaultConfig(Utils.java:160)
>
> at backtype.storm.utils.Utils.readStormConfig(Utils.java:184)
>
> at backtype.storm.utils.Utils.<clinit>(Utils.java:71)
>
> ... 14 more
>
>
>
> And then I added the default.yaml into
> flink-storm-compatibility-examples-0.10-SNAPSHOT.jar.
>
> It took another issue in the client log:
>
> 18:55:42,526 INFO  org.apache.flink.runtime.jobmanager.JobManager
>       - Status of job cb8ec2988613290d31eb6496c0af2e29 (Streaming
> WordCount) changed to FAILED.
>
> java.lang.Exception: Call to registerInputOutput() of invokable failed
>
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException:
> Cannot load user class:
> org.apache.flink.stormcompatibility.wrappers.StormBoltWrapper
>
> ClassLoader info: URL ClassLoader:
>
> Class not resolvable through given classloader.
>
> at
> org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:219)
>
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:135)
>
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:523)
>
> ... 1 more
>
>
>
> I have no idea to fix this and need some help.
>
>
>
> Thanks!
>
>
>
> Greetings,
> Huang Wei
> 华为技术有限公司 Huawei Technologies Co., Ltd.
>
>
> Tel:+86 18106512602
> Email:huangwei111@huawei.com
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message