flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Error when executing job
Date Wed, 24 Feb 2016 10:33:34 GMT
I assume that you included the flink-connector-twitter dependency in your
job jar, right? Alternatively, you might also put the jar in the lib folder
on each of your machines.

Cheers,
Till
‚Äč

On Wed, Feb 24, 2016 at 10:38 AM, ram kumar <ramkumarrock3@gmail.com> wrote:

> Hi,
>
>
> getting below error when executing twitter flink job,
>
> org.apache.flink.client.program.ProgramInvocationException: The program
> execution failed: Job execution failed.
>     at org.apache.flink.client.program.Client.runBlocking(Client.java:370)
>     at
> org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:96)
>     at com.flink.TwitterFlink.main(TwitterFlink.java:45)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:497)
>     at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
>     at org.apache.flink.client.program.Client.runBlocking(Client.java:252)
>     at
> org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:676)
>     at org.apache.flink.client.CliFrontend.run(CliFrontend.java:326)
>     at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:978)
>     at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1028)
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Job
> execution failed.
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply$mcV$sp(JobManager.scala:563)
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
>     at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
>     at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
>     at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
>     at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
>     at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>     at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>     at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>     at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.lang.Exception: Call to registerInputOutput() of invokable
> failed
>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:529)
>     at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException:
> Cannot load user class:
> org.apache.flink.streaming.connectors.twitter.TwitterFilterSource
> ClassLoader info: URL ClassLoader:
>     file:
> '/tmp/blobStore-f32e1c65-7412-4f59-9767-9fd6a1dd41ad/cache/blob_29086aa8f430f5335f527a0fba05b9e6837e0e1b'
> (valid JAR)
> Class not resolvable through given classloader.
>     at
> org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:187)
>     at
> org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:174)
>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526)
>     ... 1 more
>
>
> but i have TwitterFilterSource in pom.xml
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *pom.xml<dependency>        <groupId>com.twitter</groupId>
> <artifactId>hbc-core</artifactId>
> <version>2.2.0</version></dependency>       <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-streaming-java</artifactId>
> <version>0.10.1</version></dependency><dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-connector-twitter</artifactId>
> <version>0.10.1</version></dependency>*
> any inputs?
>
> Thanks
>
>

Mime
View raw message