Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7A4C918E7C for ; Wed, 24 Feb 2016 10:33:46 +0000 (UTC) Received: (qmail 70005 invoked by uid 500); 24 Feb 2016 10:33:36 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 69914 invoked by uid 500); 24 Feb 2016 10:33:36 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 69905 invoked by uid 99); 24 Feb 2016 10:33:36 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Feb 2016 10:33:36 +0000 Received: from mail-wm0-f51.google.com (mail-wm0-f51.google.com [74.125.82.51]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id EBC611A0279 for ; Wed, 24 Feb 2016 10:33:35 +0000 (UTC) Received: by mail-wm0-f51.google.com with SMTP id g62so23226971wme.0 for ; Wed, 24 Feb 2016 02:33:35 -0800 (PST) X-Gm-Message-State: AG10YOQu/HIPUxcf/VzcXlYdVIxgzHrgW5bQxZ3BPDXnDgSF5QNsDia9jnvQ3+A/KqCFKmBPaWo9VhtwY1eSUw== MIME-Version: 1.0 X-Received: by 10.28.175.139 with SMTP id y133mr21867635wme.45.1456310014550; Wed, 24 Feb 2016 02:33:34 -0800 (PST) Received: by 10.28.113.129 with HTTP; Wed, 24 Feb 2016 02:33:34 -0800 (PST) In-Reply-To: References: Date: Wed, 24 Feb 2016 11:33:34 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Error when executing job From: Till Rohrmann To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a11444bce19ae58052c8199fb --001a11444bce19ae58052c8199fb Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I assume that you included the flink-connector-twitter dependency in your job jar, right? Alternatively, you might also put the jar in the lib folder on each of your machines. Cheers, Till =E2=80=8B On Wed, Feb 24, 2016 at 10:38 AM, ram kumar wrote= : > Hi, > > > getting below error when executing twitter flink job, > > org.apache.flink.client.program.ProgramInvocationException: The program > execution failed: Job execution failed. > at org.apache.flink.client.program.Client.runBlocking(Client.java:370= ) > at > org.apache.flink.streaming.api.environment.StreamContextEnvironment.execu= te(StreamContextEnvironment.java:96) > at com.flink.TwitterFlink.main(TwitterFlink.java:45) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedPr= ogram.java:497) > at > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForE= xecution(PackagedProgram.java:395) > at org.apache.flink.client.program.Client.runBlocking(Client.java:252= ) > at > org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.ja= va:676) > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:326) > at > org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:978) > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1028) > Caused by: org.apache.flink.runtime.client.JobExecutionException: Job > execution failed. > at > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$= anonfun$applyOrElse$5.apply$mcV$sp(JobManager.scala:563) > at > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$= anonfun$applyOrElse$5.apply(JobManager.scala:509) > at > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$= anonfun$applyOrElse$5.apply(JobManager.scala:509) > at > scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Futu= re.scala:24) > at > scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:2= 4) > at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) > at > akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(Abstract= Dispatcher.scala:401) > at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:26= 0) > at > scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.jav= a:1339) > at > scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.j= ava:107) > Caused by: java.lang.Exception: Call to registerInputOutput() of invokabl= e > failed > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:529) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: > Cannot load user class: > org.apache.flink.streaming.connectors.twitter.TwitterFilterSource > ClassLoader info: URL ClassLoader: > file: > '/tmp/blobStore-f32e1c65-7412-4f59-9767-9fd6a1dd41ad/cache/blob_29086aa8f= 430f5335f527a0fba05b9e6837e0e1b' > (valid JAR) > Class not resolvable through given classloader. > at > org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(Strea= mConfig.java:187) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(S= treamTask.java:174) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) > ... 1 more > > > but i have TwitterFilterSource in pom.xml > > > > > > > > > > > > > > > > > > > > > > *pom.xml com.twitter > hbc-core > 2.2.0 > org.apache.flink > flink-streaming-java > 0.10.1 > org.apache.flink > flink-connector-twitter > 0.10.1* > any inputs? > > Thanks > > --001a11444bce19ae58052c8199fb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

I assume that you included the flink-connector-twitter dependency in your job jar, right? = Alternatively, you might also put the jar in the lib folder on each of your machines.

Cheers,
Till

=E2=80=8B

On Wed, Feb 24, 2016 at 10:38 AM, = ram kumar <ramkumarrock3@gmail.com> wrote:
Hi,


getting b= elow error when executing twitter flink job,

org.apache.flink.= client.program.ProgramInvocationException: The program execution failed: Jo= b execution failed.
=C2=A0=C2=A0=C2=A0 at org.apache.flink.client.progra= m.Client.runBlocking(Client.java:370)
=C2=A0=C2=A0=C2=A0 at org.apache.f= link.streaming.api.environment.StreamContextEnvironment.execute(StreamConte= xtEnvironment.java:96)
=C2=A0=C2=A0=C2=A0 at com.flink.TwitterFlink.main= (TwitterFlink.java:45)
=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAcc= essorImpl.invoke0(Native Method)
=C2=A0=C2=A0=C2=A0 at sun.reflect.Nativ= eMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
=C2=A0=C2= =A0=C2=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:43)
=C2=A0=C2=A0=C2=A0 at java.lang.reflect.Method.i= nvoke(Method.java:606)
=C2=A0=C2=A0=C2=A0 at org.apache.flink.client.pro= gram.PackagedProgram.callMainMethod(PackagedProgram.java:497)
=C2=A0=C2= =A0=C2=A0 at org.apache.flink.client.program.PackagedProgram.invokeInteract= iveModeForExecution(PackagedProgram.java:395)
=C2=A0=C2=A0=C2=A0 at org.= apache.flink.client.program.Client.runBlocking(Client.java:252)
=C2=A0= =C2=A0=C2=A0 at org.apache.flink.client.CliFrontend.executeProgramBlocking(= CliFrontend.java:676)
=C2=A0=C2=A0=C2=A0 at org.apache.flink.client.CliF= rontend.run(CliFrontend.java:326)
=C2=A0=C2=A0=C2=A0 at org.apache.flink= .client.CliFrontend.parseParameters(CliFrontend.java:978)
=C2=A0=C2=A0= =C2=A0 at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1028)Caused by: org.apache.flink.runtime.client.JobExecutionException: Job exe= cution failed.
=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.jobmanager= .JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply$mcV$sp(Jo= bManager.scala:563)
=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.jobma= nager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobM= anager.scala:509)
=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.jobmana= ger.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobMan= ager.scala:509)
=C2=A0=C2=A0=C2=A0 at scala.concurrent.impl.Future$Promi= seCompletingRunnable.liftedTree1$1(Future.scala:24)
=C2=A0=C2=A0=C2=A0 a= t scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:2= 4)
=C2=A0=C2=A0=C2=A0 at akka.dispatch.TaskInvocation.run(AbstractDispat= cher.scala:41)
=C2=A0=C2=A0=C2=A0 at akka.dispatch.ForkJoinExecutorConfi= gurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
=C2=A0=C2=A0= =C2=A0 at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:2= 60)
=C2=A0=C2=A0=C2=A0 at scala.concurrent.forkjoin.ForkJoinPool$WorkQue= ue.runTask(ForkJoinPool.java:1339)
=C2=A0=C2=A0=C2=A0 at scala.concurren= t.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
=C2=A0=C2=A0= =C2=A0 at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorker= Thread.java:107)
Caused by: java.lang.Exception: Call to registerInputOu= tput() of invokable failed
=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtim= e.taskmanager.Task.run(Task.java:529)
=C2=A0=C2=A0=C2=A0 at java.lang.Th= read.run(Thread.java:745)
Caused by: org.apache.flink.streaming.runtime.= tasks.StreamTaskException: Cannot load user class: org.apache.flink.streami= ng.connectors.twitter.TwitterFilterSource
ClassLoader info: URL ClassLoa= der:
=C2=A0=C2=A0=C2=A0 file: '/tmp/blobStore-f32e1c65-7412-4f59-976= 7-9fd6a1dd41ad/cache/blob_29086aa8f430f5335f527a0fba05b9e6837e0e1b' (va= lid JAR)
Class not resolvable through given classloader.
=C2=A0=C2=A0= =C2=A0 at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperat= or(StreamConfig.java:187)
=C2=A0=C2=A0=C2=A0 at org.apache.flink.streami= ng.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:174)
=C2= =A0=C2=A0=C2=A0 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:= 526)
=C2=A0=C2=A0=C2=A0 ... 1 more


but i ha= ve TwitterFilterSource in pom.xml

pom.xml
<dependency>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 <groupId>com.twitter</groupId>
=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 <artifactId>hbc-core</artifactId>
=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <version>2.2.0</version>= ;
</dependency>

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <de= pendency>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <groupId>o= rg.apache.flink</groupId>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 <artifactId>flink-streaming-java</artifactId>
=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <version>0.10.1</version>
= </dependency>
<dependency>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 <groupId>org.apache.flink</groupId>
=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <artifactId>flink-connector-twitter= </artifactId>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <versi= on>0.10.1</version>
</dependency>



any inputs?

Thanks


--001a11444bce19ae58052c8199fb--