flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Nowojski <pi...@data-artisans.com>
Subject Re: Submitting a job via command line
Date Thu, 12 Oct 2017 15:00:45 GMT
Have you tried this 
http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E
<http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E>
?

Piotrek

> On 12 Oct 2017, at 16:30, Alexander Smirnov <asmirnov@five9.com> wrote:
> 
> Hello All,
>  
> I got the following error while attempting to execute a job via command line:
> 
> [root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar
-Xmx2048m -Xms2048m
> Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123
> Using address flink01.pb.lx-draskin5.five9.com:6123 to connect to JobManager.
> JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081 <http://flink01.pb.lx-draskin5.five9.com:8081/>
> Starting execution of program
> Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
> Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com <mailto://flink@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478]
with leader session id 00000000-0000-0000-0000-000000000000.
>  
> ------------------------------------------------------------
> The program finished with the following exception:
>  
> org.apache.flink.client.program.ProgramInvocationException: The program execution failed:
Couldn't retrieve the JobExecutionResult from the JobManager.
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
>         at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
>         at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
>         at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
>         at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
>         at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
>         at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
>         at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
>         at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
>         at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
>         at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
>         at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>         at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
>         at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve the
JobExecutionResult from the JobManager.
>         at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
>         at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
>         ... 25 more
> Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException:
Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case
the JobManager needs more time to configure and confirm the job submission.
>         at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
>         at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
>         at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
>         at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
>         at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
>         at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
>         at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
>         at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>         at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>         at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
>         at akka.dispatch.Mailbox.run(Mailbox.scala:220)
>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>  
> But it has been successfully submitted through Web UI using ‘Submit new Job’.
> 
> Can you please help me to understand what is the difference between CLI ‘flink run’
and WEB ‘Submit new Job’?
> And how do I run the job via CLI?
> 
> -- 
> Thanks,
> Alex
> 
> 
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information
of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized.
Any liability arising from any party acting, or refraining from acting, on any information
contained in this e-mail is hereby excluded. If you are not the intended recipient, please
notify the sender immediately, destroy the original transmission and its attachments and do
not disclose the contents to any other person, use it for any purpose, or store or copy the
information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or
its affiliated entities.


Mime
View raw message