flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Nowojski <pi...@data-artisans.com>
Subject Re: Submitting a job via command line
Date Fri, 13 Oct 2017 12:46:31 GMT
Good to hear that :)


> On 13 Oct 2017, at 14:40, Alexander Smirnov <asmirnov@five9.com> wrote:
> 
> Thank you so much, it helped!
> 
> From: Piotr Nowojski <piotr@data-artisans.com <mailto:piotr@data-artisans.com>>
> Date: Thursday, October 12, 2017 at 6:00 PM
> To: Alexander Smirnov <asmirnov@five9.com <mailto:asmirnov@five9.com>>
> Cc: "user@flink.apache.org <mailto:user@flink.apache.org>" <user@flink.apache.org
<mailto:user@flink.apache.org>>
> Subject: Re: Submitting a job via command line
> 
> Have you tried this 
> http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E
<http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E>
> ?
> 
> Piotrek
> 
>> On 12 Oct 2017, at 16:30, Alexander Smirnov <asmirnov@five9.com <mailto:asmirnov@five9.com>>
wrote:
>> 
>> Hello All,
>>  
>> I got the following error while attempting to execute a job via command line:
>> 
>> [root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar
-Xmx2048m -Xms2048m
>> Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123
<http://flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123>
>> Using address flink01.pb.lx-draskin5.five9.com:6123 <http://flink01.pb.lx-draskin5.five9.com:6123/>
to connect to JobManager.
>> JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081 <http://flink01.pb.lx-draskin5.five9.com:8081/>
>> Starting execution of program
>> Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
>> Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com
<mailto://flink@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478]
with leader session id 00000000-0000-0000-0000-000000000000.
>>  
>> ------------------------------------------------------------
>> The program finished with the following exception:
>>  
>> org.apache.flink.client.program.ProgramInvocationException: The program execution
failed: Couldn't retrieve the JobExecutionResult from the JobManager.
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
>>         at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
>>         at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
>>         at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
>>         at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
>>         at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
>>         at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:498)
>>         at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
>>         at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
>>         at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
>>         at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
>>         at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
>>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
>>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
>>         at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:422)
>>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>>         at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
>>         at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
>> Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve
the JobExecutionResult from the JobManager.
>>         at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
>>         at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
>>         ... 25 more
>> Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException:
Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case
the JobManager needs more time to configure and confirm the job submission.
>>         at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
>>         at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
>>         at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
>>         at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
>>         at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
>>         at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
>>         at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
>>         at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>>         at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>>         at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
>>         at akka.dispatch.Mailbox.run(Mailbox.scala:220)
>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>>  
>> But it has been successfully submitted through Web UI using ‘Submit new Job’.
>> 
>> Can you please help me to understand what is the difference between CLI ‘flink
run’ and WEB ‘Submit new Job’?
>> And how do I run the job via CLI?
>> 
>> -- 
>> Thanks,
>> Alex
>> 
>> 
>> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential
information of Five9 and/or its affiliated entities. Access by the intended recipient only
is authorized. Any liability arising from any party acting, or refraining from acting, on
any information contained in this e-mail is hereby excluded. If you are not the intended recipient,
please notify the sender immediately, destroy the original transmission and its attachments
and do not disclose the contents to any other person, use it for any purpose, or store or
copy the information in any medium. Copyright in this e-mail and any attachments belongs to
Five9 and/or its affiliated entities.
> 
> 
> 
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information
of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized.
Any liability arising from any party acting, or refraining from acting, on any information
contained in this e-mail is hereby excluded. If you are not the intended recipient, please
notify the sender immediately, destroy the original transmission and its attachments and do
not disclose the contents to any other person, use it for any purpose, or store or copy the
information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or
its affiliated entities.


Mime
View raw message