flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rong Rong <walter...@gmail.com>
Subject Re: How to submit flink job on yarn by java code
Date Thu, 16 Aug 2018 03:13:19 GMT
I dont think your exception / code was attached.

In general, this is largely depending on how your setup is. Are you trying
to setup a long-running YARN session cluster or are you trying to directly
use YARN cluster submit? [1].
We have an open-sourced project [2] with similar requirement submitting
compiled jobs on YARN, where we directly extends Flink's
AbstractYarnClusterDescriptor.
maybe it can be a reference for you.

Thanks,
Rong

[1]
https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/yarn_setup.html#start-a-long-running-flink-cluster-on-yarn
[2]
https://github.com/uber/AthenaX/blob/master/athenax-backend/src/main/java/com/uber/athenax/backend/server/yarn/AthenaXYarnClusterDescriptor.java

On Tue, Aug 14, 2018 at 7:58 PM spoon_lz <971066723@qq.com> wrote:

> My project is to automatically generate flink's code jar and then submit it
> to yarn cluster for execution and get the ApplicationId. I find that after
> execution, an error will be reported
>
>
>
> Then I searched for the error on Google and found that the reason for the
> error was that I did not introduce the haoop environment variable.
> But my jar submission is not called./bin/flink script originally submitted,
> but use the CliFrontend.java ,How to solve this problem?
>
> My code like :
>
>
>
>
>
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>

Mime
View raw message