flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Flink Client use remote app jar
Date Wed, 27 Apr 2016 07:42:48 GMT
Hi Theofilos,

I'm afraid, but that is currently not possible with Flink. Flink expects
the user code jar to be uploaded to its Blob server. That's what the client
does prior to submitting the job. You would have to upload the jar with the
BlobClient manually if you wanted to circumvent the Client.

Cheers,
Till
On Apr 26, 2016 11:54 PM, "Theofilos Kakantousis" <tkak@kth.se> wrote:

> Hi everyone,
>
> Flink 0.10.1
> Hadoop 2.4.0
>
> Fairly new to Flink here, so my question might be simple but couldn't find
> something relevant in the docs. I am implementing a Flink client that
> submits jobs to a Flink Yarn cluster. At the moment I am using the Client
> and PackagedProgram classes which are working fine, however the latter
> expects the job jar to be available locally so that the Client can submit
> it to the Flink Yarn cluster.
>
> Is it possible to use a job jar that is already stored in the HDFS of the
> cluster where Flink is running on, without first copying it locally to
> where the Client is?
>
> Thank you,
> Theofilos
>

Mime
View raw message