flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Default parallelism for job submitted using RemoteEnvironment
Date Fri, 04 Dec 2015 12:16:06 GMT
Hi Kien Truong,

This behavior is intentional. The "parallelism.default" config entry
refers to the default parallelism to set when submitting Flink
programs. Since Flink programs are assembled on the Client (your
machine) it is set to 1 there. When you submit from the cluster, it
picks up the correct "parallelism.default" config entry and sets the
default parallelism for your program.

I agree that it would be more intuitive if the Client read the default
parallelism of the cluster. I proposed that in an issue:
https://issues.apache.org/jira/browse/FLINK-3114

Best regards,
Max


On Thu, Dec 3, 2015 at 9:21 PM, Truong Duc Kien <duckientruong@gmail.com> wrote:
> Hi,
>
> When I submit a job using RemoteEnvironment without setting parallelism, it
> always uses only one task slot.
>
> Is this a bug or intentional ? I thought it was supposed to be the default
> configuration of the server (parallelism.default=24 in my cases)
>
> I'm using Flink in Standalone cluster mode.
>
> Best regards,
> Kien Truong

Mime
View raw message