flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6580) Flink on YARN doesnt start with default parameters
Date Mon, 15 May 2017 09:19:05 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010210#comment-16010210
] 

ASF GitHub Bot commented on FLINK-6580:
---------------------------------------

GitHub user rmetzger opened a pull request:

    https://github.com/apache/flink/pull/3900

    [FLINK-6580] Sync default heap sizes from code with config file

    Flink didn't start on YARN anymore without explicit configuration of JM and TM heap because
the default heap sizes in the yaml file were set too low.
    This PR increases the default heap sizes according to the `TaskManagerOptions` and `JobManagerOptions`
classes.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/rmetzger/flink FLINK-6580

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/3900.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3900
    
----
commit d115416613313f5d01a47e92c33e87b3075008e8
Author: Robert Metzger <rmetzger@apache.org>
Date:   2017-05-15T09:15:48Z

    [FLINK-6580] Sync default heap sizes from code with config file

----


> Flink on YARN doesnt start with default parameters
> --------------------------------------------------
>
>                 Key: FLINK-6580
>                 URL: https://issues.apache.org/jira/browse/FLINK-6580
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.3.0
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>            Priority: Blocker
>
> Just doing {{./bin/yarn-session.sh -n 1}} fails with 
> {code}
> Error while deploying YARN cluster: Couldn't deploy Yarn cluster
> java.lang.RuntimeException: Couldn't deploy Yarn cluster
> 	at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:436)
> 	at org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:626)
> 	at org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:482)
> 	at org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:479)
> 	at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
> 	at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
> 	at org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:479)
> Caused by: java.lang.IllegalArgumentException: The configuration value 'containerized.heap-cutoff-min'
is higher (600) than the requested amount of memory 256
> 	at org.apache.flink.yarn.Utils.calculateHeapSize(Utils.java:100)
> 	at org.apache.flink.yarn.AbstractYarnClusterDescriptor.setupApplicationMasterContainer(AbstractYarnClusterDescriptor.java:1263)
> 	at org.apache.flink.yarn.AbstractYarnClusterDescriptor.startAppMaster(AbstractYarnClusterDescriptor.java:803)
> 	at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:568)
> 	at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:434)
> 	... 9 more
> {code}
> I think this issue has been introduced in FLINK-5904.
> Flink on YARN is now using the configuration parameters from the configuration file.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message