hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Badger (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6988) container-executor fails for docker when command length > 4096 B
Date Tue, 15 Aug 2017 21:33:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Eric Badger updated YARN-6988:
    Attachment: YARN-6988.001.patch

Attaching a patch to increase the size of the docker commands to 128 KB. This would decouple
it from EXECUTOR_PATH_MAX and not override the change that [~vvasudev] is making in YARN-6623.

> container-executor fails for docker when command length > 4096 B
> ----------------------------------------------------------------
>                 Key: YARN-6988
>                 URL: https://issues.apache.org/jira/browse/YARN-6988
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: YARN-6988.001.patch
> {{run_docker}} and {{launch_docker_container_as_user}} allocate their command arrays
using EXECUTOR_PATH_MAX, which is hardcoded to 4096 in configuration.h. Because of this, the
full docker command can only be 4096 characters. If it is longer, it will be truncated and
the command will fail with a parsing error. Because of the bind-mounting of volumes, the arguments
to the docker command can quickly get large. For example, I passed the 4096 limit with an
11 disk node. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message