hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B
Date Wed, 16 Aug 2017 05:08:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128325#comment-16128325
] 

Varun Vasudev commented on YARN-6988:
-------------------------------------

Sounds good [~ebadger].

> container-executor fails for docker when command length > 4096 B
> ----------------------------------------------------------------
>
>                 Key: YARN-6988
>                 URL: https://issues.apache.org/jira/browse/YARN-6988
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: YARN-6988.001.patch
>
>
> {{run_docker}} and {{launch_docker_container_as_user}} allocate their command arrays
using EXECUTOR_PATH_MAX, which is hardcoded to 4096 in configuration.h. Because of this, the
full docker command can only be 4096 characters. If it is longer, it will be truncated and
the command will fail with a parsing error. Because of the bind-mounting of volumes, the arguments
to the docker command can quickly get large. For example, I passed the 4096 limit with an
11 disk node. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message