hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Brennan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8029) YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS should not use commas as separators
Date Wed, 14 Mar 2018 20:21:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399240#comment-16399240
] 

Jim Brennan commented on YARN-8029:
-----------------------------------

Thanks [~shanekumpf@gmail.com]. This does appear to be a duplicate of YARN-6830, with respect
to the underlying problem, but proposes a different solution. Supporting the ability to quote
the values does seem like a natural approach - it's the first thing I tried to do.

I proposed changing the delimiters in these docker runtime variables because it is a safe
change - it can't break anything because it's currently not working with commas. While commas
seems like a natural choice for the delimiter, I don't think changing it to something else
would be much of a hardship as long as it is documented.

I'm willing to work on either this or YARN-6830, depending on which option is favored. cc:
[~jlowe], [~templedf], [~aw],

> YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS should not use commas as separators
> ------------------------------------------------------------------------
>
>                 Key: YARN-8029
>                 URL: https://issues.apache.org/jira/browse/YARN-8029
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 3.0.0
>            Reporter: Jim Brennan
>            Priority: Major
>
> The following docker-related environment variables specify a comma-separated list of
mounts:
> YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS
> YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS
> This is a problem because hadoop -Dmapreduce.map.env and related options use  comma as
a delimiter.   So if I put more than one mount in YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS the
comma in the variable will be treated as a delimiter for the hadoop command line option and
all but the first mount will be ignored.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message