hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shane Kumpf (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6830) Support quoted strings for environment variables
Date Mon, 17 Jul 2017 11:27:00 GMT
Shane Kumpf created YARN-6830:
---------------------------------

             Summary: Support quoted strings for environment variables
                 Key: YARN-6830
                 URL: https://issues.apache.org/jira/browse/YARN-6830
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Shane Kumpf


There are cases where it is necessary to allow for quoted string literals within environment
variables values when passed via the yarn command line interface.

For example, consider the follow environment variables for a MR map task.

{{MODE=bar}}
{{IMAGE_NAME=foo}}
{{MOUNTS=/tmp/foo,/tmp/bar}}

When running the MR job, these environment variables are supplied as a comma delimited string.

{{-Dmapreduce.map.env="MODE=bar,IMAGE_NAME=foo,MOUNTS=/tmp/foo,/tmp/bar"}}

In this case, {{MOUNTS}} will be parsed and added to the task environment as {{MOUNTS=/tmp/foo}}.
Any attempts to quote the embedded comma separated value results in quote characters becoming
part of the value, and parsing still breaks down at the comma.

This issue is to allow for quoting the comma separated value (escaped double or single quote).
This was mentioned on YARN-4595 and will impact YARN-5534 as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message