Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 27 May 2016 00:39:12 +0000 (UTC)
From: "Joep Rottinghuis (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12973253.1464309503000.310863.1464309552899@Atlassian.JIRA>
In-Reply-To: <JIRA.12973253.1464309503000@Atlassian.JIRA>
References: <JIRA.12973253.1464309503000@Atlassian.JIRA> <JIRA.12973253.1464309503061@arcas>
Subject: [jira] [Created] (YARN-5167) Escaping occurences of encodedValues
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 27 May 2016 00:39:14 -0000

Joep Rottinghuis created YARN-5167:
--------------------------------------

             Summary: Escaping occurences of encodedValues
                 Key: YARN-5167
                 URL: https://issues.apache.org/jira/browse/YARN-5167
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: timelineserver
            Reporter: Joep Rottinghuis
            Assignee: Sangjin Lee
            Priority: Critical


We had earlier decided to punt on this, but in discussing YARN-5109 we thought it would be best to just be safe rather than sorry later on.

Encoded sequences can occur in the original string, especially in case of "foreign key" if we decide to have lookups.

For example, space is encoded as %2$.
Encoding "String with %2$ in it" would decode to "String with   in it".
We though we should first escape existing occurrences of encoded strings by prefixing a backslash (even if there is already a backslash that should be ok). Then we should replace all unencoded strings.
On the way out, we should replace all occurrences of our encoded string to the original except when it is prefixed by an escape character. Lastly we should strip off the one additional backslash in front of each remaining (escaped) sequence.

If we add the following entry to TestSeparator#testEncodeDecode() that demonstrates what this jira should accomplish:
{code}
    testEncodeDecode("Double-escape %2$ and %3$ or \\%2$ or \\%3$, nor  \\\\%2$ = no problem!", Separator.QUALIFIERS,
        Separator.VALUES, Separator.SPACE, Separator.TAB);
{code}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org