hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Kanter (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8922) Fix test-container-executor
Date Mon, 22 Oct 2018 17:30:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659198#comment-16659198

Robert Kanter commented on YARN-8922:

That doesn't work if you run the test as root though, because TEST_ROOT will be created as
root, then the test will try to write files and dirs into the TEST_ROOT as another user, but
fail because of the permissions.  I do agree that we need the 0755 permissions, but it looks
like this will unfortunately need to be a little more complicated in order to get everything
working in every case.  I have an idea that I'm trying out that I think should work.  I'll
make sure to try it with a <1000 uid.

> Fix test-container-executor
> ---------------------------
>                 Key: YARN-8922
>                 URL: https://issues.apache.org/jira/browse/YARN-8922
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 3.3.0
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>            Priority: Major
>         Attachments: YARN-8922.001.patch
> YARN-8448 attempted to fix the {{test-container-executor}} C test to be able to run
as root.  The test claims that it should be possible to run as root; in fact, there are some
tests that only run if you use root.  
> One of the fixes was to change the permissions of the test's config dir to 0777 from
0755.  The problem was that the directory was owned by root, but then other users would need
to write files/directories under it, which would fail with 0755.  YARN-8448 fixed this by
making it 0777.  However, this breaks running cetest because it expects the directory to be
0755, and it's run afterwards.
> The proper fix for all this is to leave the directory at 0755, but to make sure it's
owned by the "nodemanager" user.  Confusingly, in {{test-container-executor}}, that appears
to be the {{username}} and not the {{yarn_username}} (i.e. {{username}} is the user running
the NM while {{yarn_username}} is just some user running a Yarn app).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message