hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8922) Fix test-container-executor
Date Mon, 22 Oct 2018 17:12:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659182#comment-16659182

Eric Yang commented on YARN-8922:

[~rkanter] Patch logic was moving the user uid/gid resolution before to test configuration
file written.  This prevents normal user who's uid below 1000 from running the test case because
test case set minimum uid to 500.  Without a valid test configuration, it fails error message:

Attempting to clean up from any previous runs
Requested user jenkins is not whitelisted and has id 501,which is below the minimum allowed

And segfault during set_user call.

> Fix test-container-executor
> ---------------------------
>                 Key: YARN-8922
>                 URL: https://issues.apache.org/jira/browse/YARN-8922
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 3.3.0
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>            Priority: Major
>         Attachments: YARN-8922.001.patch
> YARN-8448 attempted to fix the {{test-container-executor}} C test to be able to run
as root.  The test claims that it should be possible to run as root; in fact, there are some
tests that only run if you use root.  
> One of the fixes was to change the permissions of the test's config dir to 0777 from
0755.  The problem was that the directory was owned by root, but then other users would need
to write files/directories under it, which would fail with 0755.  YARN-8448 fixed this by
making it 0777.  However, this breaks running cetest because it expects the directory to be
0755, and it's run afterwards.
> The proper fix for all this is to leave the directory at 0755, but to make sure it's
owned by the "nodemanager" user.  Confusingly, in {{test-container-executor}}, that appears
to be the {{username}} and not the {{yarn_username}} (i.e. {{username}} is the user running
the NM while {{yarn_username}} is just some user running a Yarn app).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message