hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3499) New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work
Date Fri, 02 Dec 2011 01:22:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161340#comment-13161340

Siddharth Seth commented on MAPREDUCE-3499:

Tucu, after MR-3443, proxy users should work - at least the doAs part.
There's several issues after that

1. MiniMRYarnCluster - set the default app staging dir to the test Working dir. Ran into
testValidProxyUser(org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser): Permission denied:
user=u1, access=EXECUTE, inode="/home":<REPLACED_USER>:supergroup:drwxr-x---

getJobConf needs -> conf.set(MRJobConfig.MR_AM_STAGING_DIR, "/tmp");

2. The host list for the proxy user - needs to include the host IP, instead of just "localhost"

3. After this, the proxy user cannot read the AppJar - since it was written out by the original
user when creating the cluster (MiniMRClientClusterFactory).

4. Another possible issue after this, would be creation of additional dirs for job history
on hdfs.
> New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do
not work
> ----------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-3499
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3499
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Priority: Critical
>              Labels: bigtop
>             Fix For: 0.23.1, 0.24.0
>         Attachments: TestForMAPREDUCE-3499.patch
> The new MiniMR implementation is not taking proxyuser settings.
> Because of this, testcases using/testing doAs functionality fail.
> This affects all Oozie testcases that use MiniMR.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message