hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2988) Reenable TestLinuxContainerExecutor reflecting the current NM code.
Date Tue, 04 Oct 2011 14:44:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120174#comment-13120174

Vinod Kumar Vavilapalli commented on MAPREDUCE-2988:

bq. don't see much use in having tests that will hardly ever be run because they need to be
run in a complex 4 step semi-manual process requiring root privileges.
When we were developing for 0.20.* security line of releases, there was time when we didn't
have these tests and got bitten by bugs which could only be verified by running tests on clusters,
a not-so-cheap process. The fact that you need a complex setup include root priveleges prevented
us from setting up Jenkins to run these tests. So, we wired these up and developers used to
run these manually whenever there was a change in these parts of the code, and I can personally
vouch for the fact that these were of great help for us over time even if runnable only in
dev environments.

bq. Is there a reason that container-executor.conf.dir, HADOOP_HOME to the C code, must be
set at compile time? Why can't we pass it in on the command line.
It is related to security. We didn't want to make the binary read from the (huge) *-site.xml
configuration files, but having a separate configuration file mandated that it be as secure
as possible. That said, we slowly started relying on the binary being only runnable by NM/TT,
so this configuration can be removed in favour of command line arguments. I'm planning to
get that done via MAPREDUCE-3121 which needs changes in the same areas of code.

> Reenable TestLinuxContainerExecutor reflecting the current NM code. 
> --------------------------------------------------------------------
>                 Key: MAPREDUCE-2988
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2988
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: mrv2, security, test
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Eric Payne
>            Assignee: Robert Joseph Evans
>            Priority: Critical
>             Fix For: 0.23.0, 0.24.0
>         Attachments: MR-2988.txt, MR-2988.txt
>   Original Estimate: 72h
>  Remaining Estimate: 72h
> TestLinuxContainerExecutor is currently disabled completely.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message