hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3240) NM should send a SIGKILL for completed containers also
Date Thu, 27 Oct 2011 15:44:33 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13137212#comment-13137212
] 

Robert Joseph Evans commented on MAPREDUCE-3240:
------------------------------------------------

It looks like this broke 0.23

{noformat}
$git log branch-0.23
commit 3589a79d2057acbdc348ca222756c84c62289f5c
Author: Vinod Kumar Vavilapalli <vinodkv@apache.org>
Date:   Thu Oct 27 12:44:57 2011 +0000

    MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by
Anupam Seth.
    svn merge -c r1189721 --ignore-ancestry ../../trunk/
    
    
    git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189723
13f79535-47bb-0310-9956-ffa450edef68

commit cd52508b445ee5c1d00570b5cd9b03f45dd48058
Author: Vinod Kumar Vavilapalli <vinodkv@apache.org>
Date:   Thu Oct 27 12:06:08 2011 +0000

    MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees)
irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
    
    
    git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189713
13f79535-47bb-0310-9956-ffa450edef68

commit 7c01afd599dee540f4d76243a6f40c43edaf1209
Author: Arun Murthy <acmurthy@apache.org>
Date:   Thu Oct 27 08:32:18 2011 +0000

    Merge -c 1189670 from trunk to branch-0.23 to fix MAPREDUCE-3279.
    
    git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189672
13f79535-47bb-0310-9956-ffa450edef68

$git checkout 7c01afd599dee540f4d76243a6f40c43edaf1209
$mvn clean install -DskipTests
#passed
$git checkout cd52508b445ee5c1d00570b5cd9b03f45dd48058
$mvn clean install -DskipTests
#failed
/home/evans/src/hadoop-git/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/ContainerExecutor.java:[39,53]
package org.apache.hadoop.yarn.server.nodemanager.util does not exist
{noformat}
                
> NM should send a SIGKILL for completed containers also
> ------------------------------------------------------
>
>                 Key: MAPREDUCE-3240
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3240
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, nodemanager
>    Affects Versions: 0.23.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Hitesh Shah
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-3240-20111027.1.txt, MAPREDUCE-3240-20111027.2.txt, MR-3240.1.patch,
MR-3240.2.patch, MR-3240.3.patch, MR-3240.4.wip.patch, MR-3240.5.patch, MR-3240.wip.patch
>
>
> This is to address the containers which exit properly after spawning sub-processes themselves.
We don't want to leave these sub-process-tree or else they can pillage the NM's resources.
> Today, we already have code to send SIGKILL to the whole process-trees (because of single
sessionId resulting from  setsid) when the container is alive. We need to obtain the PID of
the containers when they start and use that PID to send signal for completed containers' case
also.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message