hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1398) TaskLauncher remains stuck on tasks waiting for free nodes even if task is killed.
Date Tue, 16 Feb 2010 09:14:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834131#action_12834131
] 

Hadoop QA commented on MAPREDUCE-1398:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12435943/patch-1398-2.txt
  against trunk revision 910223.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 1 new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit
warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/455/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/455/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/455/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/455/console

This message is automatically generated.

> TaskLauncher remains stuck on tasks waiting for free nodes even if task is killed.
> ----------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1398
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1398
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>            Reporter: Hemanth Yamijala
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.22.0
>
>         Attachments: patch-1398-1.txt, patch-1398-2.txt, patch-1398.txt
>
>
> Tasks could be assigned to trackers for slots that are running other tasks in a commit
pending state. This is an optimization done to pipeline task assignment and launch. When the
task reaches the tracker, it waits until sufficient slots become free for it. This wait is
done in the TaskLauncher thread. Now, while waiting, if the task is killed externally (maybe
because the job finishes, etc), the TaskLauncher is not notified of this. So, it continues
to wait for the killed task to get sufficient slots. If slots do not become free for a long
time, this would result in considerable delay in waking up the TaskLauncher thread. If the
waiting task happens to be a high RAM task, then it is also wasteful, because by waking up,
it can make way for normal tasks that can run on the available number of slots.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message