hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sreekanth Ramakrishnan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4287) [mapred] jobqueue_details.jsp shows negative count of running and waiting reduces with CapacityTaskScheduler.
Date Mon, 29 Sep 2008 05:26:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635288#action_12635288
] 

Sreekanth Ramakrishnan commented on HADOOP-4287:
------------------------------------------------

I think it would be simpler to deduce the number of pending task by subtracting values from
_desiredMaps()_ and _finishedMaps()_. Similarly for reduces, I am making an assumption that
value of the _finishedMapTasks_ and _finishedReduceTasks_ are bumped up by one whenever a
speculative task has finished. This way, we don't need to keep track of the number of failed
maps or reduces, since our scheduling algorithm does not assign weight to number of failures.

> [mapred] jobqueue_details.jsp shows negative count of running and waiting reduces with
CapacityTaskScheduler.
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4287
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Vinod K V
>
> This I observed while running a job that always fails because of reduce failures. Need
to investigate this.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message