hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sreekanth Ramakrishnan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4287) [mapred] jobqueue_details.jsp shows negative count of running and waiting reduces with CapacityTaskScheduler.
Date Fri, 26 Sep 2008 10:25:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634803#action_12634803
] 

Sreekanth Ramakrishnan commented on HADOOP-4287:
------------------------------------------------

_CapacityTaskScheduler_ uses _JobInProgress.getPendingMaps()_ and _JobInProgress.getPendingReduces()_.
The way the pending maps and reduces are calculated in JIP can return negative values.

i.e. in case of an always failing task:

Number of task  - number of running task - number of failed task - finished task + speculative
task.

When number of failures become large the method returns negative value. But not sure if this
is expected.



> [mapred] jobqueue_details.jsp shows negative count of running and waiting reduces with
CapacityTaskScheduler.
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4287
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Vinod K V
>
> This I observed while running a job that always fails because of reduce failures. Need
to investigate this.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message