hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sreekanth Ramakrishnan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4576) Modify pending tasks count in the UI to pending jobs count in the UI
Date Tue, 02 Dec 2008 05:33:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sreekanth Ramakrishnan updated HADOOP-4576:
-------------------------------------------

    Attachment: HADOOP-4576-2.patch

Attaching new patch, this patch does not iterate thro' job list to find count of waiting jobs,instead
introduces a counter in the QueueInfo object in JobQueueManager to maintain a count of waiting
jobs which is incremented and decremented (by JobInitializationPoller). This would mean that
in [HADOOP-4445|https://issues.apache.org/jira/browse/HADOOP-4445] we just need to iterate
thro' running jobs queue to find number of running tasks for that queue.

> Modify pending tasks count in the UI to pending jobs count in the UI
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4576
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4576
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>    Affects Versions: 0.19.0
>            Reporter: Hemanth Yamijala
>            Assignee: Sreekanth Ramakrishnan
>         Attachments: HADOOP-4576-1.patch, HADOOP-4576-2.patch
>
>
> The UI for capacity scheduler displays 'pending tasks' counts. However the capacity scheduler
does not update these counts to be the actual values for optimization purposes, for e.g. to
avoid walking all pending jobs on all heartbeats. Hence this information is not very accurate.
> Also, while 'running tasks' counts are useful to compare against capacities and limits,
'pending tasks' counts do not add too much user value. A better count to display would be
the number of running and pending jobs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message