hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4373) Guaranteed Capacity calculation is not calculated correctly
Date Wed, 08 Oct 2008 09:53:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637840#action_12637840
] 

Karam Singh commented on HADOOP-4373:
-------------------------------------

Settings: 
Cluster is of 107 nodes out which 106 runs tasktrackers
Configured 4 qeueues -:

default gc_percent=10
test_q1 gc_percent=20
test_q2	gc_precent=30
test_q3 gc_percent=40

After starting  mapred cluster.  
JobTracker UI shows -:
Nodes=106, Map Task Capacity=212, Reduce Task Capacity=212	Avg. Tasks/Node=4.00

Queue Information shows -:
Queue Name Scheduling Information
default    Guaranteed Capacity Maps (%) :10.0, Guaranteed Capacity Reduces (%) :10.0, Current
Capacity Maps : 0, Current Capacity Reduces : 0
test_q1    Guaranteed Capacity Maps (%) :20.0, Guaranteed Capacity Reduces (%) :20.0, Current
Capacity Maps : 0, Current Capacity Reduces : 0
test_q2    Guaranteed Capacity Maps (%) :30.0, Guaranteed Capacity Reduces (%) :30.0, Current
Capacity Maps : 0, Current Capacity Reduces : 0
test_q3    Guaranteed Capacity Maps (%) :40.0, Guaranteed Capacity Reduces (%) :40.0, Current
Capacity Maps : 0, Current Capacity Reduces : 0


And Job track log shows -:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: After updating
QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:  Queue 'default'(map):
run=0, gc=0, wait=0, run jobs=0, wait jobs=0***  Queue 'test_q1'(map): run=0, gc=0, wait=0,
run jobs=0, wait jobs=0***  Queue 'test_q2'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
 Queue 'test_q3'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: After updating
QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:  Queue 'default'(reduce):
run=0, gc=0, wait=0, run jobs=0, wait jobs=0***  Queue 'test_q1'(reduce): run=0, gc=0, wait=0,
run jobs=0, wait jobs=0***  Queue 'test_q2'(reduce): run=0, gc=0, wait=0, run jobs=0, wait
jobs=0***  Queue 'test_q3'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***

Ran running  about 15 jobs. 
gc for all 4 queues remained 0 all the time.



> Guaranteed Capacity calculation is not calculated correctly
> -----------------------------------------------------------
>
>                 Key: HADOOP-4373
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4373
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>    Affects Versions: 0.19.0
>            Reporter: Karam Singh
>            Priority: Blocker
>
> Guaranteed Capacity calculation is not calculated correctly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message