hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4211) Capacity Scheduler does not divide queue resources properly among users, when jobs are submitted one after other.
Date Thu, 16 Oct 2008 06:22:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640077#action_12640077
] 

Karam Singh commented on HADOOP-4211:
-------------------------------------

Checked and verified that after applying patch from HADOOP-4053 the queue resources are divided
properly among users, when jobs are submitted one after other. 

To verify third, did their following -:
Submitted 4 jobs one after the other (user-limit =25%) with different users. Slots are divided
among job equally. 
After first 4 jobs finished submitted 2 new jobs with different users one after the other,
slots were divided among both jobs (50% each).

 Repeated similar type of test about 10 times, and the behavior was same



> Capacity Scheduler does not divide queue resources properly among users, when jobs are
submitted one after other.
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4211
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4211
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>    Affects Versions: 0.19.0
>         Environment: Mapred Cluster capacity with 204 Maps and 204 Reduces. User limit
=25% and only one queue.
>            Reporter: Karam Singh
>            Assignee: Hemanth Yamijala
>            Priority: Blocker
>             Fix For: 0.19.0
>
>
> Capacity Scheduler does not divide queue resources  properly among users, when job are
submitted one after other. E.g. user limit =25. Say User1's job is running. Then user2 submits
a job. Then user1's job uses 75% and user2's job 25%=user limit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message