hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only
Date Fri, 08 Jan 2016 16:01:40 GMT

    [ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089407#comment-15089407
] 

Karam Singh commented on YARN-4565:
-----------------------------------

GridMix V3 Trace information with GridMix run settings for test
 Trace runs 760 jobs with settings:
gridmix.client.pending.queue.depth=10, 
gridmix.job-submission.policy=REPLAY
gridmix.client.submit.threads=5, gridmix.submit.multiplier=0.0001
gridmix.job.type=SLEEPJOB, mapreduce.framework.name=yarn
gridmix.sleep.max-map-time=5000, gridmix.sleep.max-reduce-time=5000
gridmix.user.resolve.class=org.apache.hadoop.mapred.gridmix.RoundRobinUserResolver
With Users file containing 4 users for RoundRobinUserResolver

Debugging with [~wangda]

> When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead
to situation where all queue resources consumed by AMs only
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4565
>                 URL: https://issues.apache.org/jira/browse/YARN-4565
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler, capacityscheduler
>    Affects Versions: 2.8.0, 2.7.1
>            Reporter: Karam Singh
>
> When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead
to situation where all queue resources consumed by AMs only,
> So from users perpective it appears that all application in queue are stuck, whole queue
capacity is comsumed by AMs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message