hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Feng Yuan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-5427) Labeled apps cant use <DEFAULT_PARTITION> resources in 2.8
Date Mon, 25 Jul 2016 13:15:20 GMT

     [ https://issues.apache.org/jira/browse/YARN-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Feng Yuan updated YARN-5427:
    Attachment: QQ截图20160725205642.png

Hi all above is my configs,i can run a job which can get containers from partition x and partition
default with this configs in hdp 2.7.2.
I setup two nodes:
                  node "196" have 6GB with label "default".
                  node "197" have 6GB with label "x".
                  in my configs,queue A have 100% resource of them two.
                  and queue A`s default-node-label-expression is "x".(default empty dont work
like below.)
                  When i submit job in queue A,containers(one allcate 2GB) spread over 196
and 197 as the picture show.
                  I think this  phenomenon  contrarys to what [~Naganarasimha]     says.
                 And i cant run this scene in 2.8.
                 How could i explain this?

> Labeled apps cant use <DEFAULT_PARTITION> resources in 2.8
> ----------------------------------------------------------
>                 Key: YARN-5427
>                 URL: https://issues.apache.org/jira/browse/YARN-5427
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler
>    Affects Versions: 2.8.0
>            Reporter: Feng Yuan
>             Fix For: 2.8.0
>         Attachments: QQ截图20160725205642.png, capacity-scheduler.xml
> Queue A use partition X,When x is used up,app cant get resource from <DEFAULT_PARTITION>.
> I find this behavior is different from 2.7.x.Also i find this in the document of 2.7.2
as blew:
> "All queues can access to nodes without label"--https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html
> I think it means if queue A`s partition x is used up,app can get containers from DEFAULT_PARTITION?
Do i misstake?
> And I can confirm my configs is correct.Because i can run profectlly in 2.7.x use this
configation too.
> I have observed this in 2.8: "<DEFAULT_PARTITION> is marked as <ECLUSIVE_PARTITION>"
in webui.Is this the reason? 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message