hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashwin Shankar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml
Date Thu, 02 Feb 2017 00:17:51 GMT

    [ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849161#comment-15849161
] 

Ashwin Shankar commented on YARN-4022:
--------------------------------------

[~templedf],[~forrestchen],[~yufeigu],
Whoever is planning to work on this patch, please account for 'dynamic user queues' in fair
scheduler. These queues don't exist in the xml, but are created on the fly based on username
when a user submits a job. Please see fair scheduler docs for more information. So basically
queues can exist in the scheduler but not in xml, and shouldn't be deleted just because they
don't exist in the xml.

> queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml
> ----------------------------------------------------------------------------------------
>
>                 Key: YARN-4022
>                 URL: https://issues.apache.org/jira/browse/YARN-4022
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler, resourcemanager
>    Affects Versions: 2.7.1
>            Reporter: forrestchen
>              Labels: oct16-medium, scheduler
>         Attachments: YARN-4022.001.patch, YARN-4022.002.patch, YARN-4022.003.patch, YARN-4022.004.patch
>
>
> When I delete an existing queue by modify the xxx-schedule.xml, I can still see the queue
information block in webpage(/cluster/scheduler) though the 'Min Resources' items all become
to zero and have no item of 'Max Running Applications'.
> I can still submit an application to the deleted queue and the application will run using
'root.default' queue instead, but submit to an un-exist queue will cause an exception.
> My expectation is the deleted queue will not displayed in webpage and submit application
to the deleted queue will act just like the queue doesn't exist.
> PS: There's no application running in the queue I delete.
> Some related config in yarn-site.xml:
> {code}
> <property>
>         <name>yarn.scheduler.fair.user-as-default-queue</name>
>         <value>false</value>
> </property>
> <property>
>         <name>yarn.scheduler.fair.allow-undeclared-pools</name>
>         <value>false</value>
> </property>
> {code}
> a related question is here: http://stackoverflow.com/questions/26488564/hadoop-yarn-why-the-queue-cannot-be-deleted-after-i-revise-my-fair-scheduler-xm



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message