hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wilfred Spiegelenburg (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-5722) FairScheduler hides group resolution exceptions when assigning queue
Date Tue, 15 Nov 2016 02:59:58 GMT

     [ https://issues.apache.org/jira/browse/YARN-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Wilfred Spiegelenburg updated YARN-5722:
    Attachment: YARN-5722.2.patch

After discussion with [~templedf] off-line we came to the conclusion that a slight change
of the message makes sense. Since we do not know the queue we now say "Error assigning app
to a queue: " to remove the ambiguity around the queue.

updating the patch with the agreed change

> FairScheduler hides group resolution exceptions when assigning queue 
> ---------------------------------------------------------------------
>                 Key: YARN-5722
>                 URL: https://issues.apache.org/jira/browse/YARN-5722
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>    Affects Versions: 2.6.5, 3.0.0-alpha1
>            Reporter: Wilfred Spiegelenburg
>            Assignee: Wilfred Spiegelenburg
>              Labels: oct16-easy
>         Attachments: YARN-5722.1.patch, YARN-5722.2.patch
> When a group based placement rule is used and the user does not have any groups the reason
for rejecting the application is hidden. An assignment will fail as follows:
> {code}
> <rule name="primaryGroup" create="true" /> 
> <rule name="reject" /> 
> {code}
> The error logged on the client side:
> {code}
> 09/30 15:59:27 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/test_user/.staging/job_1475223610304_6043

> 16/09/30 15:59:27 WARN security.UserGroupInformation: PriviledgedActionException as:test_user
(auth:SIMPLE) cause:java.io.IOException: Failed to run job : Error assigning app to queue
> java.io.IOException: Failed to run job : Error assigning app to queue default 
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301) 
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)

> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) 
> {code}
> The {{default}} queue name is passed in as part of the application submission and not
really the queue that is tried.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message