hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nathan Roberts (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3147) Handle leaf queues with the same name properly
Date Wed, 16 Nov 2011 21:03:52 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151511#comment-13151511
] 

Nathan Roberts commented on MAPREDUCE-3147:
-------------------------------------------

I thought about this a bit further. I wish we had a clearer separation between:
* leaf queues - queues which jobs can be submitted against
* parent queues - used to manage resources for a set of leaf nodes

I think users will get confused by the fact that you can't have a configuration with root.a.b
and root.c.b. If the job submission queues had been kept separate and then a property of the
job submission queue described where they attach to the resource hierarchy, it might have
been clearer. That way it's very clear where jobs can be submitted, and it's clear that the
list of queues where jobs can be submitted is a flat namespace, and it's clear that the hierarchical
part of the resource management can be reconfigured without any change to where jobs actually
get submitted.

However, the additional gain of making this sort of change to the way queues are defined doesn't
seem worth it. We'll just have to be very clear in the documentation that the namespace of
the leaves is flat. 

This Jira can be used to prevent the RM from accepting configurations where there is a conflict
in the list of job submission queues. 
                
> Handle leaf queues with the same name properly
> ----------------------------------------------
>
>                 Key: MAPREDUCE-3147
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3147
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ravi Prakash
>            Assignee: Ravi Prakash
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3147.branch-0.23.patch, MAPREDUCE-3147.branch-0.23.patch
>
>
> If there are two leaf queues with the same name, there is ambiguity while submitting
jobs, displaying queue info. When such ambiguity exists, the system should ask for clarification
/ show disambiguated information.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message