hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8424) Support fair scheduler user queue mapping in non-impersonation mode
Date Tue, 14 Oct 2014 21:38:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171575#comment-14171575
] 

Lefty Leverenz commented on HIVE-8424:
--------------------------------------

Doc note:  This adds configuration parameter *hive.server2.map.fair.scheduler.queue* to HiveConf.java,
so it needs to be documented in the wiki.

* [Setting Up HiveServer2 -- Authentication/Security Configuration | https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-Authentication/SecurityConfiguration]
* [Configuration Properties -- HiveServer2 | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2]

Although it's not an authentication issue, that's the section that discusses impersonation
so the parameter probably belongs near there.  If not, then somewhere else in the "Setting
Up HiveServer2" doc.

> Support fair scheduler user queue mapping in non-impersonation mode
> -------------------------------------------------------------------
>
>                 Key: HIVE-8424
>                 URL: https://issues.apache.org/jira/browse/HIVE-8424
>             Project: Hive
>          Issue Type: Improvement
>          Components: Shims
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>              Labels: TODOC15
>             Fix For: 0.15.0
>
>         Attachments: HIVE-8424.1.patch, HIVE-8424.2.patch, HIVE-8424.3.patch, HIVE-8424.patch
>
>
> Under non-impersonation mode, all MR jobs run as the hive system user. The default scheduler
queue mapping is one queue per user. This is problematic for users who use the queues to regulate
and track their MR resource usage.
> Yarn exposes an API to retrieve the fair scheduler queue mapping, which we can use to
set the appropriate MR queue for the current user.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message