hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohit Sabharwal" <mo...@cloudera.com>
Subject Re: Review Request 26515: HIVE-8424 : Support fair scheduler user queue mapping in non-impersonation mode
Date Mon, 13 Oct 2014 22:39:19 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26515/
-----------------------------------------------------------

(Updated Oct. 13, 2014, 10:39 p.m.)


Review request for hive.


Changes
-------

Inc. feedback:
  Improved config doc.
  Moved test to hive-unit-hadoop2


Bugs: HIVE-8424
    https://issues.apache.org/jira/browse/HIVE-8424


Repository: hive-git


Description
-------

HIVE-8424 : Support fair scheduler user queue mapping in non-impersonation mode

Under non-impersonation mode, all MR jobs run as the hive system user. 
The default scheduler queue mapping is one queue per user. This is problematic
for users who use the queues to regulate and track their MR resource usage.

This patch uses the Yarn API to set the fair scheduler queue mapping for
the current user, if impersonation is turned off.


Diffs (updated)
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 018c6035dd557ebb812f4224509bcf17bfdf045a

  itests/hive-unit-hadoop2/pom.xml cbdf506f94e2f720543e5932f0af65623fb43dc5 
  itests/hive-unit-hadoop2/src/test/java/org/apache/hive/jdbc/TestSchedulerQueue.java PRE-CREATION

  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java f021870cf48c55a3d2dea4c825f1f25d0ab008f3

  shims/0.20/src/main/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java 52f02c1a7915125fedd7b756e1db4611cf81d966

  shims/0.20S/src/main/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java 07946df1b0fc9064925f431fe1f0e2c020b41dfc

  shims/0.23/pom.xml ad71fccc2f94f4523cbb3572fecc06e54528d630 
  shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java 9829c1b54ed2c1cb3068a569ff47d897f6284933

  shims/common/src/main/java/org/apache/hadoop/hive/shims/HadoopShims.java d56795f7be1cffa13ea7b3ea2cd50db90730c020


Diff: https://reviews.apache.org/r/26515/diff/


Testing
-------

Added unit test


Thanks,

Mohit Sabharwal


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message