hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Balamohan <rajesh.balamo...@gmail.com>
Subject Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems
Date Tue, 14 Jun 2016 05:06:02 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48159/
-----------------------------------------------------------

(Updated June 14, 2016, 5:06 a.m.)


Review request for hive and Ashutosh Chauhan.


Changes
-------

1. HCatalog tests were failing as they ended up creating client/HMS too many times and threadPool
was getting created every time. This caused rejection exceptions. FS threadpool created here
can be static and be shared across. Made it static.

2. Renamed variable to "hive.metastore.fshandler.threads" as Ashutosh suggested.

3. Ran HCatalog tests locally to ensure it passes.


Bugs: HIVE-13901
    https://issues.apache.org/jira/browse/HIVE-13901


Repository: hive-git


Description
-------

Depending on FS, creating external tables & adding partitions can be expensive (e.g msck
which adds all partitions).


Diffs (updated)
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 285caa3 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java c0827ea 

Diff: https://reviews.apache.org/r/48159/diff/


Testing
-------


Thanks,

Rajesh Balamohan


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message