hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Balamohan <rajesh.balamo...@gmail.com>
Subject Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems
Date Fri, 03 Jun 2016 03:07:51 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48159/#review136027
-----------------------------------------------------------




metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java (line 2306)
<https://reviews.apache.org/r/48159/#comment201030>

    In case the cluster is configured with StorageBasedAuth*, based on the listener implementations,
it can have similar issues where it ends up scanning all dirs for permissions etc. Similar
approach can be followed there as well, but out of scope of this JIRA. Will create a separate
jira for it.


- Rajesh Balamohan


On June 3, 2016, 3:03 a.m., Rajesh Balamohan wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48159/
> -----------------------------------------------------------
> 
> (Updated June 3, 2016, 3:03 a.m.)
> 
> 
> Review request for hive and Ashutosh Chauhan.
> 
> 
> Bugs: HIVE-13901
>     https://issues.apache.org/jira/browse/HIVE-13901
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> Depending on FS, creating external tables & adding partitions can be expensive (e.g
msck which adds all partitions).
> 
> 
> Diffs
> -----
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 9cc8fbe 
>   metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 94dd72e 
> 
> Diff: https://reviews.apache.org/r/48159/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Rajesh Balamohan
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message