hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5234) partition name filtering uses suboptimal datastructures
Date Mon, 09 Sep 2013 16:31:55 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762001#comment-13762001
] 

Hudson commented on HIVE-5234:
------------------------------

FAILURE: Integrated in Hive-trunk-hadoop1-ptest #157 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/157/])
HIVE-5234 : partition name filtering uses suboptimal datastructures (Sergey Shelukhin via
Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1521158)
* /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java

                
> partition name filtering uses suboptimal datastructures
> -------------------------------------------------------
>
>                 Key: HIVE-5234
>                 URL: https://issues.apache.org/jira/browse/HIVE-5234
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5234.D12777.1.patch
>
>
> Some DSes used in name-based partition filtering, as well as related methods, are suboptimal,
which can cost 100-s of ms on large number of partitions. I noticed while perf testing HIVE-4914,
but it can also be applied separately given that the patch over there will take some time
to get in.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message