hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allan Yan (JIRA)" <>
Subject [jira] [Created] (HIVE-11033) BloomFilter index is not honored by ORC reader
Date Wed, 17 Jun 2015 02:00:09 GMT
Allan Yan created HIVE-11033:

             Summary: BloomFilter index is not honored by ORC reader
                 Key: HIVE-11033
             Project: Hive
          Issue Type: Bug
    Affects Versions: 1.2.0
            Reporter: Allan Yan

There is a bug in the class which caused the bloom
filter index saved in the ORC file not being used. The reason is because the bloomFilterIndices
variable defined in the SargApplier class superseded from its parent class.

Here is one way to fix it
18:46 $ diff src/java/org/apache/hadoop/hive/ql/io/orc/ src/java/org/apache/hadoop/hive/ql/io/orc/
<     bloomFilterIndices = new OrcProto.BloomFilterIndex[types.size()];
<           sarg, options.getColumnNames(), strideRate, types, included.length, bloomFilterIndices);
>           sarg, options.getColumnNames(), strideRate, types, included.length);
>     bloomFilterIndices = new OrcProto.BloomFilterIndex[types.size()];
<         List<OrcProto.Type> types, int includedCount, OrcProto.BloomFilterIndex[]
bloomFilterIndices) {
>         List<OrcProto.Type> types, int includedCount) {
<       this.bloomFilterIndices = bloomFilterIndices;
>       bloomFilterIndices = new OrcProto.BloomFilterIndex[types.size()];

This message was sent by Atlassian JIRA

View raw message