hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongzhi Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work
Date Tue, 02 Feb 2016 01:02:39 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127370#comment-15127370
] 

Yongzhi Chen commented on HIVE-11609:
-------------------------------------

[~swarnim], I did a test, after I added UDFOPEqual back to the code, the hbase_custom_key3.q
will produce the same query plan as without the fix. But there will be no value returns for
query  select * from hbase_ck_5 where key.col1 = '238' AND key.col2 = '1238' 
The row {"col1":"238","col2":"1238","col3":"2238"}     val_238  is not returned. 
Hope that help you remember how to explain the change. 

> Capability to add a filter to hbase scan via composite key doesn't work
> -----------------------------------------------------------------------
>
>                 Key: HIVE-11609
>                 URL: https://issues.apache.org/jira/browse/HIVE-11609
>             Project: Hive
>          Issue Type: Bug
>          Components: HBase Handler
>            Reporter: Swarnim Kulkarni
>            Assignee: Swarnim Kulkarni
>         Attachments: HIVE-11609.1.patch.txt, HIVE-11609.2.patch.txt, HIVE-11609.3.patch.txt,
HIVE-11609.4.patch.txt, HIVE-11609.5.patch
>
>
> It seems like the capability to add filter to an hbase scan which was added as part of
HIVE-6411 doesn't work. This is primarily because in the HiveHBaseInputFormat, the filter
is added in the getsplits instead of getrecordreader. This works fine for start and stop keys
but not for filter because a filter is respected only when an actual scan is performed. This
is also related to the initial refactoring that was done as part of HIVE-3420.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message