hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongzhi Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8872) Hive view of HBase range scan intermittently returns incorrect data.
Date Fri, 14 Nov 2014 16:57:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212472#comment-14212472
] 

Yongzhi Chen commented on HIVE-8872:
------------------------------------

Incorrect data returns only when hive.optimize.ppd=true
Fixed by adding synchronized block for method getSplit in HiveHBaseTableInputFormat

> Hive view of HBase range scan intermittently returns incorrect data.
> --------------------------------------------------------------------
>
>                 Key: HIVE-8872
>                 URL: https://issues.apache.org/jira/browse/HIVE-8872
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>
> This need running in cluster:
> 1. Create a hive external table pointing to a hbase table.
> 2. Create views to the hive table(for example 30 views), each view looks like following
with different range check:
> CREATE VIEW hview_nn AS SELECT * FROM hivehbasetable WHERE (pk >='pk_nn_0' AND pk
<= pk_nn_A')
> 3. Create same number of hive new tables as views.
> 4. then runs several queries in parallel (30 threads):
> INSERT OVERWRITE TABLE hivenewtable_nn SELECT * FROM hview_nn   //nn is from 01 to 30
> 5 After insert, check the hivenewtables, some values are not right.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message