hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.
Date Tue, 20 Feb 2018 17:50:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370353#comment-16370353
] 

Sankar Hariappan commented on HIVE-18751:
-----------------------------------------

[~ekoifman] this was a bug in master code too where ValidTxnList configuration (hive.txn.valid.txns) was
not set for ACID tables. But, it doesn't throw exception as we assume all data as committed
and read it.

With HIVE-18192, we throw exception if ACID table scan doesn't see this config (hive.txn.tables.valid.writeids).

So, I think, this need not be a blocker for HIVE-18192.

> ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.
> --------------------------------------------------------------------------------------
>
>                 Key: HIVE-18751
>                 URL: https://issues.apache.org/jira/browse/HIVE-18751
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Transactions
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: ACID, UDF
>             Fix For: 3.0.0
>
>
> Per table write ID (HIVE-18192) have replaced global transaction ID with write ID to
version data files in ACID/MM tables,
> To ensure snapshot isolation, need to generate ValidWriteIdList for the given txn/table
and use it when scan the ACID/MM tables.
> In case of get_splits UDF which runs on ACID table scan query won't receive it properly
through configuration (hive.txn.tables.valid.writeids) and hence throws exception. 
> TestAcidOnTez.testGetSplitsLocks is the test failing for the same. Need to fix it.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message