hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13369) AcidUtils.getAcidState() is not paying attention toValidTxnList when choosing the "best" base file
Date Tue, 31 May 2016 19:51:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308468#comment-15308468
] 

Jesus Camacho Rodriguez commented on HIVE-13369:
------------------------------------------------

[~wzheng], I am removing 2.1.0 as target because the RC will be created tomorrow. Please feel
free to commit to branch-2.1 anyway and fix for 2.1.0 if this happens before the release,
or let me know if this is a Blocker. Thanks

> AcidUtils.getAcidState() is not paying attention toValidTxnList when choosing the "best"
base file
> --------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-13369
>                 URL: https://issues.apache.org/jira/browse/HIVE-13369
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Wei Zheng
>            Priority: Blocker
>
> The JavaDoc on getAcidState() reads, in part:
> "Note that because major compactions don't
>    preserve the history, we can't use a base directory that includes a
>    transaction id that we must exclude."
> which is correct but there is nothing in the code that does this.
> And if we detect a situation where txn X must be excluded but and there are deltas that
contain X, we'll have to aborted the txn.  This can't (reasonably) happen with auto commit
mode, but with multi statement txns it's possible.
> Suppose some long running txn starts and lock in snapshot at 17 (HWM).  An hour later
it decides to access some partition for which all txns < 20 (for example) have already
been compacted (i.e. GC'd).  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message