hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Created] (HIVE-18662) hive.acid.key.index is missing entries
Date Fri, 09 Feb 2018 01:15:00 GMT
Eugene Koifman created HIVE-18662:

             Summary: hive.acid.key.index is missing entries
                 Key: HIVE-18662
             Project: Hive
          Issue Type: Bug
          Components: Transactions
            Reporter: Eugene Koifman

OrcRecordUpdater.KeyIndexBuilder stores an index in ORC footer where each entry is the last
ROW__ID of each stripe.  In acid1 this is used to filter the events from delta file when
merging with part of the base.


as can be seen in \{{TestTxnCommands.testVersioning()}} (added in HIVE-18659) the \{{hive.acid.key.index}}
is empty.  


This is because very little data is written and WriterImpl.flushStripe() is not called except
when \{{WriterImpl.close()} is called.  In the later, \{{WriterCallback.preFooterWrite()}}
is called before \{{preStripeWrite}} and so KeyIndexBuilder.preFooterWriter() records nothing
in \{{hive.acid.key.index}}

This message was sent by Atlassian JIRA

View raw message