hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-17660) Compaction for MM runs Cleaner - needs test once IOW is supported
Date Sat, 30 Sep 2017 00:24:04 GMT
Eugene Koifman created HIVE-17660:
-------------------------------------

             Summary: Compaction for MM runs Cleaner - needs test once IOW is supported
                 Key: HIVE-17660
                 URL: https://issues.apache.org/jira/browse/HIVE-17660
             Project: Hive
          Issue Type: Sub-task
          Components: Transactions
            Reporter: Eugene Koifman


Deletion of aborted deltas happens from CompactorMR.run() i.e. from Worker
but the Worker still sets compaction_queue entry to READY_FOR_CLEANING.
This is not needed if there are no base_N dirs which can be created by Insert Overwrite

In this case we can't delete deltas < N until we know no one is reading them, i.e. in Cleaner



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message