hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <>
Subject [jira] [Commented] (HIVE-8258) Compactor cleaners can be starved on a busy table or partition.
Date Tue, 14 Oct 2014 03:54:34 GMT


Lefty Leverenz commented on HIVE-8258:

Doc note:  This adds configuration parameter ** to,
so it needs to be documented in the wiki:

* [Hive Transactions -- Configuration |]
* maybe also [Hive Transactions -- Configuration Values to Set for Compaction |]
* [Configuration Properties -- Transactions and Compactor |]

> Compactor cleaners can be starved on a busy table or partition.
> ---------------------------------------------------------------
>                 Key: HIVE-8258
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 0.13.1
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: 0.14.0
>         Attachments: HIVE-8258.2.patch, HIVE-8258.3.patch, HIVE-8258.4.patch, HIVE-8258.5.patch,
HIVE-8258.6.patch, HIVE-8258.patch
> Currently the cleaning thread in the compactor does not run on a table or partition while
any locks are held on this partition.  This leaves it open to starvation in the case of a
busy table or partition.  It only needs to wait until all locks on the table/partition at
the time of the compaction have expired.  Any jobs initiated after that (and thus any locks
obtained) will be for the new versions of the files.

This message was sent by Atlassian JIRA

View raw message