hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <>
Subject [jira] [Commented] (HIVE-8258) Compactor cleaners can be starved on a busy table or partition.
Date Wed, 29 Oct 2014 23:57:34 GMT


Alan Gates commented on HIVE-8258:

I added this value to Hive Transactions  - Configuration and Configuration Properties - Transactions
and Compactor.  I did not add it to HIve Transactions - Configuration Value to Set for Compaction
because it's not necessary to set this (it will work with the default value) and I don't suspect
many users will set it.

I removed the TODOC14 label since I added the documentation.

> Compactor cleaners can be starved on a busy table or partition.
> ---------------------------------------------------------------
>                 Key: HIVE-8258
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 0.13.1
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: 0.14.0
>         Attachments: HIVE-8258.2.patch, HIVE-8258.3.patch, HIVE-8258.4.patch, HIVE-8258.5.patch,
HIVE-8258.6.patch, HIVE-8258.patch
> Currently the cleaning thread in the compactor does not run on a table or partition while
any locks are held on this partition.  This leaves it open to starvation in the case of a
busy table or partition.  It only needs to wait until all locks on the table/partition at
the time of the compaction have expired.  Any jobs initiated after that (and thus any locks
obtained) will be for the new versions of the files.

This message was sent by Atlassian JIRA

View raw message