Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 15 Jun 2011 02:30:47 +0000 (UTC)
From: "zhoushuaifeng (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: 
 <1842351023.5535.1308105047955.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <16087348.5779.1307604119018.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HBASE-3969) Outdated data can not be cleaned in
 time
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13049579#comment-13049579 ] 

zhoushuaifeng commented on HBASE-3969:
--------------------------------------

For the 3rd solution, the trunk has a lot of change on compact thread, it's a big change. It's a little easier to the branch 0.90.x

> Outdated data can not be cleaned in time
> ----------------------------------------
>
>                 Key: HBASE-3969
>                 URL: https://issues.apache.org/jira/browse/HBASE-3969
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>    Affects Versions: 0.90.1, 0.90.2, 0.90.3
>            Reporter: zhoushuaifeng
>             Fix For: 0.90.4
>
>         Attachments: HBASE-3969-solution1.patch
>
>
> Compaction checker will send regions to the compact queue to do compact. But the priority of these regions is too low if these regions have only a few storefiles. When there is large through output, and the compact queue will aways have some regions with higher priority. This may causing the major compact be delayed for a long time(even a few days),  and outdated data cleaning will also be delayed.
> In our test case, we found some regions sent to the queue by major compact checker hunging in the queue for more than 2 days! Some scanners on these regions cannot get availably data for a long time and lease expired.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira