hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huaxiang sun (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17854) Use StealJobQueue in HFileCleaner after HBASE-17215
Date Mon, 03 Apr 2017 16:29:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953743#comment-15953743

huaxiang sun commented on HBASE-17854:

Looks good to me, thanks [~carp84].  I checked that the initial capacity for PriorityBlockingQueue
is 11 in Java 8, is this too small? Maybe we can add a new constructor for StealJobQueue to
specify initialCapacity.

> Use StealJobQueue in HFileCleaner after HBASE-17215
> ---------------------------------------------------
>                 Key: HBASE-17854
>                 URL: https://issues.apache.org/jira/browse/HBASE-17854
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Yu Li
>            Assignee: Yu Li
>         Attachments: HBASE-17854.patch, HBASE-17854.v2.patch, HBASE-17854.v3.patch
> In HBASE-17215 we use specific threads for deleting large/small (archived) hfiles, and
will improve it from below aspects in this JIRA:
> 1. Using {{StealJobQueue}} to allow large file deletion thread to steal jobs from small
queue, based on the experience that in real world there'll be much more small hfiles
> 2. {{StealJobQueue}} is a kind of {{PriorityQueue}}, so we could also delete from the
larger file in the queues.

This message was sent by Atlassian JIRA

View raw message