hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4463) Run more aggressive compactions during off peak hours
Date Thu, 17 Nov 2011 06:13:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151846#comment-13151846
] 

Lars Hofhansl commented on HBASE-4463:
--------------------------------------

re: previous discussions. Automatically detecting a good time to perform more aggressive compactions
would be nice; my vote would be to let's get this simpler time-based scheme in first.

@Ted: Isn't hour-granularity good enough?

                
> Run more aggressive compactions during off peak hours
> -----------------------------------------------------
>
>                 Key: HBASE-4463
>                 URL: https://issues.apache.org/jira/browse/HBASE-4463
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Karthik Ranganathan
>            Assignee: Karthik Ranganathan
>         Attachments: HBASE-4463.D471.1.patch
>
>
> The number of iops on the disk and the top of the rack bandwidth utilization at off peak
hours is much lower than at peak hours depending on the application usage pattern. We can
utilize this knowledge to improve the performance of the HBase cluster by increasing the compact
selection ratio to a much larger value during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will help reduce
the average number of files per store.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message