hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4463) Run more aggressive compactions during off peak hours
Date Thu, 17 Nov 2011 06:18:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151849#comment-13151849
] 

Phabricator commented on HBASE-4463:
------------------------------------

nspiegelberg has commented on the revision "HBASE-4463 [jira] Run more aggressive compactions
during off peak hours".

  @ted : I think allowing minute-level granularity might be little over optimizing.  It just
means that aggressive compact selection ends then.  An agressive compaction can be sitting
in the compaction queue and actually executing after the ending time.  Therefore, you want
to disable aggressive compactions a decent bit of time before your traffic begins to pick
up.

REVISION DETAIL
  https://reviews.facebook.net/D471

                
> Run more aggressive compactions during off peak hours
> -----------------------------------------------------
>
>                 Key: HBASE-4463
>                 URL: https://issues.apache.org/jira/browse/HBASE-4463
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Karthik Ranganathan
>            Assignee: Karthik Ranganathan
>         Attachments: HBASE-4463.D471.1.patch
>
>
> The number of iops on the disk and the top of the rack bandwidth utilization at off peak
hours is much lower than at peak hours depending on the application usage pattern. We can
utilize this knowledge to improve the performance of the HBase cluster by increasing the compact
selection ratio to a much larger value during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will help reduce
the average number of files per store.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message