hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4463) Run more aggressive compactions during off peak hours
Date Thu, 17 Nov 2011 06:30:55 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151856#comment-13151856
] 

Phabricator commented on HBASE-4463:
------------------------------------

lhofhansl has commented on the revision "HBASE-4463 [jira] Run more aggressive compactions
during off peak hours".

  Great idea.

INLINE COMMENTS
  src/main/java/org/apache/hadoop/hbase/regionserver/Store.java:1074 Or use an iterator with
a conditioned break?
  src/main/java/org/apache/hadoop/hbase/regionserver/Store.java:1106 Should we move functionality
like this into CompactionSelection?
  src/main/java/org/apache/hadoop/hbase/regionserver/Store.java:1120 Might be good to have
a CompationSelection.numFiles() (or similar) method
  src/main/java/org/apache/hadoop/hbase/regionserver/Store.java:992 Add method to CompactionSelection
so that we do not constantly "leak" filesToCompact?

REVISION DETAIL
  https://reviews.facebook.net/D471

                
> Run more aggressive compactions during off peak hours
> -----------------------------------------------------
>
>                 Key: HBASE-4463
>                 URL: https://issues.apache.org/jira/browse/HBASE-4463
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Karthik Ranganathan
>            Assignee: Karthik Ranganathan
>         Attachments: HBASE-4463.D471.1.patch
>
>
> The number of iops on the disk and the top of the rack bandwidth utilization at off peak
hours is much lower than at peak hours depending on the application usage pattern. We can
utilize this knowledge to improve the performance of the HBase cluster by increasing the compact
selection ratio to a much larger value during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will help reduce
the average number of files per store.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message