hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12016) Reduce number of versions in Meta table. Make it configurable
Date Wed, 29 Oct 2014 04:07:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187974#comment-14187974
] 

Hudson commented on HBASE-12016:
--------------------------------

FAILURE: Integrated in HBase-0.98 #635 (See [https://builds.apache.org/job/HBase-0.98/635/])
HBASE-12205 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable'
to 0.98 (apurtell: rev 81f78fce17f0c67f5b21ca86825bba87ebb534a0)
* hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSTableDescriptors.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotManifest.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/TestFSTableDescriptorForceCreation.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestCase.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestGetClosestAtOrBefore.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/TestHTableDescriptor.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRebuildTestCore.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTable.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java


> Reduce number of versions in Meta table. Make it configurable
> -------------------------------------------------------------
>
>                 Key: HBASE-12016
>                 URL: https://issues.apache.org/jira/browse/HBASE-12016
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Andrey Stepachev
>            Assignee: Andrey Stepachev
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: HBASE-12016.patch, HBASE-12016.patch, HBASE-12016.patch, HBASE-12016.patch,
HBASE-12016.patch, HBASE-12016.patch, HBASE-12016.patch
>
>
> Currently meta keeps up to 10 versions of each KV. 
> For big metas it leads to substantial memory overhead and scan slowdowns.
> (see https://issues.apache.org/jira/browse/HBASE-11165 )
> Need to keep reasonable number of versions (suggested value is 3). 
> Number of versions configurable via parameter: hbase.meta.versions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message