hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14456) Implement a namespace-based region grouping strategy for RegionGroupingProvider
Date Tue, 22 Sep 2015 18:47:07 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903193#comment-14903193
] 

Hudson commented on HBASE-14456:
--------------------------------

FAILURE: Integrated in HBase-TRUNK #6828 (See [https://builds.apache.org/job/HBase-TRUNK/6828/])
HBASE-14456 Implement a namespace-based region grouping strategy for RegionGroupingProvider
(Yu Li) (tedyu: rev 27bc559681fbdbc0961eb6a39b279b9713ed33f1)
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestDurability.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/DisabledWALProvider.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/RegionGroupingProvider.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultCompactSelection.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCacheOnWriteInSchema.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStore.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestBoundedRegionGroupingStrategy.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHMobStore.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALProvider.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestWALObserver.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileRefresherChore.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedGroupingStrategy.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/DefaultWALProvider.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/WALPerformanceEvaluation.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestDefaultWALProvider.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALActionsListener.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFactory.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/NamespaceGroupingStrategy.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/IOTestProvider.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALFactory.java


> Implement a namespace-based region grouping strategy for RegionGroupingProvider
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-14456
>                 URL: https://issues.apache.org/jira/browse/HBASE-14456
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0, 1.3.0
>            Reporter: Yu Li
>            Assignee: Yu Li
>             Fix For: 2.0.0, 1.3.0
>
>         Attachments: HBASE-14456.patch, HBASE-14456_v2.patch, HBASE-14456_v3.patch
>
>
> In HBASE-5699 we introduced multiple wal, and after some succeeding works we now have
two main kinds of wal providers: DefaultWALProvider and RegionGroupingProvider, while DefaultWALProvider
supplies a _single_ wal per regionserver, RegionGroupingProvider supplies _multiple_ wals
according to the RegionGroupingStrategy it's using.
> Now there're two kinds of RegionGroupingStrategy: _identity_ and _bounded_, in which
"identity" only for testing (trial) purpose and "bounded" for randomly assigning region writes
to bounded number of wals. Although the "bounded" strategy is good enough for IO leverage,
we may still want a more "designed" way to distribute the region writes, like having one wal
group per business.
> Since we already have namespace for multi-tenancy, it would be good to have namespace-based
grouping strategy, and this is exactly what this JIRA is for.
> There might be more benefits if we have namespace-based wal group, like only replicating
data for the namespace in need w/o filtering anything useless, or only force region flush
for the heavy loaded namespace, etc. although we  won't include all these in this single JIRA.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message