hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15128) Disable region splits and merges in HBCK
Date Thu, 28 Jan 2016 22:22:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122427#comment-15122427
] 

Enis Soztutar commented on HBASE-15128:
---------------------------------------

bq. I'm not able to find the CatalogJanitor storing in Zk (can you point me to the code, I
have only seen an update in-memory), but I see the balancer and the normalizer tracker storing
in zk.
I maybe wrong about the catalog janitor. I thought that is also saves state in zk. 
bq. I'll be more ok if the patch is using the normalizer_switch to toggle and adjust the the
flags, relaying on the existing setNormalizerRunning() rpc.
I think what we want instead is to introduce this setSwitch() with different switch types,
and move all switch types including balancer and normalizer to the new API. We can commit
this patch, and do a follow up on moving the other switches to the new API (at least thats
what I thought was the plan). 


> Disable region splits and merges in HBCK
> ----------------------------------------
>
>                 Key: HBASE-15128
>                 URL: https://issues.apache.org/jira/browse/HBASE-15128
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>            Assignee: Heng Chen
>             Fix For: 2.0.0, 1.3.0
>
>         Attachments: HBASE-15128.patch, HBASE-15128_v1.patch, HBASE-15128_v3.patch
>
>
> In large clusters where region splits are frequent, and HBCK runs take longer, the concurrent
splits cause further problems in HBCK since HBCK assumes a static state for the region partition
map. We have just seen a case where HBCK undo's a concurrently splitting region causing number
of inconsistencies to go up. 
> We can have a mode in master where splits and merges are disabled like the balancer and
catalog janitor switches. Master will reject the split requests if regionservers decide to
split. This switch can be turned on / off by the admins and also automatically by HBCK while
it is running (similar to balancer switch being disabled by HBCK). 
> HBCK  should also disable the Catalog Janitor just in case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message