hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3112) Enable and disable of table needs a bit of loving in new master
Date Sat, 06 Nov 2010 05:03:22 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928932#action_12928932
] 

stack commented on HBASE-3112:
------------------------------

Currently enable/disable runs synchronously and serially in that the enable/disable handler
runs each table regions unassign one after the other.  This is at a minimum slow when it doesn't
have to be.

What if we changed it so it was async.

Here is how it might work.

 * Client invokes disable table on master
 ** Disable invocation returns immediately
 ** We add a new is_disabled/is_enabled call to client so client can check on state of enable/disable.
 * Master queues a DisableTableHandler.
 ** DTH checks if table already disabled, if so returns
 ** Otherwise, sets disabling flag up in zk then loops on
 *** Getting all regions in a table from meta
 *** Per region, checks if in RIT or not already offline, and if not queues close region executor
 *** Waits around till all table regions clear RIT
 ** On exit from the loop, it sets up in zk that table is disabled.

Same for ETH

If master dies midway, new master will start up a DTH or ETH per table that has disabling
or enabling up in zk.

DTH/ETH must be made idempotent because I think there are situations even still in which they
might fail. If they fail, user might reschedule the disable/enable which would start up a
new DTH (if already a DTH queued and running, they won't clash since only one thread for this
exectuor and the second will just early out because when it checks flag in zk it'll be disabled
so it'll have no work to do).

> Enable and disable of table needs a bit of loving in new master
> ---------------------------------------------------------------
>
>                 Key: HBASE-3112
>                 URL: https://issues.apache.org/jira/browse/HBASE-3112
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.90.0
>
>
> The tools are in place to do a more reliable enable/disable of tables.  Some work has
been done to hack in a basic enable/disable but its not enough -- see the test avro/thrift
tests where a disable/enable/disable switchback can confuse the table state (and has been
disabled until this issue addressed).
> This issue is about finishing off enable/disable in the new master.   I think we need
to add to the table znode an enabling/disabling state rather than have them binary with a
watcher that will stop an enable (or disable) starting until the previous completes (Currently
we atomically switch the state though the region close/open lags -- some work in enable/disable
handlers helps in that they won't complete till all regions have transitioned.. but its not
enough).
> Need to add tests too.
> Marking issue critical bug because loads of the questions we get on lists are about enable/disable
probs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message