hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2695) HMaster cleanup and refactor
Date Tue, 17 Aug 2010 19:16:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899535#action_12899535

Jonathan Gray commented on HBASE-2695:

bq. + Q: Can I miss events like data changed znode data events?
What do you mean "can you miss"?  Like, is it possible or do you mean if it happens will we
still be okay?  Specifically which znode(s) are you talking about?  unassigned ones?  It's
designed so we do not ever miss events, though we can actually miss an individual event we
have guarantees about not missing end states.

bq. + Q: Why when we start a master do we assign root and meta?  Thats a mistake?
Yeah it's a mistake to do that if a failed-over master.  What the assignRoot/assignMeta methods
should do is check to see if they are already assigned, and if so, do nothing.  If not current
assignment we should trigger one and then still wait as we do.

bq. + Q: We let out IEs and KEs?  What are we doing to do w/ them up in the higher levels
of server?
It becomes responsibility of callers.  In most cases, a KE does an abort().  Interrupted needs
to be handled accordingly (in general we don't expect most things to get interrupted, if they
do, it's likely done at shutdown).

bq. + ClusterStatusTracker is wrong.  Its znode is root region location rather than clusterStatusZNode
( /hbase/shutdown)?
Yes it's wrong.  We're not really doing anything with it which is why that didn't matter I
guess.  Like we've discussed, this should be actually used to trigger RS startup rather than
presence of a master.

bq. + In zkassign, we need to fix how it takes regionname when it really wants encodedregionname
-- errorprone; should just pass regioninfo everytime.
Sounds like a fine change to me.  Just need to make sure we can always have a RegionInfo.

bq. + I movd to use event handlers to shutdown regions inside regionserver always.....
Not sure I totally follow.  Let's discuss further.

Any chance at editing your previous comment and introducing some line breaks?  I hate when
these jiras go mega-wide :)

Good stuff.  I'm still making my way through the svn log.

> HMaster cleanup and refactor
> ----------------------------
>                 Key: HBASE-2695
>                 URL: https://issues.apache.org/jira/browse/HBASE-2695
>             Project: HBase
>          Issue Type: Sub-task
>          Components: master
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.90.0
>         Attachments: HBASE-2695-MasterStartupCleanup-v4.patch, HBASE-2695-part1-masterstatus.patch,
HBASE-2695-part2.1-masterstatus.patch, HBASE-2695-ZK-Master-FINAL-v4.patch
> Before doing the more significant changes to HMaster, it would benefit greatly from some
cleanup, commenting, and a bit of refactoring.
> One motivation is to nail down the initialization flow and comment each step.  Another
is to add a couple new classes to break up functionality into helpers to reduce HMaster size
(for example, pushing all filesystem operations into their own class).  And lastly to stop
the practice of passing around references to HMaster everywhere and instead pass along only
what is necessary.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message