hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1009) Master stuck in loop wanting to assign but regions are closing
Date Wed, 19 Nov 2008 21:54:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649174#action_12649174
] 

stack commented on HBASE-1009:
------------------------------

Tried to figure this one.  We try to do the reassignment every 3 seconds which jibes with
regionserver doing its regular report.  The 10 is the maximum number of regions a hrs will
volunteer in its message of most loaded.  Why does the master think these are closing yet
the regionserver keeps passing them in the message is odd.  Around this time we had some hungup
regionservers.  Maybe the regions were closing but not yet closed on the HRS.  Need to check.
 If so, then might make sense reintroducing a closing flag on regions and then do not return
region if its already passed into closing state.

Will check these regions out on regionservers to verify this is indeed the case.

> Master stuck in loop wanting to assign but regions are closing
> --------------------------------------------------------------
>
>                 Key: HBASE-1009
>                 URL: https://issues.apache.org/jira/browse/HBASE-1009
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>            Priority: Blocker
>             Fix For: 0.19.0
>
>
> From streamy logs.
> {code}
> 2008-11-19 10:36:58,933 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:01,315 DEBUG org.apache.hadoop.hbase.master.ServerManager: Total Load:
138, Num Servers: 9, Avg Load: 16.0
> 2008-11-19 10:37:01,935 DEBUG org.apache.hadoop.hbase.master.RegionManager: Server XX.XX.XX.212:60020
is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:01,935 DEBUG org.apache.hadoop.hbase.master.RegionManager: Choosing
to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:01,935 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:04,939 DEBUG org.apache.hadoop.hbase.master.RegionManager: Server  XX.XX.XX.212:60020
is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:04,939 DEBUG org.apache.hadoop.hbase.master.RegionManager: Choosing
to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:04,939 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�,1225411057556 because it is already closing.
> 2008-11-19 10:37:07,941 DEBUG org.apache.hadoop.hbase.master.RegionManager: Server  XX.XX.XX.212:60020
is overloaded. Server load: 21 avg: 16.0, slop: 0.1
> 2008-11-19 10:37:07,941 DEBUG org.apache.hadoop.hbase.master.RegionManager: Choosing
to reassign 5 regions. mostLoadedRegions has 10 regions in it.
> 2008-11-19 10:37:07,941 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streams,'6,1226967394935 because it is already closing.
> 2008-11-19 10:37:07,941 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,'�,1226078595896 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,���,1225472287315 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,X$�,1225411877996 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�},1225411050812 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
api,,1222913694225 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,0��,1226459423496 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
items,R�,1223906859795 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
authentication,,1222913700431 because it is already closing.
> 2008-11-19 10:37:07,942 INFO org.apache.hadoop.hbase.master.RegionManager: Skipping region
streamitems,�,1225411057556 because it is already closing.
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message