hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Esteban Gutierrez (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8490) Region mover script can get stuck in infinite loop if UnknownRegionException
Date Mon, 06 May 2013 18:32:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649957#comment-13649957
] 

Esteban Gutierrez commented on HBASE-8490:
------------------------------------------

{code}
while count < retries and same
...
rescue java.lang.reflect.UndeclaredThrowableException => e
      $LOG.info("Exception moving "  + r.getEncodedName() +
        "; split/moved? Continuing: " + e)
      return
    end
...
 end
  raise RuntimeError, "Region stuck on #{original}, newserver=#{newServer}" if same
{code}

                
> Region mover script can get stuck in infinite loop if UnknownRegionException
> ----------------------------------------------------------------------------
>
>                 Key: HBASE-8490
>                 URL: https://issues.apache.org/jira/browse/HBASE-8490
>             Project: HBase
>          Issue Type: Bug
>          Components: shell
>    Affects Versions: 0.92.1
>         Environment: HBase 0.92.1-cdh4.1.3
>            Reporter: Esteban Gutierrez
>            Priority: Minor
>              Labels: noob
>
> {code}
> 13/05/02 23:56:55 INFO region_mover: Moving 1 region(s) from procyon-8.nova.cloudera.com,60020,1367530634629
during this cycle
> 13/05/02 23:56:55 INFO region_mover: Moving region 588ccd887c699c7c23188a79a3d1807f (0
of 1) to server=procyon-5.nova.cloudera.com,60020,1367542172830
> 13/05/02 23:56:55 INFO region_mover: Exception moving 588ccd887c699c7c23188a79a3d1807f;
split/moved? Continuing: java.lang.reflect.UndeclaredThrowableException: org.apache.hadoop.hbase.UnknownRegionException:
588ccd887c699c7c23188a79a3d1807f
> 	at org.apache.hadoop.hbase.master.HMaster.move(HMaster.java:1015)
> 	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> 	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1345)
> {code}
> This was triggered due {{IllegalStateException}} while trying to open an unexisting region:
> {code}
> 2013-05-02 16:23:06,558 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received
request to open region: TestTable,,1367530404417.588ccd887c699c7c23188a79a3d1
> 807f.
> 2013-05-02 16:23:06,583 INFO org.apache.hadoop.hbase.util.FSUtils: hdfs://nameservice1/hbase/TestTable
doesn't exist
> 2013-05-02 16:23:06,586 INFO org.apache.hadoop.hbase.util.FSUtils: hdfs://nameservice1/hbase/TestTable
doesn't exist
> 2013-05-02 16:23:06,586 WARN org.apache.hadoop.hbase.util.FSTableDescriptors: The following
folder is in HBase's root directory and doesn't contain a table descriptor,
>  do consider deleting it: TestTable
> 2013-05-02 16:23:06,666 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:
Failed open of region=TestTable,,1367530404417.588ccd887c699c7c23188a79a3
> d1807f.
> java.lang.IllegalStateException: Could not instantiate a region instance.
> 	at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3123)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3254)
> 	at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:331)
> 	at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:107)
> 	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3120)
> 	... 7 more
> Caused by: java.lang.NullPointerException
> 	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.loadTableCoprocessors(RegionCoprocessorHost.java:133)
> 	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.<init>(RegionCoprocessorHost.java:125)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:376)
> 	... 12 more
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message