Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6126210C46 for ; Fri, 7 Feb 2014 22:13:35 +0000 (UTC) Received: (qmail 24177 invoked by uid 500); 7 Feb 2014 22:13:30 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 24049 invoked by uid 500); 7 Feb 2014 22:13:28 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 23918 invoked by uid 99); 7 Feb 2014 22:13:26 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Feb 2014 22:13:26 +0000 Date: Fri, 7 Feb 2014 22:13:26 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-5356) region_mover.rb can hang if table region it belongs to is deleted. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13895122#comment-13895122 ] Hudson commented on HBASE-5356: ------------------------------- SUCCESS: Integrated in hbase-0.96 #285 (See [https://builds.apache.org/job/hbase-0.96/285/]) HBASE-5356 region_mover.rb can hang if table region it belongs to is deleted (jxiang: rev 1565744) * /hbase/branches/0.96/bin/region_mover.rb > region_mover.rb can hang if table region it belongs to is deleted. > ------------------------------------------------------------------ > > Key: HBASE-5356 > URL: https://issues.apache.org/jira/browse/HBASE-5356 > Project: HBase > Issue Type: Bug > Affects Versions: 0.90.3, 0.92.0, 0.94.0 > Reporter: Jonathan Hsieh > Assignee: Jimmy Xiang > Priority: Minor > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: hbase-5356.patch > > > I was testing the region_mover.rb script on a loaded hbase and noticed that it can hang (thus hanging graceful shutdown) if a region that it is attempting to move gets deleted (by a table delete operation). > Here's the start of the relevent stack dump > {code} > 12/02/08 13:27:13 WARN client.HConnectionManager$HConnectionImplementation: Encountered problems when prefetch META table: > org.apache.hadoop.hbase.TableNotFoundException: Cannot find row in .META. for table: TestLoadAndVerify_1328735001040, row=TestLoadAnd\ > Verify_1328735001040,yC^P\xD7\x945\xD4,99999999999999 > at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:136) > at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:95) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:64\ > 9) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:703\ > ) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:594) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:565) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:416) > at org.apache.hadoop.hbase.client.ServerCallable.instantiateServer(ServerCallable.java:57) > at org.apache.hadoop.hbase.client.ScannerCallable.instantiateServer(ScannerCallable.java:63) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.\ > java:1018) > at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1104) > at org.apache.hadoop.hbase.client.HTable$ClientScanner.initialize(HTable.java:1027) > at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:535) > at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:525) > at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:380) > at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:58) > at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:137) > at usr.lib.hbase.bin.region_mover.method__7$RUBY$isSuccessfulScan(/usr/lib/hbase/bin/region_mover.rb:133) > at usr$lib$hbase$bin$region_mover#method__7$RUBY$isSuccessfulScan.call(usr$lib$hbase$bin$region_mover#method__7$RUBY$isSucces\ > sfulScan:65535) > at usr$lib$hbase$bin$region_mover#method__7$RUBY$isSuccessfulScan.call(usr$lib$hbase$bin$region_mover#method__7$RUBY$isSucces\ > sfulScan:65535) > at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:171) > at usr.lib.hbase.bin.region_mover.block_4$RUBY$__for__(/usr/lib/hbase/bin/region_mover.rb:326) > at usr$lib$hbase$bin$region_mover#block_4$RUBY$__for__.call(usr$lib$hbase$bin$region_mover#block_4$RUBY$__for__:65535) > at org.jruby.runtime.CompiledBlock.yield(CompiledBlock.java:133) > at org.jruby.runtime.BlockBody.call(BlockBody.java:73) > at org.jruby.runtime.Block.call(Block.java:89) > at org.jruby.RubyProc.call(RubyProc.java:268) > at org.jruby.RubyProc.call(RubyProc.java:228) > at org.jruby.RubyProc$i$0$0$call.call(RubyProc$i$0$0$call.gen:65535) > at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:209) > at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:205) > at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:137) > at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) > at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:103) > at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) > at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:103) > at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) > at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) > at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) > at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) > at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:272) > at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:114) > at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:123) > at usr.lib.hbase.bin.region_mover.chained_26_rescue_4$RUBY$SYNTHETICunloadRegions(/usr/lib/hbase/bin/region_mover.rb:319) > at usr.lib.hbase.bin.region_mover.method__25$RUBY$unloadRegions(/usr/lib/hbase/bin/region_mover.rb:313) > at usr$lib$hbase$bin$region_mover#method__25$RUBY$unloadRegions.call(usr$lib$hbase$bin$region_mover#method__25$RUBY$unloadRegions:65535) > at usr$lib$hbase$bin$region_mover#method__25$RUBY$unloadRegions.call(usr$lib$hbase$bin$region_mover#method__25$RUBY$unloadRegions:65535) > at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302) > at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:173) > at usr.lib.hbase.bin.region_mover.__file__(/usr/lib/hbase/bin/region_mover.rb:430) > at usr.lib.hbase.bin.region_mover.load(/usr/lib/hbase/bin/region_mover.rb) > at org.jruby.Ruby.runScript(Ruby.java:670) > at org.jruby.Ruby.runNormally(Ruby.java:574) > at org.jruby.Ruby.runFromMain(Ruby.java:423) > at org.jruby.Main.doRunFromMain(Main.java:278) > at org.jruby.Main.internalRun(Main.java:198) > at org.jruby.Main.run(Main.java:164) > at org.jruby.Main.run(Main.java:148) > at org.jruby.Main.main(Main.java:128) > {code} -- This message was sent by Atlassian JIRA (v6.1.5#6160)