hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhangduo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13097) Use same EventLoopGroup for different AsyncRpcClients if possible
Date Sat, 28 Feb 2015 04:02:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341310#comment-14341310
] 

zhangduo commented on HBASE-13097:
----------------------------------

https://builds.apache.org/job/HBase-trunk/6181/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout-output.txt
{noformat}
2015-02-28 03:32:26,444 INFO  [MASTER_TABLE_OPERATIONS-asf900:37322-0] hbase.MetaTableAccessor(1306):
Added 2
2015-02-28 03:32:26,445 WARN  [MASTER_TABLE_OPERATIONS-asf900:37322-0] balancer.BaseLoadBalancer(1039):
Wanted to do round robin assignment but no servers to assign to
2015-02-28 03:32:26,445 ERROR [MASTER_TABLE_OPERATIONS-asf900:37322-0] handler.CreateTableHandler(168):
Error trying to create the table testScannerNextRPCTimesout
java.io.IOException: Unable to determine a plan to assign region(s)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1446)
	at org.apache.hadoop.hbase.util.ModifyRegionUtils.assignRegions(ModifyRegionUtils.java:241)
	at org.apache.hadoop.hbase.master.handler.CreateTableHandler.handleCreateTable(CreateTableHandler.java:247)
	at org.apache.hadoop.hbase.master.handler.CreateTableHandler.process(CreateTableHandler.java:156)
	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:103)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:744)
{noformat}

Seems failed to create table?

> Use same EventLoopGroup for different AsyncRpcClients if possible
> -----------------------------------------------------------------
>
>                 Key: HBASE-13097
>                 URL: https://issues.apache.org/jira/browse/HBASE-13097
>             Project: HBase
>          Issue Type: Bug
>          Components: IPC/RPC, test
>    Affects Versions: 2.0.0, 1.1.0
>            Reporter: zhangduo
>            Assignee: zhangduo
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: HBASE-13097-addendum.patch, HBASE-13097.patch, HBASE-13097_1.patch,
HBASE-13097_2.patch
>
>
> In some unit tests(such as TestAcidGuarantees) we create multiple Connection instance.
If we use AsyncRpcClient, then there will be multiple netty Bootstrap and every Bootstrap
has its own PooledByteBufAllocator.
> I haven't read the code clearly but it uses some threadlocal technics and jmap shows
io.netty.buffer.PoolThreadCache$MemoryRegionCache$Entry is the biggest things on Heap.
> See https://builds.apache.org/job/HBase-TRUNK/6168/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt
> {noformat}
> 2015-02-24 23:50:29,704 WARN  [JvmPauseMonitor] util.JvmPauseMonitor$Monitor(167): Detected
pause in JVM or host machine (eg GC): pause of approximately 20133ms
> GC pool 'PS MarkSweep' had collection(s): count=15 time=55525ms
> {noformat}
> Update: We use a singleton PooledByteBufAllocator so the reason should be too many threads.
So we will work on reduce the connections and rpclients in unit tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message