hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15756) Pluggable RpcServer
Date Thu, 04 Aug 2016 06:09:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407240#comment-15407240
] 

stack commented on HBASE-15756:
-------------------------------

Thank you for fast turnaround [~aoxiang]. I'm pretty sure I got your patch in but it still
shows this:

{code}
"epollEventLoopGroup-3-3" #37 prio=10 os_prio=0 tid=0x00007fb95421c470 nid=0x10e3d runnable
[0x00007fb153d6e000]
   java.lang.Thread.State: RUNNABLE
        at sun.misc.Unsafe.freeMemory(Native Method)
        at java.nio.DirectByteBuffer$Deallocator.run(DirectByteBuffer.java:94)
        at sun.misc.Cleaner.clean(Cleaner.java:143)
        at io.netty.util.internal.Cleaner0.freeDirectBuffer(Cleaner0.java:66)
        at io.netty.util.internal.PlatformDependent0.freeDirectBuffer(PlatformDependent0.java:147)
        at io.netty.util.internal.PlatformDependent.freeDirectBuffer(PlatformDependent.java:274)
        at io.netty.buffer.UnpooledUnsafeDirectByteBuf.freeDirect(UnpooledUnsafeDirectByteBuf.java:115)
        at io.netty.buffer.UnpooledUnsafeDirectByteBuf.deallocate(UnpooledUnsafeDirectByteBuf.java:507)
        at io.netty.buffer.AbstractReferenceCountedByteBuf.release(AbstractReferenceCountedByteBuf.java:106)
        at org.apache.hadoop.hbase.ipc.Netty4RpcServer$NettyProtocolDecoder.channelRead(Netty4RpcServer.java:1161)
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787)
        at io.netty.channel.epoll.EpollSocketChannel$EpollSocketUnsafe.epollInReady(EpollSocketChannel.java:722)
        at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:326)
        at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:264)
        at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
        at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
        at java.lang.Thread.run(Thread.java:745)
{code}

.... and throughput is still below default. Do you see Pooled buffer use w/ your changes?

> Pluggable RpcServer
> -------------------
>
>                 Key: HBASE-15756
>                 URL: https://issues.apache.org/jira/browse/HBASE-15756
>             Project: HBase
>          Issue Type: Improvement
>          Components: Performance, rpc
>            Reporter: binlijin
>            Assignee: binlijin
>            Priority: Critical
>         Attachments: Netty4RpcServer_forperf.patch, NettyRpcServer.patch, NettyRpcServer_forperf.patch,
PooledByteBufAllocator.patch, gc.png, gets.png, gets.png, idle.png, queue.png
>
>
> Current we use a simple RpcServer, and can not configure and use other implementation.This
issue is to make the RpcServer pluggable, so we can make other implementation for example
netty rpc server. Patch will upload laterly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message