hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3154) HBase RPC should support timeout
Date Mon, 01 Nov 2010 17:56:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927062#action_12927062

stack commented on HBASE-3154:

Thanks Hairong. 

HBase and Hadoop RPC diverge in a few places mostly for performance reasons; e..g. we send
a code rather than method name so we don't have to pass a bunch of Text with attendant expensive
(String decoding) deserialization.

The differences are being monitored by one of the lads -- he wants to make our rpc switchable
so can slot in hadoop's 'secure' rpc optionally -- and there is also a push to reunify with
hadoop rpc... we just need to do a bit of measuring to make sure we don't lose a bunch of
perf switching back.

> HBase RPC should support timeout
> --------------------------------
>                 Key: HBASE-3154
>                 URL: https://issues.apache.org/jira/browse/HBASE-3154
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>         Attachments: hbaseRpcTimeoutTrunk.patch
> We see a client stuck at an RPC to a zombie RS. HBase RPC should support timeout.
> "IPC Client (47) connection to msgstore179.ash2.facebook.com/ from
an unknown user" daemon prio=10 tid=0x00007f554c5ab800 nid=0x5df3 runnable [0x00000000590d4000]
> java.lang.Thread.State: RUNNABLE
> at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:215)
> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
> - locked <0x00007f5aa402a9e8> (a sun.nio.ch.Util$1)
> - locked <0x00007f5aa402aac0> (a java.util.Collections$UnmodifiableSet)
> - locked <0x00007f596a398408> (a sun.nio.ch.EPollSelectorImpl)
> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
> at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:332)
> at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
> at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
> at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
> at java.io.FilterInputStream.read(FilterInputStream.java:116)
> at org.apache.hadoop.hbase.ipc.HBaseClient$Connection$PingInputStream.read(HBaseClient.java:279)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
> - locked <0x00007f5a1d7e7bd8> (a java.io.BufferedInputStream)
> at java.io.DataInputStream.readInt(DataInputStream.java:370)
> at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:514)
> at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:454)

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message