hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13714) Add tracking of the total response queue size
Date Sat, 01 Aug 2015 17:09:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650463#comment-14650463
] 

Anoop Sam John commented on HBASE-13714:
----------------------------------------

bq.the byte buffer used for the respohnse in some calls was close to 1MB
This call was actually returning result of this size? Or much lesser?  Any idea u have?  We
had an issue with the buffer (for cell block creation) size calculation in BoundedByteBufferPool

> Add tracking of the total response queue size
> ---------------------------------------------
>
>                 Key: HBASE-13714
>                 URL: https://issues.apache.org/jira/browse/HBASE-13714
>             Project: HBase
>          Issue Type: Improvement
>          Components: master, metrics, regionserver, rpc
>    Affects Versions: 2.0.0, 1.0.2, 1.2.0
>            Reporter: Esteban Gutierrez
>
> I noticed this behavior while working on HBASE-13694:
> Once we are done processing a request, we decrement the call queue size on the RPC server.
However, responses can be very large and sometimes sending them can take a long time. Since
we don't keep track the response queue via metrics it is hard to spot when the responses are
using too much resources on the RS. 
> Ideally we should be tracking on the RS how much data we have in-flight in the response
queue via metrics and not just in the logs if the size of the response exceeds a threshold
(e.g hbase.ipc.warn.response.size or hbase.ipc.warn.response.time)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message