Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 9 Feb 2017 06:48:41 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12948593.1457565515000.36097.1486622921793@Atlassian.JIRA>
In-Reply-To: <JIRA.12948593.1457565515000@Atlassian.JIRA>
References: <JIRA.12948593.1457565515000@Atlassian.JIRA> <JIRA.12948593.1457565515801@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HBASE-15437) Response size calculated in
 RPCServer for warning tooLarge responses does NOT count CellScanner payload
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 09 Feb 2017 06:48:53 -0000


    [ https://issues.apache.org/jira/browse/HBASE-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859122#comment-15859122 ] 

Hudson commented on HBASE-15437:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-1.4 #620 (See [https://builds.apache.org/job/HBase-1.4/620/])
HBASE-15437 Response size calculated in RPCServer for warning tooLarge (garyh: rev f61b840a3162c6126129e486eff621e3cf4e1539)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java


> Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15437
>                 URL: https://issues.apache.org/jira/browse/HBASE-15437
>             Project: HBase
>          Issue Type: Bug
>          Components: IPC/RPC
>            Reporter: deepankar
>            Assignee: Jerry He
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15437.patch, HBASE-15437-v1.patch, HBASE-15437-v2.patch, HBASE-15437-v3.patch, HBASE-15437-v4.patch, HBASE-15437-v5.patch, HBASE-15437-v6.patch
>
>
> After HBASE-13158 where we respond back to RPCs with cells in the payload , the protobuf response will just have the count the cells to read from payload, but there are set of features where we log warn in RPCServer whenever the response is tooLarge, but this size now is not considering the sizes of the cells in the PayloadCellScanner. Code form RPCServer
> {code}
>       long responseSize = result.getSerializedSize();
>       // log any RPC responses that are slower than the configured warn
>       // response time or larger than configured warning size
>       boolean tooSlow = (processingTime > warnResponseTime && warnResponseTime > -1);
>       boolean tooLarge = (responseSize > warnResponseSize && warnResponseSize > -1);
>       if (tooSlow || tooLarge) {
>         // when tagging, we let TooLarge trump TooSmall to keep output simple
>         // note that large responses will often also be slow.
>         logResponse(new Object[]{param},
>             md.getName(), md.getName() + "(" + param.getClass().getName() + ")",
>             (tooLarge ? "TooLarge" : "TooSlow"),
>             status.getClient(), startTime, processingTime, qTime,
>             responseSize);
>       }
> {code}
> Should this feature be not supported any more or should we add a method to CellScanner or a new interface which returns the serialized size (but this might not include the compression codecs which might be used during response ?) Any other Idea this could be fixed ?


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)