hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18633) Add more info to understand the source/scenario of large batch requests exceeding threshold
Date Wed, 30 Aug 2017 06:08:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146679#comment-16146679
] 

Hudson commented on HBASE-18633:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-1.4 #893 (See [https://builds.apache.org/job/HBase-1.4/893/])
HBASE-18633 Add more info to understand the source/scenario of large (vikasv: rev 95cc5aac0453e7b49a476c09697940d56eec3837)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMultiLogThreshold.java


> Add more info to understand the source/scenario of large batch requests exceeding threshold
> -------------------------------------------------------------------------------------------
>
>                 Key: HBASE-18633
>                 URL: https://issues.apache.org/jira/browse/HBASE-18633
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 1.4.0, 1.3.1, 2.0.0-alpha-3
>            Reporter: Vikas Vishwakarma
>            Assignee: Vikas Vishwakarma
>             Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-alpha-3
>
>         Attachments: HBASE-18633.branch-1.001.patch, HBASE-18633.master.001.patch, HBASE-18633.master.001.patch
>
>
> In our controlled test env, we are seeing frequent Large batch operation detected warnings
(as implemented in HBASE-18023). 
> We are not running any client with large batch sizes on this test env, but we start seeing
these warnings after some runtime. Maybe it is caused due to some error / retry scenario.
Could also be related to Phoenix index updates based on surrounding activity in the logs.
Need to add more info like table/region name and anything else that will enable debugging
the source or the scenario in which these warnings occur. 
> 2017-08-12 03:40:33,919 WARN  [7,queue=0,port=16020] regionserver.RSRpcServices - Large
batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7108
Client: xxx
> 2017-08-12 03:40:34,476 WARN  [7,queue=0,port=16020] regionserver.RSRpcServices - Large
batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7096
Client: xxx
> 2017-08-12 03:40:34,483 WARN  [4,queue=0,port=16020] regionserver.RSRpcServices - Large
batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7091
Client: xxx
> 2017-08-12 03:40:35,728 WARN  [3,queue=0,port=16020] regionserver.RSRpcServices - Large
batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7102
Client: xxx



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message