hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5897) prePut coprocessor hook causing substantial CPU usage
Date Mon, 30 Apr 2012 21:41:50 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265399#comment-13265399
] 

Lars Hofhansl commented on HBASE-5897:
--------------------------------------

Looking at the code some more... doMiniBactchPut will handle the entire batch unless it cannot
lock the involved rows (see STEP 1. in doMiniBatchPut).
So calling doMiniBatchPut multiple times on behalf of the same Put operation should be happening
relatively rarely.

                
> prePut coprocessor hook causing substantial CPU usage
> -----------------------------------------------------
>
>                 Key: HBASE-5897
>                 URL: https://issues.apache.org/jira/browse/HBASE-5897
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.92.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>             Fix For: 0.92.2, 0.94.0, 0.96.0
>
>         Attachments: 5897-simple.txt, hbase-5897.txt
>
>
> I was running an insert workload against trunk under oprofile and saw that a significant
portion of CPU usage was going to calling the "prePut" coprocessor hook inside doMiniBatchPut,
even though I don't have any coprocessors installed. I ran a million-row insert and collected
CPU time spent in the RS after commenting out the preput hook, and found CPU usage reduced
by 33%.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message